Compare commits

Home / Compare 1c8c7611 .. d9b55c4b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.618=0.000
σ0.056-0.055=0.000
min35.585-35.587=-0.002
max35.775-35.775=0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.084-0.086=-0.001
σ0.003-0.004=-0.001
min0.081-0.081=0.000
max0.091-0.093=-0.002
cache=y
dps=1
iters=10
policies=100
mean24.047-24.047=0.000
σ0.003-0.003=0.000
min24.044-24.045=-0.000
max24.054-24.053=0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.068-0.064=0.005
σ0.003-0.004=-0.001
min0.066-0.061=0.005
max0.074-0.072=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.490=0.001
σ0.364-0.365=-0.002
min1755.915-1755.914=0.001
max1757.076-1757.076=-0.000
mean1652.850-1642.300=10.550
σ629.238-643.911=-14.673
min618.000-616.000=2.000
max2704.000-2718.000=-14.000
mean2.338-2.385=-0.047
σ0.100-0.113=-0.013
min2.201-2.221=-0.020
max2.636-2.633=0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.764-324.765=-0.001
σ0.048-0.042=0.006
min324.678-324.691=-0.013
max324.793-324.792=0.001
mean2704.000-2718.000=-14.000
σ0.000
min2704.000-2718.000=-14.000
max2704.000-2718.000=-14.000
mean0.423-0.428=-0.005
σ0.001-0.009=-0.008
min0.421-0.421=0.000
max0.425-0.442=-0.017
iters=5
new-facts=1
prior-facts=6402
mean1985.313-1985.316=-0.003
σ0.017-0.021=-0.003
min1985.295-1985.292=0.002
max1985.332-1985.334=-0.001
mean2704.000-2718.000=-14.000
σ0.000
min2704.000-2718.000=-14.000
max2704.000-2718.000=-14.000
mean2.609-2.631=-0.021
σ0.149-0.102=0.047
min2.453-2.551=-0.098
max2.857-2.761=0.097
iters=5
new-facts=6402
prior-facts=1
mean4808.961-4809.096=-0.135
σ7.742-7.647=0.095
min4805.018-4805.611=-0.593
max4822.801-4822.775=0.026
mean2704.000-2718.000=-14.000
σ0.000
min2704.000-2718.000=-14.000
max2704.000-2718.000=-14.000
mean8.823-8.962=-0.139
σ0.261-0.362=-0.101
min8.495-8.581=-0.086
max9.163-9.521=-0.358
iters=5
new-facts=6402
prior-facts=6402
mean4996.626-4996.621=0.005
σ0.025-0.028=-0.003
min4996.598-4996.589=0.009
max4996.653-4996.652=0.001
mean2971.000-2982.200=-11.200
σ234.749-310.297=-75.548
min2704.000-2718.000=-14.000
max3307.000-3430.000=-123.000
mean8.545-8.458=0.086
σ0.104-0.049=0.056
min8.447-8.398=0.049
max8.714-8.511=0.203

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.004-0.974=0.030
σ0.068-0.145=-0.077
min0.916-0.902=0.014
max1.056-1.232=-0.176

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.215-463.224=-0.009
σ574.769-574.795=-0.026
min175.820-175.814=0.006
max1325.369-1325.417=-0.048
mean86.250
σ8.500
min82.000
max99.000
mean2704.000-2718.000=-14.000
σ0.000
min2704.000-2718.000=-14.000
max2704.000-2718.000=-14.000
mean0.541-0.531=0.009
σ0.534-0.514=0.020
min0.273-0.273=0.001
max1.341-1.302=0.039
policies=20
mean1758.503-1758.498=0.005
σ0.327-0.321=0.007
min1758.292-1758.281=0.010
max1758.989-1758.973=0.017
mean820.000
σ0.000
min820.000
max820.000
mean2704.000-2718.000=-14.000
σ0.000
min2704.000-2718.000=-14.000
max2704.000-2718.000=-14.000
mean2.723-2.694=0.029
σ0.024-0.016=0.008
min2.698-2.677=0.021
max2.755-2.711=0.044
policies=200
mean17591.933-17592.157=-0.224
σ0.686-0.533=0.153
min17591.303-17591.851=-0.548
max17592.911-17592.955=-0.045
mean8200.000
σ0.000
min8200.000
max8200.000
mean2704.000-2718.000=-14.000
σ0.000
min2704.000-2718.000=-14.000
max2704.000-2718.000=-14.000
mean27.379-27.396=-0.016
σ0.145-0.121=0.024
min27.206-27.239=-0.033
max27.512-27.519=-0.007