Compare commits

Home / Compare 4630e3ad .. 57be6afe

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.261-35.262=-0.001
σ0.054-0.054=-0.001
min35.232-35.232=0.000
max35.412-35.414=-0.002
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.084-0.083=0.001
σ0.005-0.004=0.001
min0.076-0.077=-0.001
max0.092-0.090=0.002
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.004-0.003=0.001
min23.765-23.766=-0.001
max23.778-23.773=0.005
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.069-0.069=-0.000
σ0.003-0.003=0.000
min0.066-0.067=-0.001
max0.075-0.075=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.472-1756.469=0.003
σ0.366-0.365=0.001
min1755.895-1755.897=-0.002
max1757.066-1757.058=0.008
mean1649.250-1659.850=-10.600
σ639.593-644.118=-4.525
min626.000-631.000=-5.000
max2826.000-2801.000=25.000
mean2.311-2.349=-0.038
σ0.054-0.125=-0.072
min2.238-2.218=0.020
max2.398-2.781=-0.383

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.683-324.694=-0.010
σ0.056-0.053=0.003
min324.588-324.599=-0.012
max324.722-324.720=0.002
mean2826.000-2801.000=25.000
σ0.000
min2826.000-2801.000=25.000
max2826.000-2801.000=25.000
mean0.429-0.425=0.004
σ0.007-0.001=0.007
min0.425-0.424=0.000
max0.442-0.426=0.017
iters=5
new-facts=1
prior-facts=6402
mean1985.253-1985.259=-0.007
σ0.007-0.009=-0.002
min1985.244-1985.244=-0.000
max1985.263-1985.266=-0.004
mean2826.000-2801.000=25.000
σ0.000
min2826.000-2801.000=25.000
max2826.000-2801.000=25.000
mean2.689-2.600=0.090
σ0.116-0.077=0.040
min2.546-2.507=0.039
max2.842-2.687=0.155
iters=5
new-facts=6402
prior-facts=1
mean4808.841-4808.845=-0.005
σ7.656-7.684=-0.028
min4805.374-4805.379=-0.005
max4822.536-4822.591=-0.054
mean2826.000-2801.000=25.000
σ0.000
min2826.000-2801.000=25.000
max2826.000-2801.000=25.000
mean8.831-8.837=-0.006
σ0.170-0.127=0.043
min8.633-8.657=-0.024
max8.974-9.002=-0.029
iters=5
new-facts=6402
prior-facts=6402
mean4996.456-4996.457=-0.001
σ0.017-0.018=-0.001
min4996.432-4996.432=-0.000
max4996.476-4996.480=-0.004
mean3058.000-3065.600=-7.600
σ248.623-238.188=10.436
min2826.000-2801.000=25.000
max3319.000-3407.000=-88.000
mean8.754-8.774=-0.021
σ0.245-0.150=0.095
min8.509-8.559=-0.050
max9.104-8.975=0.129

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.969-1.019=-0.050
σ0.071-0.136=-0.065
min0.908-0.903=0.005
max1.046-1.242=-0.196

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.948-462.950=-0.003
σ574.255-574.252=0.003
min175.815-175.816=-0.001
max1324.331-1324.329=0.002
mean86.250
σ8.500
min82.000
max99.000
mean2826.000-2801.000=25.000
σ0.000
min2826.000-2801.000=25.000
max2826.000-2801.000=25.000
mean0.434-0.429=0.006
σ0.300-0.292=0.008
min0.280-0.281=-0.001
max0.884-0.867=0.017
policies=20
mean1758.475-1758.468=0.007
σ0.345-0.360=-0.015
min1758.242-1758.216=0.026
max1758.986-1759.002=-0.016
mean820.000
σ0.000
min820.000
max820.000
mean2826.000-2801.000=25.000
σ0.000
min2826.000-2801.000=25.000
max2826.000-2801.000=25.000
mean2.796-2.789=0.007
σ0.006-0.011=-0.005
min2.790-2.782=0.008
max2.805-2.806=-0.001
policies=200
mean17590.963-17590.239=0.724
σ0.855-0.508=0.347
min17589.802-17589.930=-0.128
max17591.619-17590.997=0.622
mean8200.000
σ0.000
min8200.000
max8200.000
mean2826.000-2801.000=25.000
σ0.000
min2826.000-2801.000=25.000
max2826.000-2801.000=25.000
mean27.853-27.558=0.295
σ0.404-0.252=0.152
min27.460-27.273=0.187
max28.324-27.863=0.461