Compare commits

Home / Compare 08611921 .. e8f4dad0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=0.001
σ0.050-0.049=0.001
min33.945-33.951=-0.006
max34.117-34.114=0.003
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.085-0.082=0.003
σ0.003-0.006=-0.003
min0.081-0.077=0.005
max0.089-0.092=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.318-23.317=0.000
σ0.004-0.003=0.000
min23.313-23.313=0.000
max23.324-23.323=0.001
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.065-0.065=-0.000
σ0.003-0.002=0.001
min0.060-0.064=-0.004
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.429-1757.364=0.065
σ0.364-0.364=-0.000
min1756.857-1756.787=0.070
max1758.018-1757.952=0.066
mean1656.500-1654.150=2.350
σ634.778-626.539=8.239
min619.000-678.000=-59.000
max2669.000-2601.000=68.000
mean2.382-2.388=-0.006
σ0.120-0.131=-0.011
min2.273-2.255=0.019
max2.816-2.717=0.099

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.579-326.504=0.075
σ0.033-0.056=-0.023
min326.520-326.405=0.116
max326.602-326.541=0.061
mean2669.000-2601.000=68.000
σ0.000
min2669.000-2601.000=68.000
max2669.000-2601.000=68.000
mean0.426-0.431=-0.006
σ0.001-0.004=-0.003
min0.425-0.427=-0.002
max0.428-0.436=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1988.725-1988.663=0.062
σ0.020-0.020=0.001
min1988.701-1988.637=0.064
max1988.746-1988.677=0.069
mean2669.000-2601.000=68.000
σ0.000
min2669.000-2601.000=68.000
max2669.000-2601.000=68.000
mean2.766-2.813=-0.047
σ0.266-0.191=0.075
min2.618-2.637=-0.019
max3.238-3.039=0.199
iters=5
new-facts=6402
prior-facts=1
mean4813.590-4813.441=0.149
σ7.725-7.435=0.290
min4810.024-4810.009=0.015
max4827.408-4826.740=0.668
mean2669.000-2601.000=68.000
σ0.000
min2669.000-2601.000=68.000
max2669.000-2601.000=68.000
mean8.522-8.238=0.284
σ0.582-0.465=0.118
min7.929-7.799=0.130
max9.303-8.892=0.411
iters=5
new-facts=6402
prior-facts=6402
mean5001.136-5001.076=0.060
σ0.031-0.020=0.011
min5001.110-5001.051=0.059
max5001.187-5001.098=0.089
mean2967.400-2948.200=19.200
σ246.679-366.153=-119.475
min2669.000-2601.000=68.000
max3299.000-3448.000=-149.000
mean9.533-9.906=-0.372
σ0.641-0.107=0.534
min8.531-9.776=-1.245
max10.284-10.023=0.261

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.990-1.223=-0.233
σ0.109-0.261=-0.152
min0.906-0.914=-0.007
max1.157-1.595=-0.438

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.568-464.503=0.065
σ574.771-574.785=-0.013
min177.179-177.108=0.071
max1326.725-1326.680=0.045
mean88.250
σ8.500
min84.000
max101.000
mean2669.000-2601.000=68.000
σ0.000
min2669.000-2601.000=68.000
max2669.000-2601.000=68.000
mean0.539-0.548=-0.009
σ0.530-0.547=-0.017
min0.272-0.272=-0.001
max1.334-1.368=-0.034
policies=20
mean1772.049-1771.379=0.670
σ0.351-0.352=-0.001
min1771.828-1771.152=0.676
max1772.573-1771.903=0.670
mean840.000
σ0.000
min840.000
max840.000
mean2669.000-2601.000=68.000
σ0.000
min2669.000-2601.000=68.000
max2669.000-2601.000=68.000
mean2.730-2.733=-0.003
σ0.012-0.019=-0.008
min2.720-2.707=0.013
max2.744-2.754=-0.010
policies=200
mean17727.299-17721.117=6.183
σ0.507-0.505=0.002
min17726.985-17720.781=6.205
max17728.055-17721.868=6.188
mean8400.000
σ0.000
min8400.000
max8400.000
mean2669.000-2601.000=68.000
σ0.000
min2669.000-2601.000=68.000
max2669.000-2601.000=68.000
mean27.533-27.683=-0.150
σ0.125-0.195=-0.071
min27.425-27.501=-0.076
max27.662-27.909=-0.247