Compare commits

Home / Compare 21aa0978 .. 6851f7e4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-35.263=-1.283
σ0.050-0.053=-0.003
min33.954-35.235=-1.282
max34.120-35.412=-1.291
mean414.000-415.900=-1.900
σ0.000-0.316=-0.316
min414.000-415.000=-1.000
max414.000-416.000=-2.000
mean0.085-0.086=-0.001
σ0.003-0.004=-0.001
min0.082-0.082=-0.000
max0.091-0.093=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.317-23.770=-0.453
σ0.002-0.004=-0.003
min23.314-23.766=-0.452
max23.319-23.779=-0.461
mean414.000-416.700=-2.700
σ0.000-0.483=-0.483
min414.000-416.000=-2.000
max414.000-417.000=-3.000
mean0.065-0.068=-0.003
σ0.003-0.003=-0.001
min0.063-0.066=-0.002
max0.072-0.076=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.429-1756.486=0.943
σ0.364-0.366=-0.002
min1756.854-1755.909=0.945
max1758.015-1757.074=0.941
mean1649.150-1651.100=-1.950
σ627.580-640.180=-12.600
min636.000-629.000=7.000
max2823.000-2833.000=-10.000
mean2.325-2.341=-0.016
σ0.082-0.074=0.009
min2.238-2.246=-0.008
max2.556-2.503=0.052

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.586-324.711=1.875
σ0.029-0.049=-0.020
min326.537-324.624=1.912
max326.608-324.743=1.865
mean2823.000-2833.000=-10.000
σ0.000
min2823.000-2833.000=-10.000
max2823.000-2833.000=-10.000
mean0.422-0.425=-0.002
σ0.005-0.001=0.004
min0.419-0.423=-0.005
max0.431-0.426=0.005
iters=5
new-facts=1
prior-facts=6402
mean1988.741-1985.268=3.473
σ0.006-0.002=0.005
min1988.735-1985.266=3.469
max1988.751-1985.271=3.480
mean2823.000-2833.000=-10.000
σ0.000
min2823.000-2833.000=-10.000
max2823.000-2833.000=-10.000
mean2.699-2.563=0.136
σ0.076-0.120=-0.044
min2.628-2.390=0.238
max2.786-2.685=0.102
iters=5
new-facts=6402
prior-facts=1
mean4813.374-4808.872=4.502
σ7.562-7.655=-0.093
min4809.578-4805.337=4.241
max4826.894-4822.565=4.329
mean2823.000-2833.000=-10.000
σ0.000
min2823.000-2833.000=-10.000
max2823.000-2833.000=-10.000
mean8.818-8.768=0.050
σ0.390-0.261=0.129
min8.283-8.446=-0.163
max9.210-9.144=0.066
iters=5
new-facts=6402
prior-facts=6402
mean5001.147-4996.467=4.680
σ0.030-0.021=0.009
min5001.113-4996.441=4.671
max5001.187-4996.495=4.693
mean3036.800-3046.600=-9.800
σ199.371-189.765=9.606
min2823.000-2833.000=-10.000
max3322.000-3319.000=3.000
mean9.797-8.806=0.990
σ0.253-0.236=0.018
min9.547-8.539=1.008
max10.217-9.054=1.163

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.940-1.002=-0.062
σ0.060-0.066=-0.006
min0.904-0.920=-0.016
max1.045-1.056=-0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.562-462.975=1.587
σ574.767-574.250=0.517
min177.177-175.839=1.338
max1326.712-1324.350=2.363
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2823.000-2833.000=-10.000
σ0.000
min2823.000-2833.000=-10.000
max2823.000-2833.000=-10.000
mean0.434-0.435=-0.001
σ0.304-0.305=-0.001
min0.278-0.280=-0.002
max0.889-0.893=-0.003
policies=20
mean1772.045-1758.703=13.342
σ0.353-0.350=0.003
min1771.811-1758.471=13.340
max1772.569-1759.223=13.347
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2823.000-2833.000=-10.000
σ0.000
min2823.000-2833.000=-10.000
max2823.000-2833.000=-10.000
mean2.776-2.763=0.013
σ0.007-0.065=-0.057
min2.770-2.666=0.104
max2.787-2.801=-0.015
policies=200
mean17727.652-17593.233=134.419
σ0.506-0.838=-0.332
min17727.321-17592.135=135.185
max17728.399-17593.958=134.441
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2823.000-2833.000=-10.000
σ0.000
min2823.000-2833.000=-10.000
max2823.000-2833.000=-10.000
mean27.875-27.903=-0.028
σ0.441-0.406=0.035
min27.497-27.523=-0.026
max28.389-28.399=-0.010