Compare commits

Home / Compare 8e27d94a .. be00e6bd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.983-33.983=-0.000
σ0.049-0.049=-0.001
min33.957-33.955=0.002
max34.118-34.119=-0.001
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.085-0.085=-0.000
σ0.003-0.004=-0.001
min0.082-0.082=0.000
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.318-23.317=0.001
σ0.003-0.002=0.001
min23.315-23.314=0.001
max23.322-23.319=0.003
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.067-0.065=0.001
σ0.003-0.002=0.001
min0.064-0.064=0.001
max0.075-0.071=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.429-1757.425=0.004
σ0.365-0.364=0.000
min1756.857-1756.857=0.001
max1758.018-1758.016=0.002
mean1653.500-1660.100=-6.600
σ629.490-650.600=-21.110
min643.000-626.000=17.000
max2827.000-2812.000=15.000
mean2.383-2.430=-0.047
σ0.111-0.257=-0.146
min2.272-2.257=0.015
max2.793-3.421=-0.628

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.574-326.577=-0.003
σ0.054-0.046=0.009
min326.478-326.498=-0.019
max326.613-326.614=-0.002
mean2827.000-2812.000=15.000
σ0.000
min2827.000-2812.000=15.000
max2827.000-2812.000=15.000
mean0.425-0.423=0.001
σ0.007-0.005=0.002
min0.419-0.421=-0.002
max0.436-0.432=0.005
iters=5
new-facts=1
prior-facts=6402
mean1988.731-1988.724=0.006
σ0.023-0.024=-0.000
min1988.700-1988.695=0.006
max1988.757-1988.745=0.012
mean2827.000-2812.000=15.000
σ0.000
min2827.000-2812.000=15.000
max2827.000-2812.000=15.000
mean2.712-2.671=0.041
σ0.160-0.046=0.114
min2.566-2.595=-0.030
max2.980-2.720=0.261
iters=5
new-facts=6402
prior-facts=1
mean4813.550-4813.557=-0.008
σ7.664-7.674=-0.010
min4810.069-4810.085=-0.016
max4827.259-4827.284=-0.025
mean2827.000-2812.000=15.000
σ0.000
min2827.000-2812.000=15.000
max2827.000-2812.000=15.000
mean8.946-8.897=0.049
σ0.293-0.406=-0.113
min8.605-8.552=0.054
max9.263-9.438=-0.175
iters=5
new-facts=6402
prior-facts=6402
mean5001.150-5001.131=0.019
σ0.036-0.025=0.011
min5001.117-5001.097=0.020
max5001.191-5001.155=0.036
mean3015.800-3026.000=-10.200
σ199.888-220.032=-20.144
min2827.000-2812.000=15.000
max3307.000-3334.000=-27.000
mean9.907-9.532=0.375
σ0.402-0.512=-0.110
min9.476-8.653=0.823
max10.501-9.908=0.593

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.044-1.033=0.011
σ0.091-0.264=-0.172
min0.922-0.912=0.010
max1.179-1.505=-0.326

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.335-464.332=0.003
σ574.296-574.292=0.004
min177.177-177.171=0.006
max1325.779-1325.769=0.009
mean88.250
σ8.500
min84.000
max101.000
mean2827.000-2812.000=15.000
σ0.000
min2827.000-2812.000=15.000
max2827.000-2812.000=15.000
mean0.437-0.434=0.003
σ0.304-0.307=-0.002
min0.284-0.278=0.006
max0.893-0.894=-0.001
policies=20
mean1772.071-1772.048=0.023
σ0.360-0.367=-0.007
min1771.821-1771.796=0.025
max1772.603-1772.593=0.011
mean840.000
σ0.000
min840.000
max840.000
mean2827.000-2812.000=15.000
σ0.000
min2827.000-2812.000=15.000
max2827.000-2812.000=15.000
mean2.793-2.790=0.003
σ0.005-0.008=-0.003
min2.787-2.784=0.003
max2.798-2.802=-0.004
policies=200
mean17727.515-17727.539=-0.024
σ0.560-0.488=0.072
min17727.141-17727.204=-0.063
max17728.347-17728.264=0.083
mean8400.000
σ0.000
min8400.000
max8400.000
mean2827.000-2812.000=15.000
σ0.000
min2827.000-2812.000=15.000
max2827.000-2812.000=15.000
mean27.882-27.520=0.362
σ0.343-0.229=0.114
min27.597-27.344=0.253
max28.320-27.831=0.490