Compare commits

Home / Compare 2edde16b .. 4e9a7b49

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.978=0.001
σ0.050-0.047=0.002
min33.948-33.952=-0.003
max34.116-34.108=0.008
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.085-0.080=0.006
σ0.003-0.004=-0.001
min0.082-0.076=0.006
max0.092-0.087=0.005
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.000
σ0.004-0.003=0.001
min23.309-23.313=-0.003
max23.321-23.321=0.001
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.066-0.066=-0.000
σ0.002-0.003=-0.001
min0.064-0.064=0.000
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.429-1757.364=0.065
σ0.364-0.365=-0.001
min1756.855-1756.787=0.068
max1758.018-1757.954=0.064
mean1667.500-1650.800=16.700
σ618.367-646.850=-28.483
min666.000-626.000=40.000
max2600.000-2805.000=-205.000
mean2.396-2.379=0.017
σ0.159-0.133=0.026
min2.272-2.273=-0.001
max3.005-2.892=0.113

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.568-326.506=0.062
σ0.047-0.062=-0.015
min326.484-326.396=0.088
max326.595-326.550=0.045
mean2600.000-2805.000=-205.000
σ0.000
min2600.000-2805.000=-205.000
max2600.000-2805.000=-205.000
mean0.424-0.435=-0.010
σ0.002-0.009=-0.007
min0.422-0.427=-0.005
max0.427-0.449=-0.022
iters=5
new-facts=1
prior-facts=6402
mean1988.738-1988.681=0.057
σ0.012-0.004=0.008
min1988.718-1988.675=0.043
max1988.747-1988.685=0.063
mean2600.000-2805.000=-205.000
σ0.000
min2600.000-2805.000=-205.000
max2600.000-2805.000=-205.000
mean2.726-2.683=0.042
σ0.163-0.037=0.126
min2.565-2.626=-0.062
max2.912-2.730=0.183
iters=5
new-facts=6402
prior-facts=1
mean4813.515-4813.544=-0.029
σ7.788-7.747=0.041
min4809.661-4809.973=-0.312
max4827.440-4827.401=0.039
mean2600.000-2805.000=-205.000
σ0.000
min2600.000-2805.000=-205.000
max2600.000-2805.000=-205.000
mean8.356-8.483=-0.127
σ0.613-0.590=0.023
min7.762-7.806=-0.044
max9.371-9.302=0.069
iters=5
new-facts=6402
prior-facts=6402
mean5001.056-5001.064=-0.008
σ0.172-0.041=0.132
min5000.748-5000.998=-0.250
max5001.140-5001.105=0.035
mean2958.800-3035.000=-76.200
σ390.668-289.595=101.073
min2600.000-2805.000=-205.000
max3505.000-3474.000=31.000
mean9.252-9.681=-0.430
σ0.588-0.234=0.355
min8.531-9.320=-0.789
max9.829-9.923=-0.094

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.220-1.066=0.154
σ0.320-0.107=0.214
min0.907-0.928=-0.021
max1.586-1.228=0.358

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.564-464.508=0.055
σ574.780-574.771=0.009
min177.170-177.108=0.062
max1326.734-1326.665=0.069
mean88.250
σ8.500
min84.000
max101.000
mean2600.000-2805.000=-205.000
σ0.000
min2600.000-2805.000=-205.000
max2600.000-2805.000=-205.000
mean0.550-0.434=0.117
σ0.547-0.307=0.240
min0.275-0.278=-0.002
max1.371-0.895=0.477
policies=20
mean1772.024-1771.430=0.593
σ0.337-0.366=-0.029
min1771.795-1771.180=0.616
max1772.524-1771.972=0.553
mean840.000
σ0.000
min840.000
max840.000
mean2600.000-2805.000=-205.000
σ0.000
min2600.000-2805.000=-205.000
max2600.000-2805.000=-205.000
mean2.722-2.804=-0.083
σ0.010-0.020=-0.010
min2.708-2.791=-0.083
max2.729-2.833=-0.104
policies=200
mean17727.601-17721.114=6.487
σ0.544-0.376=0.168
min17727.292-17720.890=6.403
max17728.415-17721.676=6.739
mean8400.000
σ0.000
min8400.000
max8400.000
mean2600.000-2805.000=-205.000
σ0.000
min2600.000-2805.000=-205.000
max2600.000-2805.000=-205.000
mean27.578-27.591=-0.013
σ0.115-0.078=0.036
min27.445-27.479=-0.033
max27.680-27.660=0.021