Compare commits

Home / Compare 3da987ae .. cb4221dc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.994-33.994=0.000
σ0.053-0.052=0.001
min33.964-33.965=-0.002
max34.142-34.139=0.003
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.084-0.085=-0.000
σ0.003-0.004=-0.001
min0.082-0.082=0.000
max0.091-0.093=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.318-23.317=0.001
σ0.003-0.002=0.002
min23.314-23.314=-0.001
max23.324-23.320=0.004
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.065-0.064=0.001
σ0.004-0.003=0.001
min0.058-0.060=-0.002
max0.072-0.069=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1762.692-1762.690=0.002
σ0.367-0.366=0.001
min1762.116-1762.117=-0.001
max1763.301-1763.287=0.014
mean1635.600-1624.350=11.250
σ599.208-596.784=2.425
min643.000
max2441.000-2409.000=32.000
mean2.381-2.370=0.011
σ0.120-0.108=0.012
min2.259-2.221=0.038
max2.809-2.663=0.146

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean339.175-339.177=-0.001
σ0.066-0.064=0.003
min339.057-339.063=-0.006
max339.210-339.207=0.004
mean2441.000-2409.000=32.000
σ0.000
min2441.000-2409.000=32.000
max2441.000-2409.000=32.000
mean0.436-0.435=0.001
σ0.005-0.001=0.004
min0.432-0.434=-0.002
max0.444-0.436=0.008
iters=5
new-facts=1
prior-facts=6402
mean2003.800-2003.798=0.002
σ0.005-0.014=-0.009
min2003.792-2003.784=0.008
max2003.807-2003.814=-0.007
mean2441.000-2409.000=32.000
σ0.000
min2441.000-2409.000=32.000
max2441.000-2409.000=32.000
mean3.227-3.166=0.061
σ0.142-0.201=-0.059
min3.124-2.884=0.240
max3.466-3.450=0.016
iters=5
new-facts=6402
prior-facts=1
mean4828.583-4828.423=0.161
σ7.739-7.753=-0.014
min4824.964-4824.527=0.438
max4842.425-4842.285=0.140
mean2441.000-2409.000=32.000
σ0.000
min2441.000-2409.000=32.000
max2441.000-2409.000=32.000
mean8.475-8.415=0.060
σ0.577-0.272=0.305
min7.956-7.946=0.010
max9.211-8.641=0.570
iters=5
new-facts=6402
prior-facts=6402
mean5016.204-5016.207=-0.003
σ0.010-0.017=-0.007
min5016.190-5016.181=0.008
max5016.218-5016.221=-0.004
mean2958.600-2957.400=1.200
σ260.854-276.609=-15.755
min2634.000-2577.000=57.000
max3316.000-3296.000=20.000
mean8.607-8.667=-0.061
σ0.068-0.231=-0.163
min8.488-8.507=-0.020
max8.657-9.068=-0.411

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.757-1.827=-0.070
σ0.097-0.071=0.025
min1.620-1.744=-0.125
max1.867-1.911=-0.045

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.149-468.144=0.005
σ575.278-575.280=-0.002
min180.505-180.503=0.003
max1331.066-1331.064=0.002
mean92.250
σ8.500
min88.000
max105.000
mean2441.000-2409.000=32.000
σ0.000
min2441.000-2409.000=32.000
max2441.000-2409.000=32.000
mean0.557-0.588=-0.031
σ0.551-0.615=-0.064
min0.279-0.279=0.000
max1.383-1.510=-0.127
policies=20
mean1805.341-1805.315=0.026
σ0.400-0.398=0.002
min1805.095-1805.071=0.024
max1805.938-1805.909=0.029
mean880.000
σ0.000
min880.000
max880.000
mean2441.000-2409.000=32.000
σ0.000
min2441.000-2409.000=32.000
max2441.000-2409.000=32.000
mean2.764-2.765=-0.001
σ0.018-0.021=-0.003
min2.749-2.739=0.010
max2.789-2.789=0.000
policies=200
mean18061.045-18060.903=0.142
σ0.464-0.497=-0.034
min18060.679-18060.645=0.034
max18061.717-18061.649=0.068
mean8800.000
σ0.000
min8800.000
max8800.000
mean2441.000-2409.000=32.000
σ0.000
min2441.000-2409.000=32.000
max2441.000-2409.000=32.000
mean27.900-27.957=-0.058
σ0.217-0.136=0.082
min27.761-27.805=-0.043
max28.219-28.081=0.138