Compare commits

Home / Compare cb4221dc .. 2094c2c5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.994-33.994=0.000
σ0.053-0.053=0.000
min33.959-33.964=-0.004
max34.144-34.142=0.002
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.083-0.084=-0.001
σ0.005-0.003=0.003
min0.077-0.082=-0.006
max0.092-0.091=0.001
cache=y
dps=1
iters=10
policies=100
mean23.318-23.318=0.000
σ0.003-0.003=-0.000
min23.313-23.314=-0.000
max23.322-23.324=-0.003
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.065-0.065=0.000
σ0.003-0.004=-0.001
min0.061-0.058=0.003
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1762.689-1762.692=-0.003
σ0.366-0.367=-0.001
min1762.116-1762.116=0.000
max1763.286-1763.301=-0.015
mean1623.550-1635.600=-12.050
σ597.556-599.208=-1.653
min634.000-643.000=-9.000
max2411.000-2441.000=-30.000
mean2.355-2.381=-0.026
σ0.151-0.120=0.032
min2.121-2.259=-0.138
max2.758-2.809=-0.051

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean339.183-339.175=0.007
σ0.062-0.066=-0.005
min339.073-339.057=0.016
max339.217-339.210=0.007
mean2411.000-2441.000=-30.000
σ0.000
min2411.000-2441.000=-30.000
max2411.000-2441.000=-30.000
mean0.433-0.436=-0.002
σ0.001-0.005=-0.004
min0.433-0.432=0.000
max0.435-0.444=-0.010
iters=5
new-facts=1
prior-facts=6402
mean2003.801-2003.800=0.002
σ0.005-0.005=-0.000
min2003.792-2003.792=0.000
max2003.806-2003.807=-0.001
mean2411.000-2441.000=-30.000
σ0.000
min2411.000-2441.000=-30.000
max2411.000-2441.000=-30.000
mean3.257-3.227=0.030
σ0.131-0.142=-0.011
min3.150-3.124=0.026
max3.443-3.466=-0.023
iters=5
new-facts=6402
prior-facts=1
mean4828.607-4828.583=0.023
σ7.738-7.739=-0.001
min4824.964-4824.964=-0.000
max4842.446-4842.425=0.021
mean2411.000-2441.000=-30.000
σ0.000
min2411.000-2441.000=-30.000
max2411.000-2441.000=-30.000
mean8.427-8.475=-0.048
σ0.691-0.577=0.113
min7.605-7.956=-0.351
max9.237-9.211=0.026
iters=5
new-facts=6402
prior-facts=6402
mean5016.059-5016.204=-0.144
σ0.309-0.010=0.300
min5015.506-5016.190=-0.683
max5016.208-5016.218=-0.009
mean3008.800-2958.600=50.200
σ298.438-260.854=37.584
min2599.000-2634.000=-35.000
max3382.000-3316.000=66.000
mean8.642-8.607=0.035
σ0.104-0.068=0.036
min8.498-8.488=0.010
max8.742-8.657=0.084

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.745-1.757=-0.012
σ0.144-0.097=0.048
min1.559-1.620=-0.061
max1.946-1.867=0.079

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.149-468.149=0.000
σ575.276-575.278=-0.002
min180.505-180.505=-0.001
max1331.063-1331.066=-0.003
mean92.250
σ8.500
min88.000
max105.000
mean2411.000-2441.000=-30.000
σ0.000
min2411.000-2441.000=-30.000
max2411.000-2441.000=-30.000
mean0.554-0.557=-0.003
σ0.545-0.551=-0.005
min0.279-0.279=0.000
max1.372-1.383=-0.011
policies=20
mean1805.342-1805.341=0.001
σ0.393-0.400=-0.007
min1805.097-1805.095=0.002
max1805.928-1805.938=-0.010
mean880.000
σ0.000
min880.000
max880.000
mean2411.000-2441.000=-30.000
σ0.000
min2411.000-2441.000=-30.000
max2411.000-2441.000=-30.000
mean2.758-2.764=-0.005
σ0.016-0.018=-0.002
min2.734-2.749=-0.015
max2.767-2.789=-0.022
policies=200
mean18061.092-18061.045=0.047
σ0.446-0.464=-0.017
min18060.785-18060.679=0.107
max18061.754-18061.717=0.038
mean8800.000
σ0.000
min8800.000
max8800.000
mean2411.000-2441.000=-30.000
σ0.000
min2411.000-2441.000=-30.000
max2411.000-2441.000=-30.000
mean27.945-27.900=0.045
σ0.140-0.217=-0.078
min27.790-27.761=0.029
max28.104-28.219=-0.115