Compare commits

Home / Compare 8dad54e4 .. e011948a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.967-35.973=-0.006
σ0.107-0.106=0.001
min35.920-35.926=-0.006
max36.271-36.275=-0.004
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.077-0.077=0.001
σ0.005-0.004=0.000
min0.072-0.071=0.001
max0.086-0.085=0.001
cache=y
dps=1
iters=10
policies=100
mean26.208-26.209=-0.000
σ0.005-0.003=0.002
min26.201-26.203=-0.002
max26.217-26.214=0.002
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.062-0.060=0.002
σ0.003-0.003=-0.000
min0.060-0.056=0.004
max0.071-0.068=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.327-1758.363=-3.036
σ0.368-0.372=-0.003
min1754.755-1757.786=-3.031
max1755.921-1758.956=-3.034
mean1649.850-1656.250=-6.400
σ631.796-624.261=7.535
min669.000-684.000=-15.000
max2749.000-2764.000=-15.000
mean2.409-2.391=0.018
σ0.172-0.088=0.084
min2.269-2.288=-0.019
max2.908-2.561=0.348

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.510-279.510=0.000
σ0.007-0.005=0.002
min279.502-279.505=-0.004
max279.516-279.517=-0.001
mean2749.000-2764.000=-15.000
σ0.000
min2749.000-2764.000=-15.000
max2749.000-2764.000=-15.000
mean0.409-0.408=0.002
σ0.008-0.004=0.004
min0.403-0.405=-0.002
max0.423-0.415=0.007
iters=5
new-facts=1
prior-facts=6402
mean2173.703-2178.442=-4.740
σ0.025-0.019=0.005
min2173.663-2178.421=-4.758
max2173.729-2178.472=-4.742
mean2749.000-2764.000=-15.000
σ0.000
min2749.000-2764.000=-15.000
max2749.000-2764.000=-15.000
mean2.943-3.318=-0.375
σ0.299-0.264=0.035
min2.662-3.088=-0.426
max3.390-3.773=-0.383
iters=5
new-facts=6402
prior-facts=1
mean5053.219-5056.375=-3.155
σ1.108-0.986=0.122
min5052.138-5055.811=-3.673
max5055.089-5058.124=-3.035
mean2749.000-2764.000=-15.000
σ0.000
min2749.000-2764.000=-15.000
max2749.000-2764.000=-15.000
mean9.128-9.017=0.112
σ0.607-0.733=-0.126
min8.101-7.912=0.189
max9.628-9.817=-0.189
iters=5
new-facts=6402
prior-facts=6402
mean5185.968-5193.739=-7.771
σ0.113-0.103=0.010
min5185.835-5193.621=-7.786
max5186.088-5193.850=-7.762
mean3212.800-3244.000=-31.200
σ354.307-482.498=-128.192
min2840.000-2764.000=76.000
max3754.000-3922.000=-168.000
mean8.825-8.740=0.085
σ0.159-0.151=0.008
min8.601-8.616=-0.015
max8.984-8.995=-0.010

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.972-1.033=-0.061
σ0.054-0.066=-0.012
min0.933-0.951=-0.018
max1.066-1.085=-0.020

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.494-465.479=0.015
σ572.654-572.669=-0.015
min179.164-179.141=0.022
max1324.476-1324.483=-0.007
mean79.500
σ7.000
min76.000
max90.000
mean2749.000-2764.000=-15.000
σ0.000
min2749.000-2764.000=-15.000
max2749.000-2764.000=-15.000
mean0.439-0.484=-0.044
σ0.301-0.405=-0.104
min0.285-0.280=0.004
max0.891-1.091=-0.200
policies=20
mean1791.712-1791.664=0.048
σ0.308-0.326=-0.018
min1791.488-1791.470=0.018
max1792.165-1792.148=0.017
mean760.000
σ0.000
min760.000
max760.000
mean2749.000-2764.000=-15.000
σ0.000
min2749.000-2764.000=-15.000
max2749.000-2764.000=-15.000
mean2.855-2.795=0.060
σ0.098-0.013=0.085
min2.796-2.778=0.018
max3.000-2.809=0.192
policies=200
mean17923.462-17923.278=0.185
σ0.482-0.543=-0.062
min17923.208-17922.859=0.349
max17924.184-17924.071=0.113
mean7600.000
σ0.000
min7600.000
max7600.000
mean2749.000-2764.000=-15.000
σ0.000
min2749.000-2764.000=-15.000
max2749.000-2764.000=-15.000
mean28.229-28.185=0.044
σ0.115-0.114=0.000
min28.132-28.059=0.073
max28.365-28.293=0.072