Compare commits

Home / Compare b76bde18 .. b9ec0e2c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.957-30.959=-0.002
σ0.050-0.049=0.001
min30.919-30.918=0.001
max31.095-31.094=0.000
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.073-0.079=-0.006
σ0.004-0.003=0.001
min0.070-0.076=-0.007
max0.081-0.084=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.061-21.062=-0.001
σ0.001-0.002=-0.001
min21.058-21.058=0.000
max21.063-21.065=-0.003
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.061-0.063=-0.003
σ0.004-0.002=0.002
min0.057-0.062=-0.005
max0.068-0.070=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1751.410=0.002
σ0.361-0.362=-0.001
min1750.846-1750.841=0.004
max1751.993-1751.993=0.000
mean1664.150-1638.950=25.200
σ623.701-618.851=4.850
min640.000-650.000=-10.000
max2513.000-2475.000=38.000
mean2.835-2.765=0.070
σ0.158-0.192=-0.033
min2.318-2.321=-0.003
max3.176-3.204=-0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.403-273.402=0.002
σ0.008-0.014=-0.005
min273.395-273.387=0.008
max273.414-273.416=-0.002
mean2513.000-2475.000=38.000
σ0.000
min2513.000-2475.000=38.000
max2513.000-2475.000=38.000
mean0.387-0.384=0.002
σ0.007-0.008=-0.001
min0.379-0.376=0.003
max0.396-0.395=0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.839-1933.844=-0.005
σ0.006-0.007=-0.001
min1933.831-1933.835=-0.004
max1933.845-1933.854=-0.009
mean2513.000-2475.000=38.000
σ0.000
min2513.000-2475.000=38.000
max2513.000-2475.000=38.000
mean3.083-3.109=-0.026
σ0.159-0.133=0.026
min2.892-2.976=-0.084
max3.297-3.285=0.012
iters=5
new-facts=6402
prior-facts=1
mean4754.232-4754.366=-0.134
σ0.623-0.844=-0.221
min4753.767-4753.769=-0.002
max4755.328-4755.846=-0.517
mean2513.000-2475.000=38.000
σ0.000
min2513.000-2475.000=38.000
max2513.000-2475.000=38.000
mean8.560-8.812=-0.252
σ0.503-0.889=-0.386
min7.786-7.769=0.017
max9.020-10.152=-1.131
iters=5
new-facts=6402
prior-facts=6402
mean4944.798-4944.730=0.068
σ0.082-0.206=-0.124
min4944.729-4944.388=0.341
max4944.899-4944.900=-0.001
mean2968.200-2988.200=-20.000
σ339.393-357.623=-18.230
min2528.000-2530.000=-2.000
max3293.000-3332.000=-39.000
mean8.729-8.627=0.102
σ0.218-0.161=0.057
min8.526-8.401=0.125
max9.045-8.835=0.211

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.746-1.801=-0.055
σ0.202-0.081=0.121
min1.391-1.697=-0.306
max1.897-1.904=-0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.329-463.330=-0.001
σ572.197-572.194=0.003
min177.225-177.231=-0.005
max1321.624-1321.620=0.005
mean79.750
σ7.500
min76.000
max91.000
mean2513.000-2475.000=38.000
σ0.000
min2513.000-2475.000=38.000
max2513.000-2475.000=38.000
mean0.549-0.541=0.008
σ0.533-0.532=0.001
min0.276-0.271=0.005
max1.348-1.339=0.010
policies=20
mean1772.562-1772.574=-0.012
σ0.330-0.332=-0.002
min1772.338-1772.351=-0.013
max1773.051-1773.066=-0.016
mean760.000
σ0.000
min760.000
max760.000
mean2513.000-2475.000=38.000
σ0.000
min2513.000-2475.000=38.000
max2513.000-2475.000=38.000
mean2.748-2.739=0.009
σ0.020-0.014=0.007
min2.734-2.722=0.012
max2.777-2.753=0.025
policies=200
mean17732.463-17732.234=0.229
σ0.514-0.488=0.026
min17732.067-17731.857=0.210
max17733.216-17732.936=0.281
mean7600.000
σ0.000
min7600.000
max7600.000
mean2513.000-2475.000=38.000
σ0.000
min2513.000-2475.000=38.000
max2513.000-2475.000=38.000
mean27.608-27.641=-0.032
σ0.147-0.107=0.040
min27.495-27.507=-0.011
max27.824-27.766=0.058