Compare commits

Home / Compare b3ed4379 .. 3a38a4ae

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798-35.798=0.001
σ0.106-0.107=-0.000
min35.749-35.749=0.000
max36.100-36.101=-0.001
mean416.200-418.000=-1.800
σ0.422-0.000=0.422
min416.000-418.000=-2.000
max417.000-418.000=-1.000
mean0.076-0.074=0.002
σ0.003-0.005=-0.002
min0.073-0.068=0.005
max0.082-0.083=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.065-26.065=-0.000
σ0.003-0.002=0.001
min26.059-26.062=-0.003
max26.068-26.067=0.000
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.060-0.061=-0.001
σ0.003-0.002=0.000
min0.058-0.059=-0.002
max0.068-0.068=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.923-1755.922=0.002
σ0.367-0.367=0.001
min1755.349-1755.352=-0.003
max1756.513-1756.516=-0.004
mean1666.150-1669.550=-3.400
σ631.274-627.745=3.529
min669.000-677.000=-8.000
max2616.000-2667.000=-51.000
mean2.790-2.804=-0.014
σ0.148-0.128=0.021
min2.479-2.535=-0.056
max2.992-2.972=0.020

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.194-277.194=0.000
σ0.005-0.005=0.000
min277.189-277.188=0.001
max277.199-277.199=-0.000
mean2616.000-2667.000=-51.000
σ0.000
min2616.000-2667.000=-51.000
max2616.000-2667.000=-51.000
mean0.397-0.395=0.002
σ0.005-0.004=0.001
min0.393-0.392=0.001
max0.405-0.402=0.004
iters=5
new-facts=1
prior-facts=6402
mean2174.441-2174.435=0.005
σ0.017-0.021=-0.003
min2174.426-2174.406=0.020
max2174.467-2174.464=0.003
mean2616.000-2667.000=-51.000
σ0.000
min2616.000-2667.000=-51.000
max2616.000-2667.000=-51.000
mean2.966-2.825=0.141
σ0.134-0.137=-0.002
min2.796-2.746=0.051
max3.101-3.068=0.033
iters=5
new-facts=6402
prior-facts=1
mean5052.385-5052.660=-0.275
σ1.131-1.025=0.106
min5051.567-5051.998=-0.431
max5054.330-5054.478=-0.148
mean2616.000-2667.000=-51.000
σ0.000
min2616.000-2667.000=-51.000
max2616.000-2667.000=-51.000
mean8.839-8.823=0.016
σ0.707-1.015=-0.307
min8.051-8.029=0.022
max9.530-10.468=-0.937
iters=5
new-facts=6402
prior-facts=6402
mean5188.355-5188.352=0.003
σ0.115-0.211=-0.096
min5188.181-5188.002=0.179
max5188.503-5188.527=-0.024
mean3237.600-3276.200=-38.600
σ394.756-482.314=-87.558
min2698.000-2667.000=31.000
max3739.000-3858.000=-119.000
mean9.066-8.937=0.129
σ0.257-0.429=-0.172
min8.720-8.652=0.068
max9.318-9.675=-0.357

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.308-1.243=0.065
σ0.300-0.372=-0.071
min0.952-0.941=0.011
max1.618-1.878=-0.260

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.857-464.855=0.002
σ572.659-572.657=0.001
min178.524-178.521=0.003
max1323.845-1323.841=0.004
mean79.500
σ7.000
min76.000
max90.000
mean2616.000-2667.000=-51.000
σ0.000
min2616.000-2667.000=-51.000
max2616.000-2667.000=-51.000
mean0.540-0.546=-0.006
σ0.508-0.514=-0.006
min0.281-0.279=0.002
max1.302-1.316=-0.014
policies=20
mean1785.489-1785.465=0.023
σ0.348-0.349=-0.001
min1785.250-1785.230=0.020
max1786.004-1785.983=0.020
mean760.000
σ0.000
min760.000
max760.000
mean2616.000-2667.000=-51.000
σ0.000
min2616.000-2667.000=-51.000
max2616.000-2667.000=-51.000
mean2.799-2.785=0.014
σ0.006-0.022=-0.016
min2.791-2.763=0.028
max2.807-2.815=-0.008
policies=200
mean17861.496-17861.512=-0.016
σ0.377-0.550=-0.173
min17861.289-17861.098=0.191
max17862.060-17862.322=-0.261
mean7600.000
σ0.000
min7600.000
max7600.000
mean2616.000-2667.000=-51.000
σ0.000
min2616.000-2667.000=-51.000
max2616.000-2667.000=-51.000
mean28.306-28.261=0.046
σ0.189-0.102=0.087
min28.098-28.127=-0.029
max28.498-28.352=0.146