Compare commits

Home / Compare e0e6f0ed .. db216e58

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=0.001
σ0.047-0.048=-0.002
min33.950-33.938=0.012
max34.107-34.112=-0.004
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.085-0.084=0.001
σ0.003-0.005=-0.002
min0.082-0.077=0.005
max0.090-0.090=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.317-23.319=-0.001
σ0.003-0.003=-0.001
min23.314-23.313=0.001
max23.323-23.323=-0.000
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.066-0.065=0.001
σ0.003-0.002=0.000
min0.064-0.063=0.000
max0.072-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1719.361=37.942
σ0.365-169.689=-169.324
min1756.729-998.435=758.294
max1757.892-1757.891=0.001
mean1664.500-1632.400=32.100
σ627.394-599.529=27.864
min670.000-667.000=3.000
max2612.000-2610.000=2.000
mean2.370-2.321=0.049
σ0.099-0.226=-0.127
min2.273-1.483=0.790
max2.677-2.693=-0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.441-326.437=0.004
σ0.050-0.054=-0.004
min326.353-326.340=0.013
max326.477-326.469=0.008
mean2612.000-2610.000=2.000
σ0.000
min2612.000-2610.000=2.000
max2612.000-2610.000=2.000
mean0.427-0.423=0.003
σ0.005-0.001=0.005
min0.421-0.423=-0.001
max0.432-0.424=0.008
iters=5
new-facts=1
prior-facts=6402
mean1988.613-1988.608=0.005
σ0.012-0.011=0.001
min1988.593-1988.592=0.001
max1988.622-1988.620=0.002
mean2612.000-2610.000=2.000
σ0.000
min2612.000-2610.000=2.000
max2612.000-2610.000=2.000
mean2.701-2.811=-0.110
σ0.086-0.189=-0.103
min2.626-2.647=-0.021
max2.848-3.030=-0.183
iters=5
new-facts=6402
prior-facts=1
mean4813.357-4813.448=-0.091
σ7.776-7.728=0.048
min4809.460-4809.913=-0.453
max4827.261-4827.272=-0.012
mean2612.000-2610.000=2.000
σ0.000
min2612.000-2610.000=2.000
max2612.000-2610.000=2.000
mean9.005-8.575=0.430
σ0.215-0.505=-0.290
min8.636-7.815=0.820
max9.174-9.225=-0.051
iters=5
new-facts=6402
prior-facts=6402
mean5000.949-5000.935=0.014
σ0.161-0.181=-0.020
min5000.662-5000.612=0.050
max5001.038-5001.035=0.003
mean2961.800-2978.000=-16.200
σ263.683-405.144=-141.461
min2633.000-2610.000=23.000
max3321.000-3551.000=-230.000
mean9.859-9.730=0.129
σ0.320-0.328=-0.008
min9.360-9.350=0.009
max10.199-10.033=0.166

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.303-1.104=0.199
σ0.333-0.338=-0.005
min0.919-0.915=0.004
max1.736-1.701=0.035

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.430-464.441=-0.012
σ574.778-574.782=-0.003
min177.040-177.044=-0.004
max1326.597-1326.614=-0.016
mean88.250
σ8.500
min84.000
max101.000
mean2612.000-2610.000=2.000
σ0.000
min2612.000-2610.000=2.000
max2612.000-2610.000=2.000
mean0.560-0.564=-0.005
σ0.574-0.568=0.006
min0.271-0.273=-0.002
max1.421-1.416=0.005
policies=20
mean1770.752-1770.764=-0.011
σ0.355-0.356=-0.001
min1770.521-1770.533=-0.012
max1771.280-1771.293=-0.013
mean840.000
σ0.000
min840.000
max840.000
mean2612.000-2610.000=2.000
σ0.000
min2612.000-2610.000=2.000
max2612.000-2610.000=2.000
mean2.734-2.732=0.002
σ0.040-0.013=0.027
min2.696-2.724=-0.028
max2.771-2.751=0.020
policies=200
mean17714.947-17714.835=0.112
σ0.540-0.438=0.102
min17714.638-17714.453=0.185
max17715.755-17715.464=0.291
mean8400.000
σ0.000
min8400.000
max8400.000
mean2612.000-2610.000=2.000
σ0.000
min2612.000-2610.000=2.000
max2612.000-2610.000=2.000
mean27.527-27.537=-0.010
σ0.225-0.140=0.084
min27.352-27.394=-0.042
max27.846-27.679=0.167