Compare commits

Home / Compare 54863c06 .. e0a2f632

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.797-35.799=-0.002
σ0.109-0.106=0.003
min35.746-35.755=-0.009
max36.105-36.101=0.005
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.067-0.075=-0.009
σ0.016-0.004=0.012
min0.044-0.071=-0.027
max0.084-0.083=0.001
cache=y
dps=1
iters=10
policies=100
mean26.064-26.065=-0.001
σ0.004-0.003=0.002
min26.059-26.062=-0.002
max26.071-26.069=0.003
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.056-0.061=-0.005
σ0.006-0.002=0.003
min0.047-0.060=-0.013
max0.061-0.068=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.923-1755.923=-0.000
σ0.368-0.365=0.002
min1755.350-1755.355=-0.005
max1756.521-1756.519=0.002
mean1667.950-1658.650=9.300
σ628.755-624.861=3.894
min675.000-673.000=2.000
max2666.000-2653.000=13.000
mean2.848-2.799=0.050
σ0.109-0.120=-0.011
min2.612-2.546=0.066
max3.010-3.056=-0.045

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.196-277.196=-0.000
σ0.006-0.006=-0.000
min277.191-277.191=0.001
max277.206-277.204=0.002
mean2666.000-2653.000=13.000
σ0.000
min2666.000-2653.000=13.000
max2666.000-2653.000=13.000
mean0.406-0.400=0.006
σ0.010-0.009=0.001
min0.401-0.393=0.008
max0.424-0.414=0.010
iters=5
new-facts=1
prior-facts=6402
mean2174.428-2174.434=-0.007
σ0.011-0.033=-0.022
min2174.409-2174.381=0.028
max2174.438-2174.471=-0.033
mean2666.000-2653.000=13.000
σ0.000
min2666.000-2653.000=13.000
max2666.000-2653.000=13.000
mean2.950-3.031=-0.081
σ0.130-0.247=-0.117
min2.770-2.757=0.013
max3.125-3.378=-0.253
iters=5
new-facts=6402
prior-facts=1
mean5052.406-5052.438=-0.032
σ0.806-1.016=-0.210
min5051.652-5051.615=0.038
max5053.765-5054.206=-0.441
mean2666.000-2653.000=13.000
σ0.000
min2666.000-2653.000=13.000
max2666.000-2653.000=13.000
mean8.760-8.888=-0.129
σ0.542-0.382=0.160
min8.136-8.237=-0.101
max9.460-9.200=0.259
iters=5
new-facts=6402
prior-facts=6402
mean5188.430-5188.413=0.017
σ0.087-0.100=-0.013
min5188.361-5188.281=0.081
max5188.531-5188.516=0.016
mean3296.200-3226.400=69.800
σ417.306-383.086=34.220
min2712.000-2690.000=22.000
max3682.000-3705.000=-23.000
mean8.929-8.889=0.040
σ0.303-0.266=0.037
min8.691-8.668=0.024
max9.457-9.310=0.147

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.345-1.233=0.112
σ0.326-0.338=-0.012
min1.068-0.946=0.122
max1.826-1.805=0.021

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.857-464.856=0.002
σ572.659-572.659=-0.000
min178.524-178.520=0.004
max1323.846-1323.844=0.002
mean79.500
σ7.000
min76.000
max90.000
mean2666.000-2653.000=13.000
σ0.000
min2666.000-2653.000=13.000
max2666.000-2653.000=13.000
mean0.546-0.560=-0.014
σ0.516-0.537=-0.021
min0.281-0.288=-0.007
max1.320-1.365=-0.045
policies=20
mean1785.487-1785.487=-0.000
σ0.342-0.350=-0.008
min1785.254-1785.256=-0.001
max1785.995-1786.008=-0.013
mean760.000
σ0.000
min760.000
max760.000
mean2666.000-2653.000=13.000
σ0.000
min2666.000-2653.000=13.000
max2666.000-2653.000=13.000
mean2.792-2.784=0.007
σ0.023-0.018=0.004
min2.764-2.757=0.006
max2.818-2.798=0.021
policies=200
mean17861.486-17861.413=0.072
σ0.373-0.580=-0.206
min17861.259-17861.039=0.220
max17862.043-17862.276=-0.233
mean7600.000
σ0.000
min7600.000
max7600.000
mean2666.000-2653.000=13.000
σ0.000
min2666.000-2653.000=13.000
max2666.000-2653.000=13.000
mean28.173-28.186=-0.013
σ0.145-0.119=0.027
min28.000-28.077=-0.077
max28.308-28.332=-0.024