Compare commits

Home / Compare ee216bb7 .. ef3825b7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.799=-0.000
σ0.106-0.108=-0.002
min35.753-35.751=0.002
max36.099-36.104=-0.005
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.074-0.075=-0.001
σ0.005-0.004=0.001
min0.068-0.070=-0.002
max0.083-0.082=0.000
cache=y
dps=1
iters=10
policies=100
mean26.065-26.065=0.000
σ0.003-0.004=-0.001
min26.058-26.059=-0.001
max26.069-26.070=-0.001
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.061-0.061=-0.000
σ0.003-0.003=-0.000
min0.059-0.059=0.000
max0.069-0.070=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.923-1755.921=0.002
σ0.364-0.367=-0.003
min1755.350-1755.352=-0.002
max1756.514-1756.516=-0.002
mean1666.500-1665.450=1.050
σ627.505-625.181=2.324
min672.000-674.000=-2.000
max2653.000-2602.000=51.000
mean2.770-2.775=-0.005
σ0.170-0.162=0.007
min2.351-2.285=0.066
max3.056-2.980=0.077

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.195-277.193=0.001
σ0.007-0.008=-0.000
min277.183-277.183=-0.000
max277.202-277.201=0.000
mean2653.000-2602.000=51.000
σ0.000
min2653.000-2602.000=51.000
max2653.000-2602.000=51.000
mean0.401-0.395=0.006
σ0.002-0.009=-0.008
min0.398-0.390=0.008
max0.402-0.412=-0.010
iters=5
new-facts=1
prior-facts=6402
mean2174.439-2174.443=-0.004
σ0.016-0.028=-0.012
min2174.427-2174.415=0.012
max2174.464-2174.476=-0.012
mean2653.000-2602.000=51.000
σ0.000
min2653.000-2602.000=51.000
max2653.000-2602.000=51.000
mean2.993-3.002=-0.009
σ0.193-0.140=0.054
min2.673-2.772=-0.099
max3.197-3.102=0.095
iters=5
new-facts=6402
prior-facts=1
mean5052.365-5052.478=-0.113
σ1.247-1.048=0.199
min5050.921-5051.854=-0.933
max5054.363-5054.342=0.021
mean2653.000-2602.000=51.000
σ0.000
min2653.000-2602.000=51.000
max2653.000-2602.000=51.000
mean9.218-8.810=0.408
σ0.288-0.574=-0.286
min8.918-8.132=0.786
max9.654-9.427=0.226
iters=5
new-facts=6402
prior-facts=6402
mean5188.427-5188.358=0.069
σ0.090-0.121=-0.031
min5188.357-5188.177=0.180
max5188.530-5188.516=0.014
mean3233.400-3221.600=11.800
σ388.477-381.666=6.811
min2675.000-2685.000=-10.000
max3697.000-3698.000=-1.000
mean8.966-8.964=0.003
σ0.354-0.404=-0.049
min8.723-8.725=-0.002
max9.577-9.679=-0.101

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.245-1.321=-0.077
σ0.341-0.301=0.040
min0.950-1.073=-0.123
max1.808-1.800=0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.860-464.851=0.008
σ572.660-572.660=0.001
min178.522-178.518=0.004
max1323.850-1323.841=0.009
mean79.500
σ7.000
min76.000
max90.000
mean2653.000-2602.000=51.000
σ0.000
min2653.000-2602.000=51.000
max2653.000-2602.000=51.000
mean0.566-0.558=0.008
σ0.566-0.537=0.029
min0.281-0.282=-0.001
max1.415-1.364=0.051
policies=20
mean1785.481-1785.470=0.011
σ0.335-0.346=-0.011
min1785.255-1785.238=0.017
max1785.978-1785.983=-0.005
mean760.000
σ0.000
min760.000
max760.000
mean2653.000-2602.000=51.000
σ0.000
min2653.000-2602.000=51.000
max2653.000-2602.000=51.000
mean2.784-2.797=-0.013
σ0.009-0.018=-0.009
min2.771-2.775=-0.004
max2.791-2.818=-0.027
policies=200
mean17861.530-17861.417=0.113
σ0.506-0.452=0.054
min17861.227-17861.070=0.158
max17862.286-17862.080=0.205
mean7600.000
σ0.000
min7600.000
max7600.000
mean2653.000-2602.000=51.000
σ0.000
min2653.000-2602.000=51.000
max2653.000-2602.000=51.000
mean28.112-28.177=-0.065
σ0.185-0.150=0.035
min27.911-27.986=-0.075
max28.279-28.313=-0.034