Compare commits

Home / Compare 7411df6f .. 6b6506fb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.966-35.966=0.000
σ0.103-0.102=0.001
min35.922-35.923=-0.001
max36.259-36.255=0.004
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.077-0.077=0.001
σ0.003-0.003=0.000
min0.074-0.074=-0.001
max0.084-0.082=0.002
cache=y
dps=1
iters=10
policies=100
mean26.208-26.207=0.001
σ0.005-0.004=0.001
min26.201-26.201=0.000
max26.215-26.213=0.002
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.060-0.058=0.002
σ0.003-0.005=-0.003
min0.057-0.047=0.010
max0.067-0.067=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.307-1756.306=0.001
σ0.368-0.369=-0.001
min1755.731-1755.727=0.005
max1756.898-1756.899=-0.001
mean1662.850-1654.550=8.300
σ635.230-631.381=3.849
min614.000-609.000=5.000
max2740.000-2726.000=14.000
mean2.377-2.332=0.046
σ0.147-0.081=0.066
min2.076-2.243=-0.168
max2.820-2.547=0.272

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.820-278.821=-0.001
σ0.008-0.009=-0.001
min278.807-278.808=-0.001
max278.827-278.828=-0.001
mean2740.000-2726.000=14.000
σ0.000
min2740.000-2726.000=14.000
max2740.000-2726.000=14.000
mean0.412-0.407=0.005
σ0.005-0.004=0.001
min0.408-0.405=0.004
max0.421-0.414=0.007
iters=5
new-facts=1
prior-facts=6402
mean2268.877-2268.882=-0.005
σ0.016-0.011=0.006
min2268.848-2268.868=-0.020
max2268.889-2268.892=-0.003
mean2740.000-2726.000=14.000
σ0.000
min2740.000-2726.000=14.000
max2740.000-2726.000=14.000
mean3.012-2.899=0.113
σ0.204-0.123=0.081
min2.904-2.775=0.129
max3.376-3.106=0.270
iters=5
new-facts=6402
prior-facts=1
mean4954.228-4954.230=-0.002
σ0.817-0.796=0.021
min4953.717-4953.730=-0.013
max4955.675-4955.636=0.039
mean2740.000-2726.000=14.000
σ0.000
min2740.000-2726.000=14.000
max2740.000-2726.000=14.000
mean8.038-8.011=0.027
σ0.246-0.233=0.012
min7.752-7.769=-0.016
max8.417-8.285=0.132
iters=5
new-facts=6402
prior-facts=6402
mean5168.731-5168.659=0.072
σ0.204-0.275=-0.071
min5168.387-5168.179=0.208
max5168.887-5168.885=0.003
mean3362.400-3391.000=-28.600
σ464.339-492.335=-27.996
min2743.000-2801.000=-58.000
max3975.000-4067.000=-92.000
mean9.454-9.407=0.048
σ0.488-0.238=0.251
min9.054-9.115=-0.060
max10.131-9.717=0.414

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.028-0.993=0.035
σ0.145-0.072=0.073
min0.936-0.928=0.007
max1.269-1.081=0.189

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.358-460.354=0.004
σ572.652-572.659=-0.007
min174.023-174.019=0.003
max1319.336-1319.342=-0.006
mean79.500
σ7.000
min76.000
max90.000
mean2740.000-2726.000=14.000
σ0.000
min2740.000-2726.000=14.000
max2740.000-2726.000=14.000
mean0.527-0.546=-0.019
σ0.516-0.556=-0.040
min0.264-0.267=-0.003
max1.301-1.380=-0.079
policies=20
mean1740.454-1740.449=0.005
σ0.323-0.312=0.012
min1740.242-1740.244=-0.002
max1740.936-1740.913=0.022
mean760.000
σ0.000
min760.000
max760.000
mean2740.000-2726.000=14.000
σ0.000
min2740.000-2726.000=14.000
max2740.000-2726.000=14.000
mean2.693-2.677=0.016
σ0.007-0.012=-0.005
min2.684-2.665=0.019
max2.700-2.691=0.009
policies=200
mean17411.384-17411.492=-0.108
σ0.584-0.503=0.082
min17411.045-17411.220=-0.175
max17412.258-17412.245=0.013
mean7600.000
σ0.000
min7600.000
max7600.000
mean2740.000-2726.000=14.000
σ0.000
min2740.000-2726.000=14.000
max2740.000-2726.000=14.000
mean27.050-26.884=0.166
σ0.059-0.046=0.013
min26.993-26.815=0.177
max27.111-26.916=0.195