Compare commits

Home / Compare 3d4b142b .. 62c82c86

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.968-35.967=0.001
σ0.107-0.107=-0.001
min35.921-35.920=0.000
max36.270-36.271=-0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.077-0.077=0.000
σ0.003-0.005=-0.001
min0.074-0.072=0.002
max0.085-0.086=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.208-26.208=-0.000
σ0.004-0.005=-0.000
min26.202-26.201=0.001
max26.215-26.217=-0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.062-0.062=-0.000
σ0.002-0.003=-0.001
min0.060-0.060=-0.000
max0.069-0.071=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.330-1755.327=0.003
σ0.369-0.368=0.001
min1754.757-1754.755=0.002
max1755.922-1755.921=0.001
mean1651.700-1649.850=1.850
σ618.100-631.796=-13.697
min673.000-669.000=4.000
max2685.000-2749.000=-64.000
mean2.361-2.409=-0.048
σ0.103-0.172=-0.069
min2.235-2.269=-0.034
max2.651-2.908=-0.257

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.508-279.510=-0.002
σ0.007-0.007=-0.000
min279.500-279.502=-0.002
max279.518-279.516=0.002
mean2685.000-2749.000=-64.000
σ0.000
min2685.000-2749.000=-64.000
max2685.000-2749.000=-64.000
mean0.415-0.409=0.006
σ0.010-0.008=0.002
min0.406-0.403=0.004
max0.431-0.423=0.008
iters=5
new-facts=1
prior-facts=6402
mean2173.700-2173.703=-0.003
σ0.015-0.025=-0.010
min2173.685-2173.663=0.022
max2173.720-2173.729=-0.010
mean2685.000-2749.000=-64.000
σ0.000
min2685.000-2749.000=-64.000
max2685.000-2749.000=-64.000
mean2.979-2.943=0.036
σ0.151-0.299=-0.148
min2.758-2.662=0.096
max3.106-3.390=-0.284
iters=5
new-facts=6402
prior-facts=1
mean5053.105-5053.219=-0.114
σ0.444-1.108=-0.664
min5052.809-5052.138=0.671
max5053.889-5055.089=-1.200
mean2685.000-2749.000=-64.000
σ0.000
min2685.000-2749.000=-64.000
max2685.000-2749.000=-64.000
mean9.199-9.128=0.071
σ0.200-0.607=-0.407
min8.868-8.101=0.767
max9.388-9.628=-0.240
iters=5
new-facts=6402
prior-facts=6402
mean5185.991-5185.968=0.023
σ0.088-0.113=-0.026
min5185.922-5185.835=0.087
max5186.089-5186.088=0.001
mean3279.200-3212.800=66.400
σ419.380-354.307=65.073
min2685.000-2840.000=-155.000
max3664.000-3754.000=-90.000
mean9.042-8.825=0.217
σ0.453-0.159=0.294
min8.681-8.601=0.080
max9.823-8.984=0.838

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.109-0.972=0.137
σ0.226-0.054=0.171
min0.936-0.933=0.003
max1.498-1.066=0.432

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.475-465.494=-0.020
σ572.656-572.654=0.002
min179.145-179.164=-0.018
max1324.459-1324.476=-0.017
mean79.500
σ7.000
min76.000
max90.000
mean2685.000-2749.000=-64.000
σ0.000
min2685.000-2749.000=-64.000
max2685.000-2749.000=-64.000
mean0.546-0.439=0.107
σ0.532-0.301=0.230
min0.279-0.285=-0.006
max1.343-0.891=0.452
policies=20
mean1791.681-1791.712=-0.031
σ0.337-0.308=0.029
min1791.466-1791.488=-0.022
max1792.181-1792.165=0.016
mean760.000
σ0.000
min760.000
max760.000
mean2685.000-2749.000=-64.000
σ0.000
min2685.000-2749.000=-64.000
max2685.000-2749.000=-64.000
mean2.806-2.855=-0.050
σ0.015-0.098=-0.083
min2.784-2.796=-0.012
max2.817-3.000=-0.183
policies=200
mean17923.492-17923.462=0.030
σ0.514-0.482=0.032
min17923.191-17923.208=-0.017
max17924.260-17924.184=0.076
mean7600.000
σ0.000
min7600.000
max7600.000
mean2685.000-2749.000=-64.000
σ0.000
min2685.000-2749.000=-64.000
max2685.000-2749.000=-64.000
mean28.282-28.229=0.053
σ0.122-0.115=0.008
min28.167-28.132=0.035
max28.429-28.365=0.064