Compare commits

Home / Compare 685b9309 .. 3b21487e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.706-36.718=-0.012
σ0.575-0.654=-0.080
min35.923-35.926=-0.004
max37.221-37.532=-0.311
mean3996.000-3983.000=13.000
σ0.000
min3996.000-3983.000=13.000
max3996.000-3983.000=13.000
mean0.075-0.075=0.000
σ0.001-0.001=0.000
min0.075-0.074=0.000
max0.077-0.076=0.001
cache=y
dps=1
iters=10
policies=100
mean26.585-26.587=-0.001
σ0.604-0.603=0.001
min26.204-26.209=-0.005
max27.466-27.463=0.002
mean3996.000-3983.000=13.000
σ0.000
min3996.000-3983.000=13.000
max3996.000-3983.000=13.000
mean0.058-0.060=-0.002
σ0.001-0.001=0.001
min0.057-0.059=-0.003
max0.060-0.061=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.366-1756.368=-0.002
σ0.372-0.375=-0.002
min1755.793-1755.786=0.007
max1756.965-1756.969=-0.004
mean1660.150-1653.450=6.700
σ626.743-624.896=1.847
min613.000-685.000=-72.000
max2643.000-2588.000=55.000
mean2.303-2.273=0.029
σ0.179-0.147=0.033
min2.164-2.086=0.079
max2.791-2.660=0.131

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.695-278.692=0.003
σ0.011-0.014=-0.004
min278.685-278.678=0.007
max278.712-278.715=-0.003
mean2643.000-2588.000=55.000
σ0.000
min2643.000-2588.000=55.000
max2643.000-2588.000=55.000
mean0.420-0.427=-0.007
σ0.001-0.012=-0.011
min0.418-0.417=0.001
max0.421-0.441=-0.020
iters=5
new-facts=1
prior-facts=6402
mean2268.861-2268.867=-0.006
σ0.006-0.002=0.003
min2268.852-2268.864=-0.012
max2268.866-2268.870=-0.004
mean2643.000-2588.000=55.000
σ0.000
min2643.000-2588.000=55.000
max2643.000-2588.000=55.000
mean2.965-2.950=0.015
σ0.127-0.080=0.047
min2.877-2.885=-0.008
max3.187-3.089=0.097
iters=5
new-facts=6402
prior-facts=1
mean4952.355-4952.343=0.013
σ0.780-0.884=-0.104
min4951.967-4951.850=0.118
max4953.749-4953.920=-0.171
mean2643.000-2588.000=55.000
σ0.000
min2643.000-2588.000=55.000
max2643.000-2588.000=55.000
mean7.881-8.049=-0.168
σ0.153-0.327=-0.174
min7.714-7.719=-0.005
max8.113-8.542=-0.429
iters=5
new-facts=6402
prior-facts=6402
mean5167.067-5167.071=-0.005
σ0.011-0.014=-0.003
min5167.051-5167.060=-0.009
max5167.082-5167.094=-0.013
mean3417.400-3412.200=5.200
σ472.476-466.687=5.789
min2755.000-2757.000=-2.000
max3996.000-3983.000=13.000
mean9.287-9.480=-0.194
σ0.350-0.266=0.084
min8.866-9.038=-0.172
max9.589-9.740=-0.151

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.078-1.125=-0.047
σ0.107-0.167=-0.061
min0.939-0.940=-0.001
max1.239-1.348=-0.108

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.258-460.256=0.002
σ572.605-572.607=-0.002
min173.954-173.951=0.003
max1319.167-1319.167=-0.001
mean79.500
σ7.000
min76.000
max90.000
mean439.000-438.000=1.000
σ0.000
min439.000-438.000=1.000
max439.000-438.000=1.000
mean0.538-0.537=0.001
σ0.531-0.531=0.001
min0.271-0.267=0.004
max1.335-1.333=0.003
policies=20
mean1740.049-1740.055=-0.007
σ0.334-0.332=0.002
min1739.804-1739.814=-0.010
max1740.538-1740.543=-0.005
mean760.000
σ0.000
min760.000
max760.000
mean447.750
σ9.535-9.605=-0.070
min439.000-438.000=1.000
max456.000
mean2.674-2.663=0.011
σ0.017-0.014=0.003
min2.652-2.642=0.010
max2.689-2.672=0.016
policies=200
mean17409.774-17409.452=0.322
σ0.066-0.439=-0.373
min17409.690-17408.801=0.889
max17409.849-17409.719=0.130
mean7600.000
σ0.000
min7600.000
max7600.000
mean493.250-490.250=3.000
σ2.630
min491.000-488.000=3.000
max496.000-494.000=2.000
mean26.899-26.959=-0.059
σ0.100-0.160=-0.060
min26.772-26.819=-0.047
max26.998-27.186=-0.188