Compare commits

Home / Compare ceb6009f .. 23af6e26

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.727-36.727=0.001
σ1.031-0.858=0.174
min35.933-35.921=0.013
max38.450-38.473=-0.023
mean3890.000-3949.000=-59.000
σ0.000
min3890.000-3949.000=-59.000
max3890.000-3949.000=-59.000
mean0.076-0.076=0.000
σ0.002-0.001=0.001
min0.074-0.074=-0.001
max0.079-0.076=0.003
cache=y
dps=1
iters=10
policies=100
mean26.711-26.711=0.000
σ0.648-0.649=-0.000
min26.205-26.204=0.001
max27.469-27.470=-0.001
mean3890.000-3949.000=-59.000
σ0.000
min3890.000-3949.000=-59.000
max3890.000-3949.000=-59.000
mean0.060-0.059=0.001
σ0.001-0.001=-0.000
min0.059-0.057=0.002
max0.061-0.061=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.356-1756.358=-0.002
σ0.372-0.375=-0.003
min1755.786-1755.788=-0.002
max1756.959-1756.961=-0.002
mean1669.350-1656.400=12.950
σ646.204-627.525=18.678
min632.000-682.000=-50.000
max2858.000-2606.000=252.000
mean2.259-2.283=-0.024
σ0.134-0.144=-0.010
min2.110-2.161=-0.051
max2.742-2.771=-0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.674-278.670=0.003
σ0.009-0.014=-0.005
min278.664-278.656=0.008
max278.688-278.695=-0.007
mean2858.000-2606.000=252.000
σ0.000
min2858.000-2606.000=252.000
max2858.000-2606.000=252.000
mean0.436-0.417=0.020
σ0.010-0.001=0.009
min0.419-0.415=0.003
max0.442-0.418=0.024
iters=5
new-facts=1
prior-facts=6402
mean2268.842-2268.842=0.000
σ0.013-0.007=0.007
min2268.820-2268.836=-0.016
max2268.854-2268.854=0.000
mean2858.000-2606.000=252.000
σ0.000
min2858.000-2606.000=252.000
max2858.000-2606.000=252.000
mean3.125-2.955=0.170
σ0.197-0.085=0.112
min2.915-2.901=0.014
max3.334-3.105=0.229
iters=5
new-facts=6402
prior-facts=1
mean4952.364-4952.303=0.061
σ0.767-0.831=-0.064
min4951.971-4951.890=0.081
max4953.733-4953.787=-0.054
mean2858.000-2606.000=252.000
σ0.000
min2858.000-2606.000=252.000
max2858.000-2606.000=252.000
mean7.777-8.063=-0.286
σ0.133-0.179=-0.046
min7.631-7.797=-0.166
max7.931-8.301=-0.369
iters=5
new-facts=6402
prior-facts=6402
mean5167.058-5167.052=0.006
σ0.014-0.014=0.001
min5167.043-5167.041=0.002
max5167.075-5167.073=0.002
mean3342.800-3401.400=-58.600
σ396.707-448.358=-51.651
min2858.000-2771.000=87.000
max3890.000-3949.000=-59.000
mean9.452-9.507=-0.055
σ0.426-0.311=0.115
min9.009-9.142=-0.133
max10.151-9.843=0.309

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.098-1.062=0.036
σ0.246-0.238=0.008
min0.917-0.919=-0.002
max1.465-1.472=-0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.257-460.253=0.004
σ572.607-572.606=0.001
min173.952-173.949=0.003
max1319.167-1319.163=0.005
mean79.500
σ7.000
min76.000
max90.000
mean437.000
σ0.000
min437.000
max437.000
mean0.563-0.548=0.014
σ0.584-0.550=0.035
min0.267-0.267=0.000
max1.440-1.373=0.066
policies=20
mean1740.016-1739.993=0.024
σ0.333-0.339=-0.005
min1739.773-1739.754=0.019
max1740.505-1740.490=0.015
mean760.000
σ0.000
min760.000
max760.000
mean448.500-447.250=1.250
σ10.116-10.178=-0.062
min437.000
max457.000-456.000=1.000
mean2.667-2.663=0.003
σ0.016-0.016=0.000
min2.652-2.647=0.005
max2.687-2.685=0.002
policies=200
mean17409.462-17409.214=0.248
σ0.060-0.062=-0.003
min17409.387-17409.127=0.260
max17409.517-17409.274=0.243
mean7600.000
σ0.000
min7600.000
max7600.000
mean493.250-491.500=1.750
σ2.986-2.517=0.469
min490.000-489.000=1.000
max497.000-495.000=2.000
mean26.789-26.787=0.002
σ0.095-0.161=-0.067
min26.675-26.569=0.106
max26.904-26.959=-0.055