Compare commits

Home / Compare 5f903fd5 .. 64e80145

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.727-36.723=0.004
σ0.620-0.547=0.073
min35.920-35.955=-0.035
max37.219-37.212=0.007
mean3965.000-3813.000=152.000
σ0.000
min3965.000-3813.000=152.000
max3965.000-3813.000=152.000
mean0.075-0.076=-0.001
σ0.001-0.002=-0.001
min0.074-0.074=-0.000
max0.078-0.081=-0.003
cache=y
dps=1
iters=10
policies=100
mean26.710-26.711=-0.001
σ0.648-0.645=0.003
min26.203-26.207=-0.003
max27.470-27.464=0.006
mean3965.000-3813.000=152.000
σ0.000
min3965.000-3813.000=152.000
max3965.000-3813.000=152.000
mean0.057-0.058=-0.001
σ0.000-0.002=-0.002
min0.056-0.056=0.000
max0.057-0.064=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.368-1756.357=0.011
σ0.372-0.373=-0.002
min1755.796-1755.784=0.012
max1756.961-1756.959=0.002
mean1656.350-1665.350=-9.000
σ636.112-640.463=-4.352
min634.000-631.000=3.000
max2870.000-2824.000=46.000
mean2.283-2.265=0.018
σ0.166-0.112=0.054
min2.152-2.162=-0.010
max2.909-2.603=0.306

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.696-278.675=0.020
σ0.012-0.008=0.003
min278.685-278.666=0.019
max278.714-278.684=0.030
mean2870.000-2824.000=46.000
σ0.000
min2870.000-2824.000=46.000
max2870.000-2824.000=46.000
mean0.420-0.420=0.000
σ0.004-0.001=0.003
min0.418-0.419=-0.001
max0.427-0.420=0.007
iters=5
new-facts=1
prior-facts=6402
mean2268.873-2268.833=0.039
σ0.006-0.017=-0.011
min2268.866-2268.813=0.053
max2268.879-2268.847=0.032
mean2870.000-2824.000=46.000
σ0.000
min2870.000-2824.000=46.000
max2870.000-2824.000=46.000
mean2.967-3.101=-0.135
σ0.074-0.104=-0.030
min2.903-2.922=-0.019
max3.074-3.183=-0.109
iters=5
new-facts=6402
prior-facts=1
mean4952.249-4952.361=-0.112
σ0.891-0.766=0.125
min4951.323-4951.993=-0.670
max4953.736-4953.730=0.006
mean2870.000-2824.000=46.000
σ0.000
min2870.000-2824.000=46.000
max2870.000-2824.000=46.000
mean7.806-7.784=0.023
σ0.256-0.107=0.148
min7.628-7.682=-0.054
max8.215-7.921=0.294
iters=5
new-facts=6402
prior-facts=6402
mean5167.004-5167.047=-0.043
σ0.156-0.003=0.154
min5166.724-5167.044=-0.320
max5167.087-5167.050=0.037
mean3416.600-3361.200=55.400
σ417.220-444.342=-27.123
min2870.000-2925.000=-55.000
max3965.000-3813.000=152.000
mean9.305-9.396=-0.091
σ0.213-0.203=0.009
min9.050-9.138=-0.088
max9.549-9.660=-0.112

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.020-1.558=-0.538
σ0.140-0.332=-0.191
min0.928-1.150=-0.222
max1.249-1.846=-0.597

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.258-460.252=0.006
σ572.608-572.608=-0.000
min173.953-173.944=0.009
max1319.169-1319.163=0.006
mean79.500
σ7.000
min76.000
max90.000
mean435.000-437.000=-2.000
σ0.000
min435.000-437.000=-2.000
max435.000-437.000=-2.000
mean0.545-0.564=-0.019
σ0.537-0.578=-0.041
min0.273-0.269=0.004
max1.350-1.431=-0.081
policies=20
mean1740.043-1739.959=0.084
σ0.352-0.318=0.033
min1739.794-1739.724=0.069
max1740.561-1740.426=0.136
mean760.000
σ0.000
min760.000
max760.000
mean445.500-447.250=-1.750
σ9.950-10.178=-0.228
min435.000-437.000=-2.000
max454.000-456.000=-2.000
mean2.696-2.651=0.045
σ0.058-0.004=0.055
min2.657-2.646=0.012
max2.784-2.654=0.130
policies=200
mean17409.497-17409.168=0.329
σ0.112-0.052=0.060
min17409.385-17409.095=0.290
max17409.645-17409.213=0.432
mean7600.000
σ0.000
min7600.000
max7600.000
mean493.500
σ4.435-3.416=1.019
min489.000
max499.000-497.000=2.000
mean26.981-26.900=0.081
σ0.066-0.089=-0.023
min26.907-26.792=0.115
max27.057-27.005=0.053