Compare commits

Home / Compare 38ae59aa .. 85e0cbe8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.978=-0.000
σ0.048-0.048=0.001
min33.953-33.954=-0.001
max34.112-34.110=0.002
mean416.300-416.000=0.300
σ0.483-0.000=0.483
min416.000
max417.000-416.000=1.000
mean0.083-0.081=0.002
σ0.004-0.005=-0.001
min0.077-0.076=0.001
max0.090-0.089=0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.316=0.001
σ0.002-0.003=-0.001
min23.314-23.311=0.003
max23.320-23.320=-0.000
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.066-0.064=0.002
σ0.002-0.003=-0.001
min0.064-0.060=0.004
max0.072-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.302-1757.303=-0.001
σ0.365-0.365=0.001
min1756.728-1756.730=-0.002
max1757.896-1757.891=0.004
mean1648.350-1641.500=6.850
σ623.893-622.036=1.857
min638.000-623.000=15.000
max2827.000-2695.000=132.000
mean2.364-2.378=-0.014
σ0.106-0.106=-0.000
min2.175-2.259=-0.084
max2.660-2.647=0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.444-326.439=0.005
σ0.055-0.060=-0.005
min326.348-326.334=0.014
max326.481-326.480=0.001
mean2827.000-2695.000=132.000
σ0.000
min2827.000-2695.000=132.000
max2827.000-2695.000=132.000
mean0.424-0.427=-0.003
σ0.004-0.006=-0.002
min0.422-0.421=0.000
max0.431-0.434=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1988.613-1988.591=0.022
σ0.009-0.050=-0.041
min1988.601-1988.504=0.097
max1988.623-1988.621=0.002
mean2827.000-2695.000=132.000
σ0.000
min2827.000-2695.000=132.000
max2827.000-2695.000=132.000
mean2.815-2.674=0.141
σ0.187-0.064=0.123
min2.644-2.620=0.024
max3.039-2.785=0.255
iters=5
new-facts=6402
prior-facts=1
mean4813.503-4813.336=0.166
σ7.722-7.784=-0.062
min4809.917-4809.491=0.426
max4827.315-4827.256=0.059
mean2827.000-2695.000=132.000
σ0.000
min2827.000-2695.000=132.000
max2827.000-2695.000=132.000
mean8.406-8.813=-0.407
σ0.702-0.273=0.429
min7.629-8.486=-0.856
max9.317-9.101=0.215
iters=5
new-facts=6402
prior-facts=6402
mean5001.011-5001.018=-0.007
σ0.021-0.031=-0.010
min5000.989-5000.987=0.002
max5001.036-5001.059=-0.022
mean3067.000-2991.600=75.400
σ319.353-251.665=67.688
min2827.000-2695.000=132.000
max3560.000-3314.000=246.000
mean9.840-9.912=-0.073
σ0.097-0.206=-0.109
min9.727-9.732=-0.006
max9.961-10.234=-0.273

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.949-1.015=-0.065
σ0.058-0.146=-0.088
min0.916-0.913=0.003
max1.051-1.236=-0.185

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.444-464.442=0.001
σ574.773-574.786=-0.014
min177.045-177.042=0.003
max1326.603-1326.622=-0.019
mean88.250
σ8.500
min84.000
max101.000
mean2827.000-2695.000=132.000
σ0.000
min2827.000-2695.000=132.000
max2827.000-2695.000=132.000
mean0.436-0.553=-0.117
σ0.308-0.557=-0.249
min0.279-0.273=0.007
max0.898-1.389=-0.491
policies=20
mean1770.802-1770.754=0.048
σ0.366-0.355=0.011
min1770.548-1770.522=0.025
max1771.342-1771.283=0.059
mean840.000
σ0.000
min840.000
max840.000
mean2827.000-2695.000=132.000
σ0.000
min2827.000-2695.000=132.000
max2827.000-2695.000=132.000
mean2.803-2.722=0.081
σ0.016-0.013=0.003
min2.787-2.707=0.080
max2.826-2.737=0.089
policies=200
mean17714.774-17714.797=-0.023
σ0.372-0.458=-0.085
min17714.491-17714.385=0.105
max17715.307-17715.450=-0.143
mean8400.000
σ0.000
min8400.000
max8400.000
mean2827.000-2695.000=132.000
σ0.000
min2827.000-2695.000=132.000
max2827.000-2695.000=132.000
mean28.062-27.536=0.526
σ0.396-0.230=0.167
min27.539-27.304=0.235
max28.447-27.831=0.616