Compare commits

Home / Compare 9ece0e87 .. 3d2bcef1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.978=0.001
σ0.049-0.053=-0.005
min33.952-33.940=0.012
max34.113-34.126=-0.014
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.085-0.080=0.005
σ0.004-0.005=-0.001
min0.082-0.076=0.006
max0.092-0.089=0.003
cache=y
dps=1
iters=10
policies=100
mean23.317-23.319=-0.002
σ0.003-0.003=-0.000
min23.312-23.316=-0.003
max23.321-23.325=-0.004
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.066-0.066=-0.000
σ0.003-0.002=0.001
min0.063-0.063=-0.000
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.364-1757.363=0.001
σ0.364-0.365=-0.001
min1756.788-1756.786=0.002
max1757.944-1757.950=-0.005
mean1648.100-1664.450=-16.350
σ640.917-628.112=12.806
min656.000-669.000=-13.000
max2872.000-2613.000=259.000
mean2.326-2.356=-0.030
σ0.062-0.109=-0.047
min2.243-2.245=-0.003
max2.480-2.726=-0.245

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.505-326.503=0.002
σ0.048-0.050=-0.002
min326.419-326.414=0.005
max326.529-326.530=-0.001
mean2872.000-2613.000=259.000
σ0.000
min2872.000-2613.000=259.000
max2872.000-2613.000=259.000
mean0.427-0.424=0.003
σ0.006-0.002=0.004
min0.421-0.422=-0.001
max0.434-0.426=0.008
iters=5
new-facts=1
prior-facts=6402
mean1988.679-1988.670=0.009
σ0.005-0.015=-0.009
min1988.675-1988.651=0.024
max1988.686-1988.688=-0.002
mean2872.000-2613.000=259.000
σ0.000
min2872.000-2613.000=259.000
max2872.000-2613.000=259.000
mean2.732-2.715=0.017
σ0.122-0.153=-0.031
min2.647-2.522=0.125
max2.943-2.947=-0.004
iters=5
new-facts=6402
prior-facts=1
mean4813.529-4813.325=0.204
σ7.750-7.860=-0.110
min4810.007-4809.409=0.599
max4827.393-4827.374=0.019
mean2872.000-2613.000=259.000
σ0.000
min2872.000-2613.000=259.000
max2872.000-2613.000=259.000
mean8.744-8.414=0.330
σ0.498-0.565=-0.067
min8.131-7.811=0.320
max9.347-9.293=0.054
iters=5
new-facts=6402
prior-facts=6402
mean5000.999-5000.933=0.066
σ0.145-0.305=-0.159
min5000.740-5000.389=0.352
max5001.086-5001.098=-0.012
mean3085.600-2944.600=141.000
σ296.052-347.052=-51.000
min2872.000-2613.000=259.000
max3546.000-3413.000=133.000
mean9.692-9.650=0.042
σ0.218-0.274=-0.056
min9.354-9.330=0.024
max9.930-9.968=-0.038

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.034-1.207=-0.173
σ0.124-0.347=-0.223
min0.911-0.929=-0.019
max1.216-1.751=-0.535

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.498-464.500=-0.002
σ574.773-574.781=-0.007
min177.109-177.104=0.005
max1326.659-1326.672=-0.013
mean88.250
σ8.500
min84.000
max101.000
mean2872.000-2613.000=259.000
σ0.000
min2872.000-2613.000=259.000
max2872.000-2613.000=259.000
mean0.434-0.544=-0.109
σ0.308-0.543=-0.235
min0.279-0.269=0.010
max0.897-1.358=-0.461
policies=20
mean1771.396-1771.355=0.042
σ0.362-0.366=-0.004
min1771.137-1771.114=0.023
max1771.930-1771.898=0.032
mean840.000
σ0.000
min840.000
max840.000
mean2872.000-2613.000=259.000
σ0.000
min2872.000-2613.000=259.000
max2872.000-2613.000=259.000
mean2.798-2.725=0.073
σ0.008-0.022=-0.013
min2.787-2.708=0.079
max2.807-2.755=0.052
policies=200
mean17721.172-17721.004=0.168
σ0.522-0.549=-0.027
min17720.774-17720.640=0.134
max17721.928-17721.818=0.110
mean8400.000
σ0.000
min8400.000
max8400.000
mean2872.000-2613.000=259.000
σ0.000
min2872.000-2613.000=259.000
max2872.000-2613.000=259.000
mean27.964-27.489=0.475
σ0.441-0.114=0.327
min27.415-27.372=0.043
max28.448-27.605=0.844