Compare commits

Home / Compare 7ac18e28 .. a620a95d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.916-53.915=0.001
σ0.366-0.366=0.000
min53.782-53.781=0.001
max54.958-54.956=0.002
mean416.800-415.000=1.800
σ0.422-0.000=0.422
min416.000-415.000=1.000
max417.000-415.000=2.000
mean0.140-0.137=0.003
σ0.003-0.006=-0.003
min0.136-0.129=0.007
max0.145-0.148=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.140-43.141=-0.001
σ0.005-0.007=-0.001
min43.135-43.133=0.002
max43.149-43.156=-0.007
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.120-0.122=-0.002
σ0.004-0.007=-0.003
min0.115-0.118=-0.003
max0.128-0.141=-0.013

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.075-992.078=-0.003
σ1.232-1.243=-0.012
min991.511-991.498=0.013
max997.253-997.306=-0.053
mean1069.850-1061.350=8.500
σ313.578-311.910=1.668
min602.000-605.000=-3.000
max1644.000-1598.000=46.000
mean1.531-1.555=-0.024
σ0.102-0.118=-0.016
min1.448-1.470=-0.022
max1.927-1.962=-0.035

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.680-285.675=0.004
σ0.013-0.015=-0.002
min285.659-285.651=0.008
max285.690-285.690=-0.000
mean1644.000-1598.000=46.000
σ0.000
min1644.000-1598.000=46.000
max1644.000-1598.000=46.000
mean0.384-0.375=0.009
σ0.011-0.000=0.010
min0.375-0.375=0.000
max0.396-0.376=0.020
iters=5
new-facts=1
prior-facts=6402
mean1285.645-1285.641=0.004
σ0.137-0.135=0.002
min1285.582-1285.573=0.008
max1285.890-1285.882=0.008
mean1644.000-1598.000=46.000
σ0.000
min1644.000-1598.000=46.000
max1644.000-1598.000=46.000
mean1.943-1.880=0.063
σ0.137-0.019=0.119
min1.830-1.863=-0.033
max2.121-1.909=0.212
iters=5
new-facts=6402
prior-facts=1
mean1807.985-1807.983=0.003
σ7.059-7.016=0.043
min1804.619-1804.616=0.003
max1820.599-1820.517=0.082
mean1644.000-1598.000=46.000
σ0.000
min1644.000-1598.000=46.000
max1644.000-1598.000=46.000
mean4.258-4.218=0.040
σ0.308-0.176=0.132
min3.959-4.000=-0.041
max4.781-4.472=0.309
iters=5
new-facts=6402
prior-facts=6402
mean2070.462-2070.462=-0.001
σ0.004-0.010=-0.006
min2070.457-2070.448=0.008
max2070.466-2070.477=-0.011
mean1860.000-1844.000=16.000
σ195.250-217.430=-22.181
min1644.000-1598.000=46.000
max2095.000-2086.000=9.000
mean4.526-4.453=0.073
σ0.054-0.028=0.025
min4.470-4.412=0.058
max4.599-4.488=0.111

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.162-1.247=-0.085
σ0.232-0.314=-0.082
min0.913-0.903=0.010
max1.474-1.594=-0.120

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.381-437.386=-0.005
σ572.363-572.364=-0.000
min151.195-151.194=0.001
max1295.927-1295.931=-0.005
mean90.250
σ8.500
min86.000
max103.000
mean1644.000-1598.000=46.000
σ0.000
min1644.000-1598.000=46.000
max1644.000-1598.000=46.000
mean0.532-0.561=-0.029
σ0.550-0.612=-0.061
min0.249-0.253=-0.004
max1.357-1.478=-0.121
policies=20
mean1512.196-1512.195=0.001
σ0.242-0.245=-0.003
min1512.039-1512.032=0.007
max1512.557-1512.560=-0.003
mean860.000
σ0.000
min860.000
max860.000
mean1644.000-1598.000=46.000
σ0.000
min1644.000-1598.000=46.000
max1644.000-1598.000=46.000
mean2.530-2.520=0.010
σ0.021-0.014=0.007
min2.507-2.505=0.002
max2.554-2.539=0.015
policies=200
mean15129.671-15129.570=0.101
σ0.132-0.083=0.049
min15129.504-15129.465=0.039
max15129.822-15129.653=0.169
mean8600.000
σ0.000
min8600.000
max8600.000
mean1644.000-1598.000=46.000
σ0.000
min1644.000-1598.000=46.000
max1644.000-1598.000=46.000
mean25.667-25.622=0.046
σ0.182-0.110=0.071
min25.457-25.500=-0.042
max25.891-25.747=0.145