Compare commits

Home / Compare 758a7a59 .. 15032ec1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.562=0.001
σ0.047-0.048=-0.001
min70.536-70.539=-0.004
max70.696-70.696=-0.000
mean415.600-415.000=0.600
σ0.516-0.000=0.516
min415.000
max416.000-415.000=1.000
mean0.156-0.155=0.001
σ0.007-0.005=0.002
min0.149-0.150=-0.001
max0.169-0.163=0.005
cache=y
dps=1
iters=10
policies=100
mean21.289-21.289=-0.000
σ0.003-0.002=0.000
min21.284-21.286=-0.001
max21.292-21.292=-0.000
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.066-0.064=0.002
σ0.003-0.003=0.000
min0.063-0.061=0.003
max0.072-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.569-1753.569=0.000
σ0.359-0.362=-0.003
min1753.003-1753.001=0.001
max1754.151-1754.149=0.002
mean1649.750-1655.250=-5.500
σ639.415-637.120=2.295
min630.000-631.000=-1.000
max2876.000-2847.000=29.000
mean2.809-2.809=0.000
σ0.116-0.182=-0.066
min2.548-2.359=0.189
max2.962-3.060=-0.098

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.015-272.016=-0.001
σ0.007-0.005=0.002
min272.008-272.010=-0.002
max272.026-272.023=0.003
mean2876.000-2847.000=29.000
σ0.000
min2876.000-2847.000=29.000
max2876.000-2847.000=29.000
mean0.392-0.388=0.004
σ0.011-0.011=-0.000
min0.380-0.377=0.003
max0.404-0.404=0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.433-1792.204=140.229
σ0.009-313.584=-313.575
min1932.422-1231.247=701.175
max1932.447-1932.476=-0.029
mean2876.000-2847.000=29.000
σ0.000
min2876.000-2847.000=29.000
max2876.000-2847.000=29.000
mean3.036-2.714=0.322
σ0.048-0.585=-0.536
min2.963-1.705=1.258
max3.088-3.125=-0.038
iters=5
new-facts=6402
prior-facts=1
mean4752.773-4752.919=-0.146
σ0.771-0.361=0.410
min4752.261-4752.644=-0.383
max4754.095-4753.541=0.554
mean2876.000-2847.000=29.000
σ0.000
min2876.000-2847.000=29.000
max2876.000-2847.000=29.000
mean8.048-8.670=-0.622
σ0.443-0.362=0.081
min7.543-8.240=-0.697
max8.531-9.154=-0.622
iters=5
new-facts=6402
prior-facts=6402
mean4943.614-4943.559=0.055
σ0.020-0.172=-0.152
min4943.591-4943.254=0.337
max4943.633-4943.660=-0.027
mean3090.000-2975.400=114.600
σ295.875-168.643=127.232
min2876.000-2847.000=29.000
max3554.000-3259.000=295.000
mean8.480-8.558=-0.078
σ0.110-0.135=-0.025
min8.383-8.393=-0.010
max8.659-8.695=-0.036

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.053-1.025=0.027
σ0.130-0.137=-0.007
min0.936-0.934=0.001
max1.254-1.248=0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.082-473.083=-0.001
σ575.913-575.915=-0.002
min185.121-185.119=0.002
max1336.952-1336.956=-0.003
mean88.250
σ8.500
min84.000
max101.000
mean2876.000-2847.000=29.000
σ0.000
min2876.000-2847.000=29.000
max2876.000-2847.000=29.000
mean0.452-0.495=-0.043
σ0.306-0.386=-0.080
min0.294-0.299=-0.005
max0.911-1.074=-0.164
policies=20
mean1851.478-1851.466=0.013
σ0.382-0.376=0.006
min1851.187-1851.181=0.006
max1852.031-1852.012=0.020
mean840.000
σ0.000
min840.000
max840.000
mean2876.000-2847.000=29.000
σ0.000
min2876.000-2847.000=29.000
max2876.000-2847.000=29.000
mean2.970-2.944=0.026
σ0.009-0.009=-0.001
min2.964-2.934=0.030
max2.983-2.953=0.030
policies=200
mean18521.191-18521.154=0.037
σ0.462-0.338=0.124
min18520.899-18520.917=-0.018
max18521.876-18521.651=0.224
mean8400.000
σ0.000
min8400.000
max8400.000
mean2876.000-2847.000=29.000
σ0.000
min2876.000-2847.000=29.000
max2876.000-2847.000=29.000
mean29.395-29.266=0.130
σ0.473-0.425=0.048
min28.963-28.915=0.048
max30.048-29.800=0.248