Compare commits

Home / Compare d0bf0469 .. 58c7f4cb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.721-70.568=0.153
σ0.045-0.045=0.001
min70.697-70.543=0.155
max70.848-70.690=0.158
mean410.000-417.000=-7.000
σ0.000
min410.000-417.000=-7.000
max410.000-417.000=-7.000
mean0.159-0.161=-0.001
σ0.003-0.003=0.000
min0.156-0.158=-0.001
max0.165-0.165=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.445-21.288=0.157
σ0.003-0.003=0.000
min21.440-21.282=0.157
max21.449-21.293=0.156
mean410.000-417.000=-7.000
σ0.000
min410.000-417.000=-7.000
max410.000-417.000=-7.000
mean0.065-0.064=0.000
σ0.002-0.002=0.000
min0.063-0.063=0.000
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.528-1753.376=1.153
σ0.360-0.360=-0.000
min1753.965-1752.803=1.162
max1755.104-1753.969=1.135
mean1636.100-1648.250=-12.150
σ629.813-643.449=-13.637
min634.000-619.000=15.000
max2839.000-2718.000=121.000
mean2.791-2.861=-0.070
σ0.215-0.117=0.097
min2.314-2.630=-0.316
max3.230-3.087=0.143

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.609-271.756=1.853
σ0.006-0.005=0.001
min273.599-271.749=1.850
max273.615-271.762=1.854
mean2839.000-2718.000=121.000
σ0.000
min2839.000-2718.000=121.000
max2839.000-2718.000=121.000
mean0.385-0.381=0.005
σ0.009-0.005=0.004
min0.379-0.377=0.002
max0.402-0.389=0.013
iters=5
new-facts=1
prior-facts=6402
mean1934.007-1932.179=1.828
σ0.013-0.006=0.008
min1933.989-1932.171=1.818
max1934.021-1932.186=1.835
mean2839.000-2718.000=121.000
σ0.000
min2839.000-2718.000=121.000
max2839.000-2718.000=121.000
mean2.994-3.059=-0.066
σ0.343-0.046=0.297
min2.632-2.997=-0.365
max3.446-3.100=0.347
iters=5
new-facts=6402
prior-facts=1
mean4754.664-4752.950=1.714
σ0.907-0.888=0.019
min4753.950-4752.407=1.543
max4756.249-4754.529=1.720
mean2839.000-2718.000=121.000
σ0.000
min2839.000-2718.000=121.000
max2839.000-2718.000=121.000
mean8.509-8.288=0.221
σ0.541-0.492=0.049
min7.617-7.685=-0.068
max8.960-8.975=-0.015
iters=5
new-facts=6402
prior-facts=6402
mean4945.224-4943.379=1.845
σ0.017-0.017=0.000
min4945.208-4943.358=1.850
max4945.244-4943.400=1.844
mean3059.600-2998.600=61.000
σ189.629-327.901=-138.271
min2839.000-2718.000=121.000
max3325.000-3475.000=-150.000
mean8.605-8.576=0.029
σ0.209-0.188=0.021
min8.430-8.340=0.090
max8.923-8.746=0.177

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.101-1.060=0.041
σ0.163-0.209=-0.046
min0.935-0.933=0.002
max1.375-1.422=-0.047

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.845-467.863=4.982
σ574.937-575.935=-0.998
min185.365-179.885=5.480
max1335.250-1331.766=3.484
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2839.000-2718.000=121.000
σ0.000
min2839.000-2718.000=121.000
max2839.000-2718.000=121.000
mean0.486-0.571=-0.085
σ0.378-0.559=-0.181
min0.295-0.284=0.011
max1.052-1.409=-0.357
policies=20
mean1854.024-1799.158=54.866
σ0.373-0.371=0.002
min1853.747-1798.917=54.831
max1854.566-1799.711=54.855
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2839.000-2718.000=121.000
σ0.000
min2839.000-2718.000=121.000
max2839.000-2718.000=121.000
mean2.957-2.782=0.175
σ0.016-0.014=0.002
min2.939-2.765=0.173
max2.977-2.801=0.176
policies=200
mean18546.613-17998.380=548.233
σ0.542-0.591=-0.049
min18546.129-17998.007=548.122
max18547.345-17999.259=548.086
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2839.000-2718.000=121.000
σ0.000
min2839.000-2718.000=121.000
max2839.000-2718.000=121.000
mean29.114-28.100=1.015
σ0.459-0.086=0.373
min28.854-28.019=0.835
max29.802-28.211=1.591