Compare commits

Home / Compare 53e50adb .. 9f4c61bb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.565-70.567=-0.001
σ0.046-0.046=0.000
min70.536-70.543=-0.006
max70.693-70.693=-0.000
mean418.000
σ0.000
min418.000
max418.000
mean0.155-0.160=-0.005
σ0.005-0.004=0.001
min0.147-0.155=-0.007
max0.164-0.168=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.288-21.287=0.001
σ0.003-0.003=-0.000
min21.283-21.284=-0.001
max21.291-21.293=-0.001
mean418.000
σ0.000
min418.000
max418.000
mean0.064-0.063=0.002
σ0.002-0.004=-0.002
min0.063-0.059=0.004
max0.069-0.071=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.567-1753.567=0.001
σ0.360-0.360=-0.000
min1752.998-1752.999=-0.001
max1754.152-1754.140=0.013
mean1652.350-1645.250=7.100
σ641.702-630.569=11.132
min634.000-630.000=4.000
max2884.000-2851.000=33.000
mean2.749-2.775=-0.026
σ0.215-0.167=0.047
min2.146-2.344=-0.198
max2.974-3.010=-0.036

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.019-272.015=0.004
σ0.004-0.006=-0.003
min272.015-272.007=0.008
max272.025-272.023=0.002
mean2884.000-2851.000=33.000
σ0.000
min2884.000-2851.000=33.000
max2884.000-2851.000=33.000
mean0.393-0.385=0.008
σ0.006-0.008=-0.002
min0.387-0.380=0.008
max0.402-0.399=0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.437-1932.444=-0.007
σ0.005-0.010=-0.005
min1932.430-1932.433=-0.002
max1932.443-1932.456=-0.013
mean2884.000-2851.000=33.000
σ0.000
min2884.000-2851.000=33.000
max2884.000-2851.000=33.000
mean3.022-2.936=0.086
σ0.068-0.178=-0.109
min2.976-2.623=0.353
max3.141-3.064=0.078
iters=5
new-facts=6402
prior-facts=1
mean4753.187-4753.172=0.015
σ0.800-0.839=-0.039
min4752.679-4752.713=-0.034
max4754.607-4754.665=-0.057
mean2884.000-2851.000=33.000
σ0.000
min2884.000-2851.000=33.000
max2884.000-2851.000=33.000
mean8.363-8.484=-0.121
σ0.384-0.452=-0.068
min7.817-7.818=-0.001
max8.838-8.997=-0.159
iters=5
new-facts=6402
prior-facts=6402
mean4943.632-4943.628=0.004
σ0.028-0.026=0.002
min4943.597-4943.595=0.002
max4943.665-4943.657=0.007
mean3067.000-3072.000=-5.000
σ195.553-226.112=-30.559
min2884.000-2851.000=33.000
max3355.000-3404.000=-49.000
mean8.498-8.613=-0.115
σ0.164-0.233=-0.069
min8.358-8.416=-0.058
max8.753-9.017=-0.265

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.023-1.103=-0.080
σ0.188-0.234=-0.046
min0.926-0.938=-0.012
max1.359-1.449=-0.090

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.081-473.082=-0.001
σ575.914-575.927=-0.013
min185.116-185.114=0.002
max1336.952-1336.972=-0.020
mean88.250
σ8.500
min84.000
max101.000
mean2884.000-2851.000=33.000
σ0.000
min2884.000-2851.000=33.000
max2884.000-2851.000=33.000
mean0.448-0.487=-0.038
σ0.302-0.374=-0.072
min0.294-0.297=-0.003
max0.902-1.048=-0.146
policies=20
mean1851.441-1851.451=-0.010
σ0.373-0.375=-0.002
min1851.174-1851.167=0.007
max1851.986-1851.995=-0.009
mean840.000
σ0.000
min840.000
max840.000
mean2884.000-2851.000=33.000
σ0.000
min2884.000-2851.000=33.000
max2884.000-2851.000=33.000
mean2.937-2.952=-0.015
σ0.006-0.009=-0.004
min2.930-2.942=-0.013
max2.944-2.960=-0.016
policies=200
mean18520.678-18521.211=-0.533
σ0.758-0.460=0.298
min18519.684-18520.904=-1.219
max18521.529-18521.896=-0.367
mean8400.000
σ0.000
min8400.000
max8400.000
mean2884.000-2851.000=33.000
σ0.000
min2884.000-2851.000=33.000
max2884.000-2851.000=33.000
mean29.175-29.104=0.071
σ0.432-0.432=0.000
min28.799-28.806=-0.007
max29.640-29.729=-0.089