Compare commits

Home / Compare f0326ed2 .. 3b4bbfa4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.782=-0.001
σ0.052-0.055=-0.003
min70.750-70.745=0.005
max70.926-70.935=-0.009
mean414.000-414.700=-0.700
σ0.000-0.483=-0.483
min414.000
max414.000-415.000=-1.000
mean0.159-0.160=-0.001
σ0.005-0.003=0.002
min0.151-0.158=-0.007
max0.166-0.167=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.493-21.494=-0.001
σ0.002-0.002=0.000
min21.489-21.490=-0.001
max21.496-21.497=-0.001
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.064-0.065=-0.001
σ0.004-0.002=0.002
min0.059-0.062=-0.003
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.882-1751.882=0.000
σ0.362-0.362=-0.000
min1751.315-1751.313=0.002
max1752.467-1752.474=-0.007
mean1632.850-1665.300=-32.450
σ623.812-638.903=-15.091
min620.000-678.000=-58.000
max2764.000-2694.000=70.000
mean2.756-2.828=-0.072
σ0.246-0.209=0.037
min2.174-2.199=-0.025
max3.273-3.053=0.220

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.382-269.381=0.001
σ0.005-0.007=-0.002
min269.376-269.372=0.004
max269.389-269.388=0.001
mean2764.000-2694.000=70.000
σ0.000
min2764.000-2694.000=70.000
max2764.000-2694.000=70.000
mean0.373-0.376=-0.002
σ0.004-0.004=0.001
min0.370-0.371=-0.001
max0.381-0.381=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1929.764-1929.739=0.024
σ0.012-0.013=-0.001
min1929.751-1929.722=0.030
max1929.783-1929.751=0.032
mean2764.000-2694.000=70.000
σ0.000
min2764.000-2694.000=70.000
max2764.000-2694.000=70.000
mean2.815-2.990=-0.175
σ0.271-0.102=0.168
min2.467-2.873=-0.406
max3.115-3.099=0.016
iters=5
new-facts=6402
prior-facts=1
mean4750.582-4750.524=0.058
σ0.835-0.859=-0.024
min4750.122-4750.042=0.079
max4752.069-4752.054=0.015
mean2764.000-2694.000=70.000
σ0.000
min2764.000-2694.000=70.000
max2764.000-2694.000=70.000
mean8.040-8.416=-0.375
σ0.371-0.443=-0.072
min7.683-7.935=-0.252
max8.568-9.043=-0.474
iters=5
new-facts=6402
prior-facts=6402
mean4940.924-4940.987=-0.063
σ0.152-0.019=0.133
min4940.654-4940.962=-0.308
max4941.010-4941.005=0.004
mean3019.600-2952.200=67.400
σ291.884-300.706=-8.822
min2764.000-2694.000=70.000
max3437.000-3392.000=45.000
mean8.585-8.409=0.175
σ0.302-0.070=0.232
min8.373-8.345=0.027
max9.096-8.523=0.573

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.028-1.081=-0.053
σ0.134-0.207=-0.073
min0.939-0.930=0.009
max1.246-1.359=-0.113

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.711-462.697=0.014
σ574.953-574.942=0.011
min175.223-175.221=0.003
max1325.140-1325.110=0.030
mean86.250
σ8.500
min82.000
max99.000
mean2764.000-2694.000=70.000
σ0.000
min2764.000-2694.000=70.000
max2764.000-2694.000=70.000
mean0.536-0.549=-0.013
σ0.521-0.536=-0.015
min0.275-0.276=-0.001
max1.318-1.352=-0.034
policies=20
mean1752.511-1752.513=-0.002
σ0.343-0.349=-0.006
min1752.300-1752.290=0.010
max1753.024-1753.035=-0.011
mean820.000
σ0.000
min820.000
max820.000
mean2764.000-2694.000=70.000
σ0.000
min2764.000-2694.000=70.000
max2764.000-2694.000=70.000
mean2.713-2.716=-0.004
σ0.022-0.006=0.016
min2.691-2.710=-0.019
max2.742-2.724=0.018
policies=200
mean17532.266-17532.313=-0.047
σ0.352-0.477=-0.124
min17532.074-17531.990=0.085
max17532.794-17533.022=-0.228
mean8200.000
σ0.000
min8200.000
max8200.000
mean2764.000-2694.000=70.000
σ0.000
min2764.000-2694.000=70.000
max2764.000-2694.000=70.000
mean27.503-27.339=0.164
σ0.188-0.126=0.062
min27.341-27.220=0.121
max27.729-27.505=0.224