Compare commits

Home / Compare e34d08d5 .. a93afbba

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.783=-0.001
σ0.048-0.046=0.002
min70.747-70.754=-0.007
max70.915-70.911=0.004
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.160-0.162=-0.003
σ0.003-0.007=-0.004
min0.157-0.156=0.002
max0.166-0.174=-0.008
cache=y
dps=1
iters=10
policies=100
mean21.494-21.493=0.000
σ0.004-0.003=0.001
min21.489-21.488=0.001
max21.500-21.498=0.003
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.065-0.066=-0.001
σ0.003-0.003=-0.000
min0.064-0.064=-0.000
max0.072-0.074=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1754.092=0.000
σ0.360-0.359=0.001
min1753.528-1753.531=-0.003
max1754.680-1754.680=0.000
mean1659.500-1667.450=-7.950
σ617.064-633.848=-16.783
min645.000-669.000=-24.000
max2492.000-2725.000=-233.000
mean2.792-2.784=0.008
σ0.221-0.252=-0.031
min2.267-2.108=0.159
max3.164-3.058=0.106

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.956-271.955=0.001
σ0.007-0.007=0.001
min271.949-271.949=-0.001
max271.967-271.966=0.001
mean2492.000-2725.000=-233.000
σ0.000
min2492.000-2725.000=-233.000
max2492.000-2725.000=-233.000
mean0.384-0.383=0.001
σ0.011-0.006=0.005
min0.378-0.378=-0.001
max0.403-0.394=0.009
iters=5
new-facts=1
prior-facts=6402
mean1932.315-1932.329=-0.014
σ0.011-0.008=0.003
min1932.298-1932.318=-0.020
max1932.326-1932.340=-0.014
mean2492.000-2725.000=-233.000
σ0.000
min2492.000-2725.000=-233.000
max2492.000-2725.000=-233.000
mean3.039-2.967=0.072
σ0.114-0.186=-0.072
min2.927-2.645=0.281
max3.231-3.123=0.108
iters=5
new-facts=6402
prior-facts=1
mean4753.055-4753.120=-0.065
σ0.910-0.905=0.006
min4752.577-4752.552=0.025
max4754.681-4754.716=-0.035
mean2492.000-2725.000=-233.000
σ0.000
min2492.000-2725.000=-233.000
max2492.000-2725.000=-233.000
mean8.700-8.518=0.182
σ0.515-0.677=-0.162
min7.864-7.600=0.264
max9.182-9.092=0.090
iters=5
new-facts=6402
prior-facts=6402
mean4943.558-4943.560=-0.002
σ0.015-0.017=-0.002
min4943.540-4943.542=-0.002
max4943.572-4943.580=-0.009
mean2958.000-3022.800=-64.800
σ272.310-247.281=25.030
min2590.000-2725.000=-135.000
max3311.000-3338.000=-27.000
mean8.578-8.552=0.026
σ0.198-0.191=0.007
min8.462-8.399=0.063
max8.931-8.869=0.061

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.703-1.077=0.625
σ0.192-0.150=0.042
min1.455-0.929=0.526
max1.920-1.252=0.668

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.611-468.617=-0.006
σ574.882-574.894=-0.012
min181.166-181.163=0.003
max1330.933-1330.958=-0.024
mean88.250
σ8.500
min84.000
max101.000
mean2492.000-2725.000=-233.000
σ0.000
min2492.000-2725.000=-233.000
max2492.000-2725.000=-233.000
mean0.571-0.555=0.016
σ0.556-0.530=0.026
min0.292-0.289=0.003
max1.404-1.350=0.054
policies=20
mean1811.957-1811.960=-0.003
σ0.388-0.389=-0.001
min1811.700-1811.686=0.014
max1812.530-1812.533=-0.003
mean840.000
σ0.000
min840.000
max840.000
mean2492.000-2725.000=-233.000
σ0.000
min2492.000-2725.000=-233.000
max2492.000-2725.000=-233.000
mean2.832-2.838=-0.006
σ0.027-0.021=0.006
min2.800-2.813=-0.013
max2.865-2.858=0.007
policies=200
mean18126.781-18126.797=-0.015
σ0.486-0.465=0.022
min18126.487-18126.477=0.011
max18127.508-18127.486=0.021
mean8400.000
σ0.000
min8400.000
max8400.000
mean2492.000-2725.000=-233.000
σ0.000
min2492.000-2725.000=-233.000
max2492.000-2725.000=-233.000
mean28.584-28.584=0.000
σ0.073-0.070=0.003
min28.498-28.511=-0.014
max28.663-28.679=-0.016