Compare commits

Home / Compare 839d2285 .. feb74a4d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.568-70.567=0.001
σ0.046-0.047=-0.001
min70.543-70.538=0.005
max70.694-70.696=-0.003
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.160-0.159=0.001
σ0.004-0.003=0.000
min0.156-0.154=0.002
max0.165-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.289-21.287=0.002
σ0.003-0.003=0.000
min21.282-21.283=-0.001
max21.293-21.292=0.000
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.065-0.063=0.002
σ0.003-0.003=-0.000
min0.063-0.059=0.004
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.174-1753.172=0.002
σ0.362-0.362=-0.000
min1752.603-1752.597=0.006
max1753.756-1753.756=0.000
mean1650.450-1644.500=5.950
σ630.541-633.205=-2.664
min636.000-630.000=6.000
max2763.000-2774.000=-11.000
mean2.817-2.841=-0.024
σ0.172-0.165=0.007
min2.450-2.338=0.112
max2.991-3.018=-0.027

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.621-271.618=0.003
σ0.007-0.004=0.003
min271.610-271.613=-0.004
max271.627-271.624=0.003
mean2763.000-2774.000=-11.000
σ0.000
min2763.000-2774.000=-11.000
max2763.000-2774.000=-11.000
mean0.382-0.378=0.005
σ0.007-0.002=0.005
min0.378-0.376=0.002
max0.395-0.381=0.014
iters=5
new-facts=1
prior-facts=6402
mean1932.050-1932.043=0.007
σ0.007-0.018=-0.011
min1932.040-1932.023=0.016
max1932.058-1932.063=-0.005
mean2763.000-2774.000=-11.000
σ0.000
min2763.000-2774.000=-11.000
max2763.000-2774.000=-11.000
mean3.021-2.975=0.046
σ0.062-0.084=-0.022
min2.944-2.898=0.046
max3.081-3.119=-0.038
iters=5
new-facts=6402
prior-facts=1
mean4752.820-4752.771=0.048
σ0.809-0.884=-0.076
min4752.245-4752.245=0.000
max4754.243-4754.340=-0.097
mean2763.000-2774.000=-11.000
σ0.000
min2763.000-2774.000=-11.000
max2763.000-2774.000=-11.000
mean8.185-8.658=-0.472
σ0.729-0.413=0.316
min7.703-8.231=-0.528
max9.407-9.176=0.230
iters=5
new-facts=6402
prior-facts=6402
mean4943.164-4943.231=-0.068
σ0.163-0.015=0.149
min4942.872-4943.221=-0.348
max4943.243-4943.257=-0.014
mean3006.800-2979.600=27.200
σ301.193-212.805=88.388
min2763.000-2774.000=-11.000
max3457.000-3301.000=156.000
mean8.409-8.464=-0.055
σ0.040-0.065=-0.025
min8.362-8.390=-0.029
max8.454-8.527=-0.073

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.076-1.078=-0.001
σ0.116-0.115=0.001
min0.933-0.935=-0.002
max1.257-1.256=0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.292-472.287=0.005
σ575.930-575.929=0.001
min184.324-184.320=0.004
max1336.187-1336.180=0.007
mean88.250
σ8.500
min84.000
max101.000
mean2763.000-2774.000=-11.000
σ0.000
min2763.000-2774.000=-11.000
max2763.000-2774.000=-11.000
mean0.450-0.445=0.005
σ0.308-0.289=0.019
min0.292-0.298=-0.006
max0.913-0.879=0.033
policies=20
mean1843.580-1843.578=0.002
σ0.363-0.397=-0.034
min1843.307-1843.286=0.021
max1844.108-1844.158=-0.050
mean840.000
σ0.000
min840.000
max840.000
mean2763.000-2774.000=-11.000
σ0.000
min2763.000-2774.000=-11.000
max2763.000-2774.000=-11.000
mean2.950-2.941=0.009
σ0.105-0.111=-0.006
min2.866-2.847=0.019
max3.097-3.096=0.001
policies=200
mean18442.230-18442.146=0.084
σ0.542-0.497=0.046
min18441.928-18441.829=0.099
max18443.041-18442.882=0.160
mean8400.000
σ0.000
min8400.000
max8400.000
mean2763.000-2774.000=-11.000
σ0.000
min2763.000-2774.000=-11.000
max2763.000-2774.000=-11.000
mean28.983-28.778=0.205
σ0.130-0.175=-0.045
min28.905-28.617=0.288
max29.178-28.990=0.188