Compare commits

Home / Compare 70440dc1 .. ed018e4e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.783-70.782=0.001
σ0.047-0.045=0.001
min70.757-70.755=0.001
max70.913-70.908=0.006
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.160-0.159=0.001
σ0.002-0.004=-0.002
min0.157-0.152=0.005
max0.165-0.164=0.002
cache=y
dps=1
iters=10
policies=100
mean21.494-21.494=-0.000
σ0.001-0.003=-0.001
min21.490-21.490=0.000
max21.495-21.499=-0.004
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.062-0.066=-0.004
σ0.003-0.003=0.000
min0.058-0.065=-0.006
max0.067-0.075=-0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.095-1754.093=0.002
σ0.360-0.362=-0.002
min1753.531-1753.536=-0.005
max1754.682-1754.678=0.004
mean1645.600-1642.150=3.450
σ603.361-604.214=-0.854
min646.000-642.000=4.000
max2457.000-2455.000=2.000
mean2.825-2.791=0.034
σ0.207-0.201=0.007
min2.268-2.271=-0.003
max3.172-3.126=0.046

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.956-271.600=0.357
σ0.007-0.006=0.001
min271.947-271.594=0.353
max271.964-271.608=0.356
mean2457.000-2455.000=2.000
σ0.000
min2457.000-2455.000=2.000
max2457.000-2455.000=2.000
mean0.387-0.383=0.003
σ0.009-0.002=0.007
min0.380-0.381=-0.001
max0.400-0.385=0.015
iters=5
new-facts=1
prior-facts=6402
mean1932.328-1932.006=0.322
σ0.008-0.011=-0.004
min1932.320-1931.991=0.329
max1932.336-1932.021=0.315
mean2457.000-2455.000=2.000
σ0.000
min2457.000-2455.000=2.000
max2457.000-2455.000=2.000
mean2.947-2.508=0.438
σ0.320-0.094=0.225
min2.395-2.393=0.002
max3.182-2.623=0.559
iters=5
new-facts=6402
prior-facts=1
mean4753.124-4752.774=0.350
σ0.882-0.844=0.038
min4752.588-4752.254=0.334
max4754.683-4754.271=0.411
mean2457.000-2455.000=2.000
σ0.000
min2457.000-2455.000=2.000
max2457.000-2455.000=2.000
mean8.326-8.445=-0.118
σ0.574-0.488=0.085
min7.587-7.851=-0.263
max8.962-8.945=0.018
iters=5
new-facts=6402
prior-facts=6402
mean4943.560-4943.138=0.422
σ0.020-0.167=-0.148
min4943.532-4942.840=0.692
max4943.575-4943.233=0.342
mean2969.200-3018.200=-49.000
σ251.536-263.245=-11.709
min2649.000-2627.000=22.000
max3309.000-3330.000=-21.000
mean8.517-8.620=-0.103
σ0.189-0.129=0.060
min8.395-8.445=-0.051
max8.850-8.746=0.104

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.757-1.726=0.031
σ0.111-0.123=-0.011
min1.636-1.549=0.086
max1.855-1.819=0.036

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.656-468.632=0.024
σ574.921-574.925=-0.004
min181.190-181.165=0.025
max1331.037-1331.020=0.017
mean88.250
σ8.500
min84.000
max101.000
mean2457.000-2455.000=2.000
σ0.000
min2457.000-2455.000=2.000
max2457.000-2455.000=2.000
mean0.559-0.553=0.005
σ0.542-0.518=0.024
min0.284-0.288=-0.004
max1.372-1.331=0.041
policies=20
mean1812.201-1811.964=0.236
σ0.388-0.393=-0.005
min1811.941-1811.703=0.238
max1812.773-1812.545=0.228
mean840.000
σ0.000
min840.000
max840.000
mean2457.000-2455.000=2.000
σ0.000
min2457.000-2455.000=2.000
max2457.000-2455.000=2.000
mean2.842-2.846=-0.005
σ0.010-0.027=-0.016
min2.829-2.818=0.011
max2.854-2.882=-0.028
policies=200
mean18129.144-18126.638=2.507
σ0.308-0.590=-0.282
min18128.908-18126.241=2.667
max18129.594-18127.497=2.096
mean8400.000
σ0.000
min8400.000
max8400.000
mean2457.000-2455.000=2.000
σ0.000
min2457.000-2455.000=2.000
max2457.000-2455.000=2.000
mean28.581-28.691=-0.109
σ0.094-0.036=0.058
min28.460-28.661=-0.202
max28.680-28.738=-0.059