Compare commits

Home / Compare 34afda87 .. b113e53d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.393-70.392=0.001
σ0.046-0.046=0.000
min70.372-70.366=0.005
max70.523-70.520=0.003
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.164-0.157=0.007
σ0.010-0.003=0.006
min0.156-0.151=0.005
max0.185-0.164=0.022
cache=y
dps=1
iters=10
policies=100
mean21.148-21.144=0.004
σ0.012-0.003=0.009
min21.141-21.140=0.001
max21.180-21.148=0.032
mean414.800-412.000=2.800
σ0.422-0.000=0.422
min414.000-412.000=2.000
max415.000-412.000=3.000
mean0.065-0.066=-0.001
σ0.003-0.003=0.000
min0.062-0.064=-0.003
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.700-1752.697=0.002
σ0.360-0.362=-0.001
min1752.133-1752.124=0.009
max1753.286-1753.268=0.018
mean1661.600-1650.150=11.450
σ638.432-643.574=-5.142
min626.000-629.000=-3.000
max2789.000-2855.000=-66.000
mean2.836-2.864=-0.028
σ0.129-0.163=-0.034
min2.518-2.281=0.237
max3.109-3.101=0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.609-270.591=0.018
σ0.007-0.012=-0.004
min270.598-270.581=0.017
max270.619-270.611=0.008
mean2789.000-2855.000=-66.000
σ0.000
min2789.000-2855.000=-66.000
max2789.000-2855.000=-66.000
mean0.378-0.382=-0.004
σ0.006-0.009=-0.003
min0.368-0.372=-0.004
max0.386-0.397=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1931.040-1931.035=0.005
σ0.005-0.011=-0.007
min1931.034-1931.017=0.018
max1931.047-1931.046=0.001
mean2789.000-2855.000=-66.000
σ0.000
min2789.000-2855.000=-66.000
max2789.000-2855.000=-66.000
mean3.032-2.930=0.102
σ0.100-0.143=-0.043
min2.956-2.702=0.254
max3.189-3.079=0.110
iters=5
new-facts=6402
prior-facts=1
mean4751.622-4751.796=-0.174
σ1.040-0.869=0.171
min4750.395-4751.286=-0.891
max4753.278-4753.343=-0.065
mean2789.000-2855.000=-66.000
σ0.000
min2789.000-2855.000=-66.000
max2789.000-2855.000=-66.000
mean7.940-8.281=-0.341
σ0.320-0.495=-0.175
min7.692-7.651=0.041
max8.490-8.892=-0.402
iters=5
new-facts=6402
prior-facts=6402
mean4942.233-4942.232=0.001
σ0.024-0.024=0.000
min4942.198-4942.207=-0.008
max4942.256-4942.258=-0.003
mean3024.800-3039.000=-14.200
σ284.676-236.773=47.903
min2789.000-2855.000=-66.000
max3454.000-3398.000=56.000
mean8.444-8.435=0.009
σ0.128-0.115=0.013
min8.274-8.310=-0.036
max8.609-8.555=0.054

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.081-1.072=0.009
σ0.272-0.233=0.039
min0.925-0.936=-0.010
max1.555-1.476=0.079

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.209-467.206=0.002
σ575.936-575.934=0.003
min179.231-179.230=0.001
max1331.114-1331.107=0.007
mean86.250
σ8.500
min82.000
max99.000
mean2789.000-2855.000=-66.000
σ0.000
min2789.000-2855.000=-66.000
max2789.000-2855.000=-66.000
mean0.485-0.441=0.044
σ0.288-0.298=-0.010
min0.293-0.291=0.002
max0.904-0.888=0.016
policies=20
mean1792.622-1792.622=-0.001
σ0.330-0.378=-0.048
min1792.363-1792.344=0.019
max1793.105-1793.176=-0.071
mean820.000
σ0.000
min820.000
max820.000
mean2789.000-2855.000=-66.000
σ0.000
min2789.000-2855.000=-66.000
max2789.000-2855.000=-66.000
mean2.786-2.875=-0.089
σ0.015-0.005=0.010
min2.772-2.870=-0.098
max2.800-2.881=-0.081
policies=200
mean17932.999-17932.952=0.047
σ0.362-0.595=-0.233
min17932.800-17932.620=0.180
max17933.542-17933.843=-0.301
mean8200.000
σ0.000
min8200.000
max8200.000
mean2789.000-2855.000=-66.000
σ0.000
min2789.000-2855.000=-66.000
max2789.000-2855.000=-66.000
mean28.087-28.651=-0.564
σ0.095-0.502=-0.407
min28.001-28.074=-0.073
max28.221-29.153=-0.932