Compare commits

Home / Compare e72e0599 .. b4b81164

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.564-70.563=0.000
σ0.049-0.045=0.003
min70.536-70.539=-0.003
max70.701-70.692=0.009
mean417.000-412.000=5.000
σ0.000
min417.000-412.000=5.000
max417.000-412.000=5.000
mean0.160-0.158=0.002
σ0.003-0.003=0.000
min0.155-0.151=0.004
max0.166-0.163=0.003
cache=y
dps=1
iters=10
policies=100
mean21.291-21.287=0.004
σ0.011-0.003=0.008
min21.283-21.283=0.001
max21.322-21.292=0.030
mean417.000-412.000=5.000
σ0.000
min417.000-412.000=5.000
max417.000-412.000=5.000
mean0.064-0.065=-0.000
σ0.003-0.002=0.001
min0.060-0.063=-0.003
max0.071-0.070=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.175-1753.173=0.001
σ0.358-0.361=-0.003
min1752.603-1752.603=0.000
max1753.750-1753.765=-0.015
mean1659.500-1651.150=8.350
σ641.917-643.767=-1.850
min634.000-629.000=5.000
max2809.000-2886.000=-77.000
mean2.871-2.823=0.048
σ0.115-0.158=-0.043
min2.466-2.430=0.036
max3.023-3.110=-0.086

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.620-271.621=-0.002
σ0.007-0.006=0.001
min271.613-271.612=0.001
max271.631-271.628=0.003
mean2809.000-2886.000=-77.000
σ0.000
min2809.000-2886.000=-77.000
max2809.000-2886.000=-77.000
mean0.385-0.384=0.001
σ0.008-0.008=0.001
min0.378-0.377=0.001
max0.397-0.392=0.005
iters=5
new-facts=1
prior-facts=6402
mean1932.043-1932.042=0.001
σ0.018-0.011=0.007
min1932.022-1932.026=-0.003
max1932.062-1932.050=0.013
mean2809.000-2886.000=-77.000
σ0.000
min2809.000-2886.000=-77.000
max2809.000-2886.000=-77.000
mean2.978-2.891=0.088
σ0.060-0.292=-0.231
min2.902-2.379=0.524
max3.071-3.085=-0.014
iters=5
new-facts=6402
prior-facts=1
mean4752.752-4752.725=0.027
σ0.915-0.868=0.046
min4752.267-4752.272=-0.005
max4754.382-4754.273=0.109
mean2809.000-2886.000=-77.000
σ0.000
min2809.000-2886.000=-77.000
max2809.000-2886.000=-77.000
mean8.768-8.793=-0.026
σ0.298-0.297=0.001
min8.380-8.400=-0.020
max9.149-9.041=0.108
iters=5
new-facts=6402
prior-facts=6402
mean4943.228-4943.169=0.059
σ0.020-0.164=-0.144
min4943.205-4942.877=0.328
max4943.247-4943.270=-0.022
mean3013.000-3037.400=-24.400
σ257.518-170.365=87.153
min2809.000-2886.000=-77.000
max3403.000-3301.000=102.000
mean8.468-8.578=-0.110
σ0.285-0.172=0.113
min8.312-8.384=-0.072
max8.975-8.788=0.187

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.045-1.038=0.008
σ0.114-0.148=-0.034
min0.935-0.941=-0.006
max1.210-1.285=-0.075

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.291-472.294=-0.004
σ575.916-575.916=0.000
min184.327-184.331=-0.004
max1336.165-1336.168=-0.003
mean88.250
σ8.500
min84.000
max101.000
mean2809.000-2886.000=-77.000
σ0.000
min2809.000-2886.000=-77.000
max2809.000-2886.000=-77.000
mean0.451-0.454=-0.003
σ0.304-0.308=-0.003
min0.293-0.297=-0.004
max0.907-0.915=-0.008
policies=20
mean1843.572-1843.591=-0.018
σ0.381-0.386=-0.005
min1843.286-1843.291=-0.005
max1844.123-1844.148=-0.025
mean840.000
σ0.000
min840.000
max840.000
mean2809.000-2886.000=-77.000
σ0.000
min2809.000-2886.000=-77.000
max2809.000-2886.000=-77.000
mean2.963-2.972=-0.009
σ0.030-0.034=-0.004
min2.943-2.954=-0.011
max3.009-3.023=-0.015
policies=200
mean18442.118-18442.257=-0.138
σ0.424-0.488=-0.065
min18441.842-18441.922=-0.080
max18442.746-18442.975=-0.229
mean8400.000
σ0.000
min8400.000
max8400.000
mean2809.000-2886.000=-77.000
σ0.000
min2809.000-2886.000=-77.000
max2809.000-2886.000=-77.000
mean29.109-29.241=-0.132
σ0.258-0.402=-0.144
min28.735-28.861=-0.126
max29.289-29.772=-0.483