Compare commits

Home / Compare a85dc53b .. a15d4236

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.787-70.787=0.000
σ0.048-0.048=-0.000
min70.757-70.754=0.003
max70.921-70.921=0.000
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.160-0.162=-0.002
σ0.003-0.003=-0.000
min0.158-0.158=-0.001
max0.168-0.166=0.002
cache=y
dps=1
iters=10
policies=100
mean21.495-21.495=-0.000
σ0.004-0.004=0.000
min21.489-21.487=0.002
max21.501-21.499=0.001
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.065-0.066=-0.001
σ0.004-0.002=0.002
min0.059-0.064=-0.005
max0.075-0.072=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.094-1754.096=-0.002
σ0.362-0.361=0.001
min1753.529-1753.537=-0.008
max1754.679-1754.679=-0.001
mean1661.550-1647.750=13.800
σ633.055-602.830=30.225
min626.000-642.000=-16.000
max2756.000-2456.000=300.000
mean2.802-2.800=0.002
σ0.158-0.205=-0.047
min2.384-2.260=0.123
max3.031-3.198=-0.167

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.957-271.956=0.001
σ0.009-0.010=-0.002
min271.946-271.946=-0.001
max271.964-271.972=-0.009
mean2756.000-2456.000=300.000
σ0.000
min2756.000-2456.000=300.000
max2756.000-2456.000=300.000
mean0.386-0.390=-0.004
σ0.007-0.016=-0.009
min0.379-0.378=0.001
max0.395-0.416=-0.021
iters=5
new-facts=1
prior-facts=6402
mean1932.319-1932.331=-0.012
σ0.006-0.014=-0.009
min1932.315-1932.308=0.007
max1932.329-1932.345=-0.016
mean2756.000-2456.000=300.000
σ0.000
min2756.000-2456.000=300.000
max2756.000-2456.000=300.000
mean2.997-2.997=0.000
σ0.059-0.094=-0.035
min2.910-2.870=0.040
max3.073-3.125=-0.051
iters=5
new-facts=6402
prior-facts=1
mean4752.935-4753.093=-0.157
σ0.998-0.916=0.082
min4752.085-4752.578=-0.493
max4754.664-4754.722=-0.058
mean2756.000-2456.000=300.000
σ0.000
min2756.000-2456.000=300.000
max2756.000-2456.000=300.000
mean8.779-8.651=0.128
σ0.237-0.420=-0.183
min8.518-8.020=0.498
max9.065-9.108=-0.044
iters=5
new-facts=6402
prior-facts=6402
mean4943.557-4943.550=0.007
σ0.018-0.020=-0.002
min4943.542-4943.532=0.010
max4943.581-4943.581=-0.000
mean2998.800-2891.800=107.000
σ222.227-367.449=-145.222
min2756.000-2456.000=300.000
max3322.000-3399.000=-77.000
mean8.508-8.346=0.162
σ0.146-0.128=0.018
min8.352-8.172=0.180
max8.668-8.509=0.159

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.025-1.753=-0.728
σ0.132-0.128=0.004
min0.935-1.544=-0.608
max1.237-1.873=-0.636

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.668-468.655=0.013
σ574.938-574.922=0.016
min181.194-181.191=0.003
max1331.075-1331.038=0.037
mean88.250
σ8.500
min84.000
max101.000
mean2756.000-2456.000=300.000
σ0.000
min2756.000-2456.000=300.000
max2756.000-2456.000=300.000
mean0.566-0.569=-0.003
σ0.549-0.553=-0.004
min0.289-0.286=0.003
max1.390-1.399=-0.009
policies=20
mean1812.230-1812.203=0.027
σ0.385-0.388=-0.003
min1811.968-1811.955=0.014
max1812.798-1812.779=0.019
mean840.000
σ0.000
min840.000
max840.000
mean2756.000-2456.000=300.000
σ0.000
min2756.000-2456.000=300.000
max2756.000-2456.000=300.000
mean2.843-2.839=0.003
σ0.020-0.024=-0.003
min2.824-2.816=0.009
max2.863-2.872=-0.009
policies=200
mean18129.359-18129.216=0.143
σ0.439-0.412=0.027
min18129.026-18128.856=0.171
max18130.004-18129.805=0.199
mean8400.000
σ0.000
min8400.000
max8400.000
mean2756.000-2456.000=300.000
σ0.000
min2756.000-2456.000=300.000
max2756.000-2456.000=300.000
mean28.602-28.643=-0.041
σ0.093-0.084=0.010
min28.512-28.548=-0.036
max28.716-28.745=-0.029