Compare commits

Home / Compare 11e5ce46 .. 488133eb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.781=0.001
σ0.048-0.048=-0.000
min70.748-70.749=-0.001
max70.916-70.913=0.002
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.160-0.158=0.002
σ0.004-0.005=-0.001
min0.152-0.151=0.001
max0.165-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.492-21.493=-0.001
σ0.003-0.002=0.001
min21.485-21.489=-0.004
max21.497-21.495=0.001
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.063-0.066=-0.003
σ0.004-0.002=0.002
min0.059-0.064=-0.005
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1754.094=-0.002
σ0.360-0.360=0.000
min1753.529-1753.530=-0.001
max1754.678-1754.680=-0.002
mean1632.750-1653.900=-21.150
σ611.448-626.856=-15.408
min638.000-625.000=13.000
max2454.000-2771.000=-317.000
mean2.784-2.846=-0.062
σ0.158-0.140=0.017
min2.503-2.529=-0.026
max2.988-3.052=-0.064

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.601-271.598=0.003
σ0.007-0.007=0.000
min271.592-271.589=0.003
max271.613-271.604=0.008
mean2454.000-2771.000=-317.000
σ0.000
min2454.000-2771.000=-317.000
max2454.000-2771.000=-317.000
mean0.386-0.384=0.002
σ0.008-0.004=0.005
min0.380-0.380=-0.000
max0.399-0.390=0.009
iters=5
new-facts=1
prior-facts=6402
mean1932.002-1932.001=0.000
σ0.010-0.016=-0.006
min1931.988-1931.975=0.013
max1932.012-1932.013=-0.000
mean2454.000-2771.000=-317.000
σ0.000
min2454.000-2771.000=-317.000
max2454.000-2771.000=-317.000
mean2.535-2.583=-0.048
σ0.153-0.075=0.079
min2.384-2.509=-0.124
max2.777-2.669=0.107
iters=5
new-facts=6402
prior-facts=1
mean4752.711-4752.665=0.046
σ0.886-1.010=-0.124
min4752.220-4751.816=0.404
max4754.291-4754.409=-0.118
mean2454.000-2771.000=-317.000
σ0.000
min2454.000-2771.000=-317.000
max2454.000-2771.000=-317.000
mean8.699-8.256=0.443
σ0.317-0.588=-0.271
min8.343-7.639=0.704
max9.196-9.118=0.078
iters=5
new-facts=6402
prior-facts=6402
mean4943.138-4943.203=-0.065
σ0.149-0.018=0.131
min4942.873-4943.182=-0.309
max4943.219-4943.222=-0.002
mean3021.000-3023.000=-2.000
σ261.648-297.190=-35.543
min2626.000-2771.000=-145.000
max3319.000-3461.000=-142.000
mean8.585-8.439=0.146
σ0.194-0.081=0.113
min8.345-8.384=-0.039
max8.797-8.581=0.216

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.767-1.070=0.697
σ0.155-0.239=-0.083
min1.538-0.931=0.607
max1.924-1.485=0.439

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.651-468.666=-0.014
σ574.931-574.938=-0.007
min181.183-181.190=-0.007
max1331.048-1331.072=-0.024
mean88.250
σ8.500
min84.000
max101.000
mean2454.000-2771.000=-317.000
σ0.000
min2454.000-2771.000=-317.000
max2454.000-2771.000=-317.000
mean0.574-0.450=0.124
σ0.569-0.304=0.265
min0.285-0.295=-0.010
max1.427-0.906=0.521
policies=20
mean1812.157-1812.233=-0.076
σ0.392-0.367=0.025
min1811.899-1811.956=-0.057
max1812.737-1812.757=-0.020
mean840.000
σ0.000
min840.000
max840.000
mean2454.000-2771.000=-317.000
σ0.000
min2454.000-2771.000=-317.000
max2454.000-2771.000=-317.000
mean2.833-2.899=-0.066
σ0.007-0.126=-0.119
min2.823-2.826=-0.003
max2.839-3.087=-0.248
policies=200
mean18129.124-18129.230=-0.106
σ0.563-0.444=0.119
min18128.719-18128.871=-0.152
max18129.927-18129.876=0.051
mean8400.000
σ0.000
min8400.000
max8400.000
mean2454.000-2771.000=-317.000
σ0.000
min2454.000-2771.000=-317.000
max2454.000-2771.000=-317.000
mean28.661-28.626=0.034
σ0.081-0.048=0.034
min28.563-28.558=0.004
max28.758-28.669=0.089