Compare commits

Home / Compare f8e48a63 .. 61167d29

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.687-70.691=-0.005
σ0.045-0.048=-0.003
min70.663-70.658=0.005
max70.815-70.826=-0.011
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.160-0.161=-0.001
σ0.003-0.004=-0.001
min0.156-0.158=-0.002
max0.166-0.168=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.421-21.420=0.001
σ0.002-0.003=-0.001
min21.418-21.416=0.002
max21.424-21.425=-0.001
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.065-0.064=0.002
σ0.003-0.004=-0.001
min0.063-0.058=0.005
max0.074-0.074=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.457-1754.458=-0.001
σ0.359-0.360=-0.001
min1753.896-1753.881=0.015
max1755.036-1755.039=-0.002
mean1647.200-1670.850=-23.650
σ628.376-628.866=-0.490
min627.000-664.000=-37.000
max2864.000-2620.000=244.000
mean2.819-2.800=0.018
σ0.275-0.126=0.149
min2.154-2.412=-0.258
max3.511-2.927=0.584

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.507-273.501=0.006
σ0.004-0.005=-0.001
min273.500-273.493=0.008
max273.511-273.506=0.005
mean2864.000-2620.000=244.000
σ0.000
min2864.000-2620.000=244.000
max2864.000-2620.000=244.000
mean0.386-0.378=0.008
σ0.012-0.004=0.008
min0.378-0.376=0.002
max0.407-0.386=0.022
iters=5
new-facts=1
prior-facts=6402
mean1933.899-1933.892=0.007
σ0.007-0.005=0.002
min1933.886-1933.883=0.003
max1933.906-1933.896=0.009
mean2864.000-2620.000=244.000
σ0.000
min2864.000-2620.000=244.000
max2864.000-2620.000=244.000
mean3.009-3.035=-0.026
σ0.012-0.137=-0.125
min3.003-2.820=0.182
max3.030-3.158=-0.128
iters=5
new-facts=6402
prior-facts=1
mean4754.735-4613.988=140.747
σ0.805-314.468=-313.664
min4754.295-4051.453=702.842
max4756.172-4756.134=0.038
mean2864.000-2620.000=244.000
σ0.000
min2864.000-2620.000=244.000
max2864.000-2620.000=244.000
mean7.973-8.081=-0.108
σ0.342-0.725=-0.383
min7.724-7.000=0.725
max8.570-8.942=-0.372
iters=5
new-facts=6402
prior-facts=6402
mean4945.114-4945.056=0.059
σ0.012-0.173=-0.162
min4945.100-4944.747=0.352
max4945.132-4945.160=-0.028
mean3052.000-3014.000=38.000
σ264.484-378.325=-113.840
min2864.000-2620.000=244.000
max3472.000-3543.000=-71.000
mean8.451-8.815=-0.364
σ0.113-0.366=-0.253
min8.355-8.538=-0.183
max8.641-9.448=-0.807

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.064-1.286=-0.222
σ0.146-0.358=-0.213
min0.934-0.927=0.006
max1.288-1.739=-0.450

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.568-472.567=0.001
σ574.927-574.933=-0.005
min185.099-185.096=0.003
max1334.959-1334.966=-0.007
mean88.250
σ8.500
min84.000
max101.000
mean2864.000-2620.000=244.000
σ0.000
min2864.000-2620.000=244.000
max2864.000-2620.000=244.000
mean0.448-0.558=-0.110
σ0.306-0.534=-0.228
min0.289-0.289=-0.000
max0.907-1.359=-0.453
policies=20
mean1851.264-1851.234=0.031
σ0.381-0.368=0.013
min1850.986-1850.985=0.000
max1851.820-1851.780=0.040
mean840.000
σ0.000
min840.000
max840.000
mean2864.000-2620.000=244.000
σ0.000
min2864.000-2620.000=244.000
max2864.000-2620.000=244.000
mean2.948-2.859=0.089
σ0.001-0.021=-0.019
min2.947-2.836=0.111
max2.950-2.877=0.074
policies=200
mean18519.284-18519.214=0.070
σ0.496-0.574=-0.078
min18518.906-18518.830=0.076
max18520.013-18520.056=-0.044
mean8400.000
σ0.000
min8400.000
max8400.000
mean2864.000-2620.000=244.000
σ0.000
min2864.000-2620.000=244.000
max2864.000-2620.000=244.000
mean29.185-28.955=0.230
σ0.442-0.032=0.410
min28.828-28.925=-0.097
max29.787-28.998=0.789