Compare commits

Home / Compare b6216275 .. 53247dc8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.730-70.729=0.000
σ0.044-0.046=-0.002
min70.704-70.701=0.003
max70.852-70.858=-0.005
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.158-0.156=0.002
σ0.004-0.005=-0.000
min0.153-0.150=0.003
max0.166-0.162=0.003
cache=y
dps=1
iters=10
policies=100
mean21.445-21.449=-0.004
σ0.003-0.009=-0.006
min21.441-21.442=-0.001
max21.451-21.475=-0.023
mean415.000-417.800=-2.800
σ0.000-0.422=-0.422
min415.000-417.000=-2.000
max415.000-418.000=-3.000
mean0.065-0.066=-0.001
σ0.002-0.004=-0.002
min0.063-0.063=0.001
max0.070-0.075=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.529-1754.528=0.002
σ0.361-0.363=-0.002
min1753.961-1753.954=0.007
max1755.114-1755.092=0.022
mean1655.650-1660.200=-4.550
σ640.477-626.124=14.353
min639.000-628.000=11.000
max2846.000-2837.000=9.000
mean2.868-2.763=0.105
σ0.137-0.182=-0.046
min2.606-2.352=0.254
max3.144-2.973=0.172

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.610-273.609=0.001
σ0.006-0.007=-0.001
min273.604-273.599=0.004
max273.620-273.617=0.003
mean2846.000-2837.000=9.000
σ0.000
min2846.000-2837.000=9.000
max2846.000-2837.000=9.000
mean0.383-0.389=-0.006
σ0.004-0.009=-0.005
min0.381-0.380=0.000
max0.390-0.401=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1934.003-1933.995=0.008
σ0.009-0.006=0.004
min1933.991-1933.987=0.004
max1934.017-1934.003=0.014
mean2846.000-2837.000=9.000
σ0.000
min2846.000-2837.000=9.000
max2846.000-2837.000=9.000
mean2.978-2.992=-0.014
σ0.130-0.099=0.032
min2.792-2.848=-0.056
max3.150-3.084=0.066
iters=5
new-facts=6402
prior-facts=1
mean4754.762-4754.780=-0.017
σ0.820-0.832=-0.012
min4754.298-4754.284=0.014
max4756.226-4756.261=-0.035
mean2846.000-2837.000=9.000
σ0.000
min2846.000-2837.000=9.000
max2846.000-2837.000=9.000
mean8.399-8.388=0.012
σ0.386-0.540=-0.154
min7.803-7.629=0.174
max8.872-9.113=-0.241
iters=5
new-facts=6402
prior-facts=6402
mean4945.224-4945.224=0.000
σ0.013-0.024=-0.011
min4945.214-4945.192=0.022
max4945.242-4945.254=-0.012
mean3065.200-3083.000=-17.800
σ234.182-247.010=-12.828
min2846.000-2837.000=9.000
max3410.000-3331.000=79.000
mean8.509-8.781=-0.272
σ0.102-0.396=-0.294
min8.404-8.418=-0.014
max8.646-9.453=-0.807

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.001-1.044=-0.043
σ0.134-0.132=0.002
min0.938-0.924=0.014
max1.241-1.248=-0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.843-472.844=-0.001
σ574.927-574.927=-0.000
min185.373-185.370=0.003
max1335.233-1335.235=-0.001
mean88.250
σ8.500
min84.000
max101.000
mean2846.000-2837.000=9.000
σ0.000
min2846.000-2837.000=9.000
max2846.000-2837.000=9.000
mean0.489-0.449=0.040
σ0.379-0.299=0.080
min0.296-0.297=-0.001
max1.057-0.897=0.160
policies=20
mean1853.996-1853.987=0.010
σ0.373-0.372=0.001
min1853.721-1853.722=-0.001
max1854.541-1854.529=0.012
mean840.000
σ0.000
min840.000
max840.000
mean2846.000-2837.000=9.000
σ0.000
min2846.000-2837.000=9.000
max2846.000-2837.000=9.000
mean2.938-2.949=-0.012
σ0.014-0.011=0.003
min2.922-2.940=-0.018
max2.955-2.961=-0.006
policies=200
mean18546.718-18546.684=0.034
σ0.503-0.477=0.026
min18546.416-18546.352=0.064
max18547.470-18547.384=0.086
mean8400.000
σ0.000
min8400.000
max8400.000
mean2846.000-2837.000=9.000
σ0.000
min2846.000-2837.000=9.000
max2846.000-2837.000=9.000
mean29.157-29.229=-0.072
σ0.442-0.481=-0.038
min28.774-28.739=0.034
max29.744-29.781=-0.038