Compare commits

Home / Compare 08acf71e .. 5d5b554f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.729-70.729=-0.000
σ0.046-0.046=0.001
min70.699-70.703=-0.004
max70.859-70.857=0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.156-0.160=-0.004
σ0.006-0.003=0.003
min0.148-0.155=-0.007
max0.164-0.164=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.446-21.446=-0.000
σ0.002-0.002=0.001
min21.443-21.444=-0.001
max21.451-21.449=0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.065=-0.000
σ0.002-0.003=-0.001
min0.063-0.063=-0.000
max0.070-0.073=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.527-1754.529=-0.002
σ0.361-0.361=-0.001
min1753.954-1753.954=0.000
max1755.107-1755.132=-0.025
mean1669.500-1659.350=10.150
σ653.109-647.558=5.551
min639.000-628.000=11.000
max2870.000-2805.000=65.000
mean2.853-2.832=0.021
σ0.117-0.180=-0.063
min2.615-2.348=0.267
max3.118-3.184=-0.066

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.611-273.606=0.005
σ0.007-0.009=-0.001
min273.599-273.592=0.007
max273.617-273.614=0.003
mean2870.000-2805.000=65.000
σ0.000
min2870.000-2805.000=65.000
max2870.000-2805.000=65.000
mean0.388-0.386=0.002
σ0.006-0.008=-0.001
min0.382-0.380=0.002
max0.398-0.399=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1934.003-1933.999=0.004
σ0.010-0.006=0.004
min1933.986-1933.989=-0.003
max1934.009-1934.004=0.006
mean2870.000-2805.000=65.000
σ0.000
min2870.000-2805.000=65.000
max2870.000-2805.000=65.000
mean2.915-3.103=-0.189
σ0.159-0.157=0.002
min2.644-2.985=-0.341
max3.063-3.352=-0.289
iters=5
new-facts=6402
prior-facts=1
mean4754.802-4754.774=0.028
σ0.865-0.836=0.028
min4754.221-4754.283=-0.062
max4756.323-4756.264=0.060
mean2870.000-2805.000=65.000
σ0.000
min2870.000-2805.000=65.000
max2870.000-2805.000=65.000
mean8.461-8.391=0.070
σ0.668-0.455=0.212
min7.733-7.623=0.110
max9.395-8.846=0.550
iters=5
new-facts=6402
prior-facts=6402
mean4765.059-4945.218=-180.159
σ402.666-0.024=402.642
min4044.748-4945.192=-900.444
max4945.247-4945.253=-0.005
mean3000.200-3033.200=-33.000
σ202.734-230.749=-28.015
min2870.000-2805.000=65.000
max3332.000-3351.000=-19.000
mean8.322-8.532=-0.210
σ0.582-0.159=0.423
min7.325-8.358=-1.033
max8.855-8.791=0.064

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.020-1.021=-0.001
σ0.135-0.139=-0.004
min0.932-0.931=0.000
max1.241-1.256=-0.014

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.846-472.842=0.004
σ574.927-574.934=-0.008
min185.375-185.368=0.007
max1335.237-1335.244=-0.007
mean88.250
σ8.500
min84.000
max101.000
mean2870.000-2805.000=65.000
σ0.000
min2870.000-2805.000=65.000
max2870.000-2805.000=65.000
mean0.488-0.489=-0.001
σ0.375-0.397=-0.021
min0.299-0.286=0.012
max1.051-1.084=-0.033
policies=20
mean1854.024-1853.977=0.048
σ0.366-0.355=0.011
min1853.752-1853.764=-0.011
max1854.557-1854.504=0.053
mean840.000
σ0.000
min840.000
max840.000
mean2870.000-2805.000=65.000
σ0.000
min2870.000-2805.000=65.000
max2870.000-2805.000=65.000
mean2.948-2.868=0.081
σ0.007-0.010=-0.003
min2.941-2.854=0.087
max2.957-2.875=0.082
policies=200
mean18546.750-18546.535=0.215
σ0.472-0.572=-0.100
min18546.442-18546.179=0.263
max18547.450-18547.390=0.060
mean8400.000
σ0.000
min8400.000
max8400.000
mean2870.000-2805.000=65.000
σ0.000
min2870.000-2805.000=65.000
max2870.000-2805.000=65.000
mean29.147-28.773=0.373
σ0.432-0.031=0.401
min28.793-28.742=0.051
max29.751-28.808=0.943