Compare commits

Home / Compare 1fda4eec .. dd61dc21

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.980=-0.003
σ0.048-0.049=-0.001
min33.951-33.952=-0.001
max34.112-34.116=-0.004
mean418.000-418.800=-0.800
σ0.000-0.632=-0.632
min418.000-417.000=1.000
max418.000-419.000=-1.000
mean0.082-0.084=-0.002
σ0.003-0.003=0.000
min0.077-0.081=-0.004
max0.090-0.091=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.001
σ0.003-0.003=0.000
min23.312-23.311=0.002
max23.322-23.321=0.001
mean418.000-419.000=-1.000
σ0.000
min418.000-419.000=-1.000
max418.000-419.000=-1.000
mean0.066-0.065=0.001
σ0.003-0.002=0.000
min0.064-0.064=0.000
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.495-1757.428=0.066
σ0.364-0.367=-0.003
min1756.920-1756.852=0.068
max1758.080-1758.019=0.061
mean1652.400-1650.750=1.650
σ626.051-625.714=0.336
min639.000
max2825.000-2840.000=-15.000
mean2.366-2.369=-0.002
σ0.091-0.073=0.018
min2.244-2.287=-0.043
max2.625-2.544=0.081

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.637-326.569=0.068
σ0.060-0.065=-0.005
min326.530-326.454=0.077
max326.677-326.614=0.063
mean2825.000-2840.000=-15.000
σ0.000
min2825.000-2840.000=-15.000
max2825.000-2840.000=-15.000
mean0.431-0.429=0.002
σ0.007-0.011=-0.004
min0.424-0.421=0.003
max0.440-0.447=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1988.802-1988.736=0.067
σ0.013-0.009=0.005
min1988.788-1988.726=0.062
max1988.816-1988.747=0.069
mean2825.000-2840.000=-15.000
σ0.000
min2825.000-2840.000=-15.000
max2825.000-2840.000=-15.000
mean2.663-2.803=-0.140
σ0.102-0.190=-0.089
min2.545-2.636=-0.091
max2.819-3.039=-0.220
iters=5
new-facts=6402
prior-facts=1
mean4813.690-4813.549=0.140
σ7.744-7.454=0.291
min4810.098-4810.033=0.065
max4827.542-4826.878=0.664
mean2825.000-2840.000=-15.000
σ0.000
min2825.000-2840.000=-15.000
max2825.000-2840.000=-15.000
mean8.755-8.431=0.324
σ0.655-0.881=-0.227
min7.763-7.746=0.016
max9.401-9.579=-0.178
iters=5
new-facts=6402
prior-facts=6402
mean5001.207-5001.059=0.147
σ0.026-0.152=-0.126
min5001.185-5000.788=0.397
max5001.250-5001.151=0.099
mean3045.200-3066.200=-21.000
σ234.751-307.189=-72.438
min2825.000-2840.000=-15.000
max3390.000-3544.000=-154.000
mean9.821-9.496=0.326
σ0.154-0.568=-0.413
min9.687-8.498=1.190
max10.079-9.856=0.223

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.964-0.947=0.016
σ0.066-0.057=0.009
min0.906-0.909=-0.003
max1.042-1.048=-0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.637-464.567=0.070
σ574.770-574.774=-0.004
min177.242-177.172=0.069
max1326.793-1326.729=0.064
mean88.250
σ8.500
min84.000
max101.000
mean2825.000-2840.000=-15.000
σ0.000
min2825.000-2840.000=-15.000
max2825.000-2840.000=-15.000
mean0.434-0.434=-0.001
σ0.301-0.309=-0.008
min0.281-0.276=0.005
max0.884-0.898=-0.013
policies=20
mean1772.718-1772.055=0.663
σ0.357-0.365=-0.008
min1772.469-1771.803=0.665
max1773.246-1772.595=0.651
mean840.000
σ0.000
min840.000
max840.000
mean2825.000-2840.000=-15.000
σ0.000
min2825.000-2840.000=-15.000
max2825.000-2840.000=-15.000
mean2.807-2.788=0.018
σ0.006-0.004=0.002
min2.802-2.784=0.017
max2.815-2.795=0.021
policies=200
mean17734.133-17727.665=6.468
σ0.443-0.465=-0.022
min17733.798-17727.366=6.432
max17734.785-17728.356=6.430
mean8400.000
σ0.000
min8400.000
max8400.000
mean2825.000-2840.000=-15.000
σ0.000
min2825.000-2840.000=-15.000
max2825.000-2840.000=-15.000
mean28.146-27.882=0.265
σ0.387-0.403=-0.015
min27.807-27.496=0.310
max28.589-28.324=0.265