Compare commits

Home / Compare 51226b31 .. c3c55572

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.979=0.000
σ0.047-0.049=-0.003
min33.955-33.947=0.008
max34.110-34.117=-0.007
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.084-0.085=-0.001
σ0.004-0.003=0.001
min0.080-0.082=-0.003
max0.091-0.090=0.000
cache=y
dps=1
iters=10
policies=100
mean23.318-23.318=0.000
σ0.003-0.004=-0.001
min23.313-23.311=0.002
max23.322-23.326=-0.003
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.066-0.065=0.001
σ0.003-0.002=0.000
min0.064-0.063=0.001
max0.074-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.302-1757.302=0.000
σ0.364-0.366=-0.002
min1756.728-1756.727=0.001
max1757.889-1757.894=-0.005
mean1666.050-1652.850=13.200
σ628.073-623.883=4.190
min671.000-680.000=-9.000
max2615.000-2592.000=23.000
mean2.368-2.365=0.003
σ0.116-0.134=-0.018
min2.258-2.240=0.017
max2.733-2.669=0.064

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.441-326.448=-0.007
σ0.061-0.043=0.018
min326.334-326.374=-0.040
max326.481-326.480=0.001
mean2615.000-2592.000=23.000
σ0.000
min2615.000-2592.000=23.000
max2615.000-2592.000=23.000
mean0.433-0.421=0.012
σ0.006-0.001=0.005
min0.425-0.420=0.005
max0.440-0.423=0.017
iters=5
new-facts=1
prior-facts=6402
mean1988.614-1988.611=0.003
σ0.005-0.010=-0.005
min1988.605-1988.594=0.011
max1988.618-1988.621=-0.002
mean2615.000-2592.000=23.000
σ0.000
min2615.000-2592.000=23.000
max2615.000-2592.000=23.000
mean2.715-2.684=0.032
σ0.106-0.085=0.022
min2.615-2.596=0.019
max2.880-2.815=0.065
iters=5
new-facts=6402
prior-facts=1
mean4813.344-4813.448=-0.105
σ7.797-7.716=0.081
min4809.427-4809.989=-0.562
max4827.284-4827.251=0.033
mean2615.000-2592.000=23.000
σ0.000
min2615.000-2592.000=23.000
max2615.000-2592.000=23.000
mean8.893-8.987=-0.094
σ0.328-0.169=0.159
min8.410-8.746=-0.337
max9.193-9.152=0.040
iters=5
new-facts=6402
prior-facts=6402
mean5001.004-5001.019=-0.015
σ0.022-0.037=-0.015
min5000.979-5000.984=-0.005
max5001.031-5001.078=-0.046
mean3015.600-3016.800=-1.200
σ313.230-261.460=51.771
min2615.000-2626.000=-11.000
max3417.000-3323.000=94.000
mean9.189-9.783=-0.593
σ0.601-0.387=0.214
min8.502-9.254=-0.752
max9.737-10.342=-0.606

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.295-1.279=0.016
σ0.295-0.320=-0.025
min0.947-0.917=0.030
max1.635-1.653=-0.018

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.429-464.437=-0.009
σ574.775-574.785=-0.010
min177.038-177.039=-0.000
max1326.591-1326.615=-0.023
mean88.250
σ8.500
min84.000
max101.000
mean2615.000-2592.000=23.000
σ0.000
min2615.000-2592.000=23.000
max2615.000-2592.000=23.000
mean0.554-0.552=0.002
σ0.560-0.558=0.002
min0.269-0.272=-0.002
max1.394-1.389=0.005
policies=20
mean1770.740-1770.761=-0.021
σ0.363-0.362=0.001
min1770.496-1770.509=-0.013
max1771.279-1771.297=-0.017
mean840.000
σ0.000
min840.000
max840.000
mean2615.000-2592.000=23.000
σ0.000
min2615.000-2592.000=23.000
max2615.000-2592.000=23.000
mean2.741-2.725=0.017
σ0.011-0.017=-0.006
min2.728-2.706=0.023
max2.752-2.747=0.005
policies=200
mean17714.876-17714.820=0.056
σ0.558-0.532=0.027
min17714.429-17714.350=0.079
max17715.691-17715.581=0.110
mean8400.000
σ0.000
min8400.000
max8400.000
mean2615.000-2592.000=23.000
σ0.000
min2615.000-2592.000=23.000
max2615.000-2592.000=23.000
mean27.522-27.408=0.115
σ0.116-0.079=0.037
min27.378-27.338=0.040
max27.636-27.479=0.157