Compare commits

Home / Compare 186d3ebd .. 12952c82

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.978=0.002
σ0.050-0.048=0.001
min33.951-33.949=0.002
max34.117-34.112=0.005
mean414.000
σ0.000
min414.000
max414.000
mean0.084-0.083=0.001
σ0.003-0.003=-0.000
min0.082-0.077=0.006
max0.090-0.089=0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.316=0.001
σ0.003-0.002=0.001
min23.312-23.311=0.000
max23.322-23.320=0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.064-0.062=0.002
σ0.003-0.003=-0.000
min0.060-0.059=0.001
max0.070-0.070=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.494-1757.494=0.000
σ0.364-0.365=-0.001
min1756.921-1756.920=0.001
max1758.081-1758.086=-0.005
mean1650.350-1668.650=-18.300
σ625.022-641.898=-16.876
min674.000-676.000=-2.000
max2592.000-2641.000=-49.000
mean2.377-2.364=0.014
σ0.109-0.117=-0.008
min2.264-2.217=0.047
max2.660-2.648=0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.628-326.640=-0.012
σ0.062-0.041=0.021
min326.518-326.568=-0.049
max326.671-326.672=-0.001
mean2592.000-2641.000=-49.000
σ0.000
min2592.000-2641.000=-49.000
max2592.000-2641.000=-49.000
mean0.427-0.426=0.000
σ0.004-0.005=-0.001
min0.423-0.424=-0.000
max0.434-0.435=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1988.800-1988.807=-0.007
σ0.006-0.008=-0.001
min1988.791-1988.797=-0.006
max1988.806-1988.818=-0.011
mean2592.000-2641.000=-49.000
σ0.000
min2592.000-2641.000=-49.000
max2592.000-2641.000=-49.000
mean2.706-2.683=0.023
σ0.086-0.049=0.036
min2.605-2.639=-0.034
max2.798-2.762=0.036
iters=5
new-facts=6402
prior-facts=1
mean4813.312-4813.662=-0.349
σ7.965-7.720=0.245
min4809.025-4810.105=-1.080
max4827.536-4827.471=0.065
mean2592.000-2641.000=-49.000
σ0.000
min2592.000-2641.000=-49.000
max2592.000-2641.000=-49.000
mean8.915-8.439=0.476
σ0.428-0.487=-0.060
min8.477-7.854=0.622
max9.580-9.131=0.449
iters=5
new-facts=6402
prior-facts=6402
mean5001.200-5001.213=-0.013
σ0.021-0.052=-0.030
min5001.175-5001.173=0.002
max5001.222-5001.278=-0.056
mean2968.200-2995.600=-27.400
σ282.466-395.447=-112.981
min2592.000-2641.000=-49.000
max3310.000-3560.000=-250.000
mean9.690-9.612=0.078
σ0.126-0.757=-0.631
min9.519-8.414=1.105
max9.843-10.301=-0.458

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.202-1.193=0.009
σ0.386-0.404=-0.018
min0.915-0.905=0.010
max1.849-1.893=-0.044

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.628-464.635=-0.007
σ574.785-574.778=0.007
min177.232-177.238=-0.006
max1326.806-1326.802=0.003
mean88.250
σ8.500
min84.000
max101.000
mean2592.000-2641.000=-49.000
σ0.000
min2592.000-2641.000=-49.000
max2592.000-2641.000=-49.000
mean0.557-0.562=-0.005
σ0.569-0.577=-0.007
min0.269-0.270=-0.002
max1.411-1.427=-0.016
policies=20
mean1772.655-1772.680=-0.025
σ0.364-0.356=0.007
min1772.405-1772.451=-0.046
max1773.195-1773.211=-0.016
mean840.000
σ0.000
min840.000
max840.000
mean2592.000-2641.000=-49.000
σ0.000
min2592.000-2641.000=-49.000
max2592.000-2641.000=-49.000
mean2.744-2.728=0.016
σ0.007-0.027=-0.020
min2.737-2.695=0.041
max2.752-2.760=-0.008
policies=200
mean17733.961-17734.102=-0.140
σ0.425-0.524=-0.099
min17733.577-17733.760=-0.183
max17734.563-17734.882=-0.320
mean8400.000
σ0.000
min8400.000
max8400.000
mean2592.000-2641.000=-49.000
σ0.000
min2592.000-2641.000=-49.000
max2592.000-2641.000=-49.000
mean27.579-27.532=0.047
σ0.167-0.160=0.007
min27.384-27.341=0.044
max27.737-27.729=0.009