Compare commits

Home / Compare 22d69908 .. caa9cf4e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.709-53.708=0.000
σ0.364-0.365=-0.002
min53.577-53.576=0.001
max54.743-54.747=-0.004
mean414.000-416.600=-2.600
σ0.000-0.516=-0.516
min414.000-416.000=-2.000
max414.000-417.000=-3.000
mean0.138-0.135=0.003
σ0.003-0.004=-0.001
min0.135-0.128=0.007
max0.144-0.142=0.001
cache=y
dps=1
iters=10
policies=100
mean42.978-42.977=0.001
σ0.004-0.004=0.000
min42.971-42.971=0.000
max42.987-42.983=0.004
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.121-0.118=0.003
σ0.003-0.004=-0.001
min0.118-0.113=0.005
max0.127-0.123=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean995.211-995.219=-0.008
σ1.226-1.195=0.031
min994.624-994.687=-0.062
max1000.354-1000.229=0.125
mean1056.200-1059.800=-3.600
σ307.831-311.602=-3.771
min619.000-596.000=23.000
max1509.000-1516.000=-7.000
mean1.510-1.495=0.015
σ0.102-0.131=-0.029
min1.392-1.389=0.003
max1.786-2.005=-0.219

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.322-297.322=-0.000
σ0.004-0.007=-0.002
min297.317-297.312=0.005
max297.328-297.329=-0.001
mean1509.000-1516.000=-7.000
σ0.000
min1509.000-1516.000=-7.000
max1509.000-1516.000=-7.000
mean0.389-0.389=0.000
σ0.002-0.002=0.000
min0.387-0.387=0.000
max0.392-0.391=0.001
iters=5
new-facts=1
prior-facts=6402
mean1299.030-1299.014=0.016
σ0.055-0.096=-0.041
min1298.940-1298.842=0.098
max1299.074-1299.066=0.008
mean1509.000-1516.000=-7.000
σ0.000
min1509.000-1516.000=-7.000
max1509.000-1516.000=-7.000
mean1.876-2.078=-0.202
σ0.029-0.257=-0.228
min1.846-1.853=-0.006
max1.911-2.494=-0.583
iters=5
new-facts=6402
prior-facts=1
mean1719.183-1719.178=0.005
σ6.937-6.923=0.014
min1715.942-1715.939=0.003
max1731.587-1731.558=0.030
mean1509.000-1516.000=-7.000
σ0.000
min1509.000-1516.000=-7.000
max1509.000-1516.000=-7.000
mean3.004-3.118=-0.114
σ0.458-0.351=0.107
min2.494-2.753=-0.259
max3.729-3.657=0.072
iters=5
new-facts=6402
prior-facts=6402
mean1981.922-1981.929=-0.007
σ0.040-0.041=-0.001
min1981.853-1981.858=-0.005
max1981.953-1981.955=-0.002
mean1784.800-1799.800=-15.000
σ201.920-229.172=-27.252
min1537.000
max2056.000-2117.000=-61.000
mean3.326-3.291=0.035
σ0.380-0.398=-0.018
min3.088-3.014=0.074
max3.999-3.992=0.007

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.595-1.560=0.035
σ0.294-0.273=0.021
min1.241-1.225=0.016
max1.833-1.825=0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.448-440.451=-0.003
σ573.026-573.026=0.001
min153.929-153.931=-0.002
max1299.988-1299.990=-0.002
mean94.250
σ8.500
min90.000
max107.000
mean1509.000-1516.000=-7.000
σ0.000
min1509.000-1516.000=-7.000
max1509.000-1516.000=-7.000
mean0.538-0.542=-0.004
σ0.563-0.568=-0.005
min0.255-0.257=-0.002
max1.382-1.393=-0.011
policies=20
mean1539.583-1539.586=-0.003
σ0.296-0.308=-0.012
min1539.383-1539.385=-0.002
max1540.022-1540.044=-0.022
mean900.000
σ0.000
min900.000
max900.000
mean1509.000-1516.000=-7.000
σ0.000
min1509.000-1516.000=-7.000
max1509.000-1516.000=-7.000
mean2.555-2.563=-0.007
σ0.011-0.020=-0.009
min2.541-2.533=0.008
max2.565-2.576=-0.011
policies=200
mean15404.073-15404.052=0.021
σ0.091-0.106=-0.015
min15403.955-15403.931=0.024
max15404.160-15404.153=0.007
mean9000.000
σ0.000
min9000.000
max9000.000
mean1509.000-1516.000=-7.000
σ0.000
min1509.000-1516.000=-7.000
max1509.000-1516.000=-7.000
mean26.018-25.956=0.061
σ0.122-0.171=-0.048
min25.910-25.748=0.163
max26.162-26.108=0.055