Compare commits

Home / Compare 1a9dcd12 .. 4c0cac2c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.958-30.957=0.001
σ0.049-0.049=0.000
min30.912-30.920=-0.007
max31.092-31.094=-0.002
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.076-0.074=0.002
σ0.004-0.005=-0.001
min0.070-0.069=0.001
max0.082-0.081=0.001
cache=y
dps=1
iters=10
policies=100
mean21.061-21.060=0.000
σ0.003-0.002=0.001
min21.056-21.058=-0.002
max21.064-21.064=-0.000
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.063-0.064=-0.001
σ0.002-0.003=-0.000
min0.061-0.062=-0.001
max0.069-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1751.412=0.000
σ0.364-0.363=0.001
min1750.839-1750.841=-0.002
max1751.991-1751.993=-0.002
mean1636.650-1641.450=-4.800
σ614.115-619.012=-4.896
min653.000-652.000=1.000
max2466.000-2478.000=-12.000
mean2.739-2.768=-0.029
σ0.210-0.196=0.014
min2.321-2.261=0.060
max3.189-3.039=0.150

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.401-273.404=-0.003
σ0.011-0.012=-0.001
min273.392-273.392=0.001
max273.418-273.420=-0.002
mean2466.000-2478.000=-12.000
σ0.000
min2466.000-2478.000=-12.000
max2466.000-2478.000=-12.000
mean0.389-0.386=0.002
σ0.017-0.010=0.007
min0.375-0.376=-0.000
max0.415-0.399=0.017
iters=5
new-facts=1
prior-facts=6402
mean1933.841-1933.836=0.005
σ0.006-0.007=-0.001
min1933.834-1933.825=0.009
max1933.850-1933.844=0.007
mean2466.000-2478.000=-12.000
σ0.000
min2466.000-2478.000=-12.000
max2466.000-2478.000=-12.000
mean3.085-3.053=0.032
σ0.099-0.090=0.009
min3.000-2.975=0.025
max3.219-3.177=0.042
iters=5
new-facts=6402
prior-facts=1
mean4754.340-4754.403=-0.062
σ0.900-0.851=0.050
min4753.741-4753.922=-0.181
max4755.937-4755.915=0.022
mean2466.000-2478.000=-12.000
σ0.000
min2466.000-2478.000=-12.000
max2466.000-2478.000=-12.000
mean8.590-8.102=0.487
σ0.630-0.574=0.055
min7.661-7.632=0.029
max9.157-9.089=0.068
iters=5
new-facts=6402
prior-facts=6402
mean4944.798-4944.729=0.068
σ0.075-0.123=-0.048
min4944.741-4944.543=0.197
max4944.881-4944.890=-0.009
mean3034.200-2913.800=120.400
σ358.411-394.657=-36.246
min2558.000-2478.000=80.000
max3368.000-3452.000=-84.000
mean8.752-8.399=0.354
σ0.224-0.039=0.184
min8.509-8.359=0.150
max9.077-8.448=0.629

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.835-1.791=0.045
σ0.097-0.112=-0.015
min1.766-1.602=0.164
max2.003-1.882=0.121

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.333-463.334=-0.000
σ572.193-572.193=0.001
min177.234-177.234=-0.000
max1321.624-1321.623=0.001
mean79.750
σ7.500
min76.000
max91.000
mean2466.000-2478.000=-12.000
σ0.000
min2466.000-2478.000=-12.000
max2466.000-2478.000=-12.000
mean0.553-0.556=-0.003
σ0.535-0.547=-0.012
min0.275-0.276=-0.001
max1.355-1.376=-0.020
policies=20
mean1772.586-1772.587=-0.001
σ0.327-0.332=-0.005
min1772.368-1772.368=0.001
max1773.071-1773.081=-0.010
mean760.000
σ0.000
min760.000
max760.000
mean2466.000-2478.000=-12.000
σ0.000
min2466.000-2478.000=-12.000
max2466.000-2478.000=-12.000
mean2.749-2.747=0.002
σ0.009-0.024=-0.015
min2.739-2.721=0.018
max2.761-2.769=-0.008
policies=200
mean17732.517-17732.335=0.181
σ0.500-0.548=-0.049
min17732.240-17731.930=0.311
max17733.266-17733.144=0.122
mean7600.000
σ0.000
min7600.000
max7600.000
mean2466.000-2478.000=-12.000
σ0.000
min2466.000-2478.000=-12.000
max2466.000-2478.000=-12.000
mean27.655-27.604=0.051
σ0.142-0.115=0.027
min27.548-27.503=0.045
max27.862-27.760=0.103