Compare commits

Home / Compare 73aea738 .. c02c9ccb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.770-30.769=0.000
σ0.045-0.048=-0.003
min30.726-30.729=-0.003
max30.893-30.902=-0.009
mean416.000
σ0.000
min416.000
max416.000
mean0.078-0.081=-0.003
σ0.003-0.003=-0.000
min0.075-0.078=-0.002
max0.084-0.085=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.061-21.062=-0.000
σ0.003-0.002=0.000
min21.057-21.060=-0.003
max21.065-21.066=-0.001
mean416.000
σ0.000
min416.000
max416.000
mean0.063-0.065=-0.002
σ0.003-0.003=0.001
min0.061-0.063=-0.002
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.420-1751.421=-0.001
σ0.362-0.363=-0.002
min1750.847-1750.853=-0.006
max1752.019-1752.004=0.015
mean1652.250-1647.150=5.100
σ625.168-617.736=7.431
min681.000-684.000=-3.000
max2649.000-2637.000=12.000
mean2.868-2.752=0.116
σ0.165-0.261=-0.096
min2.330-2.280=0.050
max3.127-3.134=-0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.756-275.755=0.001
σ0.007-0.012=-0.005
min275.747-275.743=0.004
max275.766-275.770=-0.004
mean2649.000-2637.000=12.000
σ0.000
min2649.000-2637.000=12.000
max2649.000-2637.000=12.000
mean0.407-0.395=0.012
σ0.011-0.009=0.002
min0.394-0.387=0.007
max0.419-0.405=0.014
iters=5
new-facts=1
prior-facts=6402
mean2168.267-2168.287=-0.020
σ0.018-0.005=0.013
min2168.245-2168.280=-0.034
max2168.286-2168.293=-0.008
mean2649.000-2637.000=12.000
σ0.000
min2649.000-2637.000=12.000
max2649.000-2637.000=12.000
mean2.951-2.999=-0.048
σ0.163-0.117=0.047
min2.739-2.831=-0.093
max3.167-3.114=0.053
iters=5
new-facts=6402
prior-facts=1
mean5047.983-5047.963=0.020
σ0.657-1.004=-0.348
min5047.520-5047.156=0.365
max5049.134-5049.715=-0.581
mean2649.000-2637.000=12.000
σ0.000
min2649.000-2637.000=12.000
max2649.000-2637.000=12.000
mean9.012-8.826=0.186
σ0.509-0.436=0.074
min8.162-8.055=0.107
max9.479-9.091=0.387
iters=5
new-facts=6402
prior-facts=6402
mean5179.156-5179.159=-0.003
σ0.203-0.215=-0.011
min5178.812-5178.799=0.012
max5179.309-5179.334=-0.025
mean3262.000-3219.600=42.400
σ372.131-390.332=-18.201
min2745.000-2692.000=53.000
max3720.000-3727.000=-7.000
mean9.841-9.652=0.189
σ0.143-0.477=-0.334
min9.711-8.964=0.747
max10.072-10.141=-0.068

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.187-1.291=-0.103
σ0.317-0.418=-0.101
min0.940-0.947=-0.007
max1.695-1.988=-0.293

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.574-463.571=0.003
σ572.663-572.660=0.003
min177.238-177.237=0.000
max1322.569-1322.561=0.008
mean79.750
σ7.500
min76.000
max91.000
mean2649.000-2637.000=12.000
σ0.000
min2649.000-2637.000=12.000
max2649.000-2637.000=12.000
mean0.546-0.565=-0.019
σ0.536-0.574=-0.038
min0.275-0.277=-0.002
max1.350-1.426=-0.076
policies=20
mean1772.641-1772.650=-0.009
σ0.334-0.339=-0.005
min1772.418-1772.423=-0.005
max1773.136-1773.152=-0.016
mean760.000
σ0.000
min760.000
max760.000
mean2649.000-2637.000=12.000
σ0.000
min2649.000-2637.000=12.000
max2649.000-2637.000=12.000
mean2.746-2.768=-0.022
σ0.008-0.014=-0.007
min2.737-2.752=-0.015
max2.756-2.784=-0.028
policies=200
mean17733.052-17733.042=0.010
σ0.505-0.459=0.047
min17732.769-17732.797=-0.028
max17733.809-17733.730=0.079
mean7600.000
σ0.000
min7600.000
max7600.000
mean2649.000-2637.000=12.000
σ0.000
min2649.000-2637.000=12.000
max2649.000-2637.000=12.000
mean27.741-27.943=-0.203
σ0.163-0.152=0.012
min27.585-27.800=-0.215
max27.969-28.114=-0.144