Compare commits

Home / Compare 13cf5bed .. 21640a27

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-70.391=-0.001
σ0.046-0.047=-0.001
min70.362-70.365=-0.003
max70.519-70.522=-0.003
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.159-0.160=-0.002
σ0.003-0.004=-0.001
min0.156-0.156=-0.000
max0.164-0.166=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.144-21.145=-0.001
σ0.003-0.002=0.001
min21.140-21.142=-0.002
max21.148-21.150=-0.001
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.064-0.064=-0.001
σ0.003-0.002=0.001
min0.059-0.063=-0.004
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.393=0.001
σ0.362-0.362=-0.000
min1751.821-1751.825=-0.003
max1752.990-1752.983=0.007
mean1640.650-1632.000=8.650
σ614.594-589.908=24.686
min627.000-625.000=2.000
max2474.000-2413.000=61.000
mean2.829-2.755=0.074
σ0.184-0.206=-0.021
min2.173-2.182=-0.009
max3.100-2.966=0.134

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.148-270.146=0.002
σ0.008-0.004=0.004
min270.136-270.141=-0.005
max270.157-270.151=0.006
mean2474.000-2413.000=61.000
σ0.000
min2474.000-2413.000=61.000
max2474.000-2413.000=61.000
mean0.395-0.381=0.014
σ0.008-0.005=0.003
min0.380-0.378=0.002
max0.400-0.390=0.010
iters=5
new-facts=1
prior-facts=6402
mean1930.610-1790.367=140.243
σ0.005-313.614=-313.608
min1930.601-1229.358=701.244
max1930.616-1930.658=-0.042
mean2474.000-2413.000=61.000
σ0.000
min2474.000-2413.000=61.000
max2474.000-2413.000=61.000
mean2.553-2.444=0.109
σ0.095-0.433=-0.339
min2.449-1.670=0.779
max2.665-2.671=-0.007
iters=5
new-facts=6402
prior-facts=1
mean4751.099-4751.383=-0.284
σ1.064-0.823=0.241
min4750.274-4750.902=-0.627
max4752.943-4752.850=0.093
mean2474.000-2413.000=61.000
σ0.000
min2474.000-2413.000=61.000
max2474.000-2413.000=61.000
mean8.418-7.952=0.466
σ0.600-0.403=0.196
min7.570-7.626=-0.056
max9.055-8.636=0.419
iters=5
new-facts=6402
prior-facts=6402
mean4941.774-4941.775=-0.000
σ0.011-0.022=-0.010
min4941.759-4941.746=0.013
max4941.788-4941.796=-0.008
mean3012.200-2893.800=118.400
σ326.452-381.928=-55.475
min2583.000-2413.000=170.000
max3428.000-3408.000=20.000
mean8.541-8.514=0.027
σ0.108-0.188=-0.080
min8.426-8.358=0.068
max8.662-8.773=-0.112

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.810-1.856=-0.047
σ0.146-0.095=0.051
min1.558-1.791=-0.233
max1.920-2.022=-0.102

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.368-466.365=0.003
σ575.924-575.924=-0.000
min178.402-178.402=0.001
max1330.254-1330.251=0.003
mean84.000
σ8.000
min80.000
max96.000
mean2474.000-2413.000=61.000
σ0.000
min2474.000-2413.000=61.000
max2474.000-2413.000=61.000
mean0.543-0.543=0.000
σ0.530-0.520=0.011
min0.276-0.281=-0.006
max1.339-1.322=0.017
policies=20
mean1784.320-1784.314=0.006
σ0.356-0.356=-0.000
min1784.098-1784.080=0.018
max1784.850-1784.843=0.007
mean800.000
σ0.000
min800.000
max800.000
mean2474.000-2413.000=61.000
σ0.000
min2474.000-2413.000=61.000
max2474.000-2413.000=61.000
mean2.767-2.777=-0.011
σ0.023-0.009=0.014
min2.743-2.766=-0.023
max2.794-2.786=0.008
policies=200
mean17849.893-17849.776=0.117
σ0.456-0.418=0.039
min17849.576-17849.501=0.075
max17850.569-17850.385=0.183
mean8000.000
σ0.000
min8000.000
max8000.000
mean2474.000-2413.000=61.000
σ0.000
min2474.000-2413.000=61.000
max2474.000-2413.000=61.000
mean28.026-27.944=0.082
σ0.021-0.017=0.004
min28.002-27.928=0.074
max28.047-27.965=0.081