Compare commits

Home / Compare 0483d24f .. 4fdf4f20

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.389-70.390=-0.001
σ0.045-0.048=-0.003
min70.363-70.364=-0.000
max70.513-70.523=-0.010
mean415.400-414.000=1.400
σ0.699-0.000=0.699
min414.000
max416.000-414.000=2.000
mean0.159-0.157=0.003
σ0.003-0.004=-0.001
min0.156-0.151=0.006
max0.164-0.163=0.000
cache=y
dps=1
iters=10
policies=100
mean21.143-21.145=-0.001
σ0.002-0.002=-0.000
min21.141-21.142=-0.001
max21.147-21.148=-0.001
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.062-0.063=-0.000
σ0.004-0.005=-0.001
min0.058-0.058=-0.000
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.396-1752.393=0.003
σ0.360-0.363=-0.003
min1751.826-1751.833=-0.006
max1752.983-1752.976=0.007
mean1658.350-1644.800=13.550
σ631.146-605.864=25.282
min626.000-636.000=-10.000
max2774.000-2458.000=316.000
mean2.869-2.831=0.038
σ0.118-0.168=-0.050
min2.474-2.358=0.116
max3.055-3.074=-0.019

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.141-270.142=-0.001
σ0.014-0.007=0.006
min270.128-270.131=-0.004
max270.162-270.151=0.011
mean2774.000-2458.000=316.000
σ0.000
min2774.000-2458.000=316.000
max2774.000-2458.000=316.000
mean0.384-0.384=0.000
σ0.016-0.014=0.002
min0.372-0.368=0.004
max0.411-0.399=0.012
iters=5
new-facts=1
prior-facts=6402
mean1930.612-1930.597=0.015
σ0.006-0.027=-0.021
min1930.603-1930.564=0.039
max1930.617-1930.620=-0.003
mean2774.000-2458.000=316.000
σ0.000
min2774.000-2458.000=316.000
max2774.000-2458.000=316.000
mean2.577-2.541=0.036
σ0.086-0.130=-0.044
min2.491-2.430=0.060
max2.668-2.746=-0.077
iters=5
new-facts=6402
prior-facts=1
mean4751.204-4751.301=-0.097
σ0.972-0.927=0.045
min4750.360-4750.816=-0.456
max4752.878-4752.950=-0.072
mean2774.000-2458.000=316.000
σ0.000
min2774.000-2458.000=316.000
max2774.000-2458.000=316.000
mean8.465-8.550=-0.085
σ0.509-0.611=-0.101
min7.642-7.621=0.021
max9.031-9.032=-0.001
iters=5
new-facts=6402
prior-facts=6402
mean4941.773-4941.769=0.004
σ0.022-0.022=-0.000
min4941.745-4941.738=0.007
max4941.800-4941.791=0.009
mean3074.400-2965.800=108.600
σ292.852-263.636=29.216
min2774.000-2609.000=165.000
max3364.000-3312.000=52.000
mean8.647-8.479=0.167
σ0.193-0.069=0.124
min8.431-8.376=0.055
max8.926-8.563=0.363

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.031-1.752=-0.721
σ0.147-0.127=0.021
min0.936-1.636=-0.700
max1.279-1.961=-0.682

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.376-466.365=0.011
σ575.927-575.923=0.003
min178.405-178.399=0.007
max1330.266-1330.250=0.016
mean84.250
σ8.500
min80.000
max97.000
mean2774.000-2458.000=316.000
σ0.000
min2774.000-2458.000=316.000
max2774.000-2458.000=316.000
mean0.444-0.550=-0.106
σ0.305-0.545=-0.239
min0.285-0.276=0.009
max0.902-1.367=-0.465
policies=20
mean1784.320-1784.291=0.028
σ0.309-0.369=-0.059
min1784.098-1784.049=0.049
max1784.769-1784.839=-0.070
mean800.000
σ0.000
min800.000
max800.000
mean2774.000-2458.000=316.000
σ0.000
min2774.000-2458.000=316.000
max2774.000-2458.000=316.000
mean2.824-2.768=0.056
σ0.101-0.012=0.089
min2.757-2.751=0.006
max2.974-2.779=0.195
policies=200
mean17849.777-17849.807=-0.029
σ0.430-0.517=-0.087
min17849.477-17849.447=0.031
max17850.416-17850.544=-0.128
mean8000.000
σ0.000
min8000.000
max8000.000
mean2774.000-2458.000=316.000
σ0.000
min2774.000-2458.000=316.000
max2774.000-2458.000=316.000
mean28.055-27.927=0.128
σ0.170-0.038=0.131
min27.940-27.890=0.050
max28.300-27.980=0.320