Compare commits

Home / Compare fd2a3d20 .. 3aab30ce

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.391-70.391=-0.000
σ0.048-0.045=0.003
min70.360-70.365=-0.005
max70.523-70.515=0.009
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.162-0.161=0.001
σ0.003-0.004=-0.001
min0.159-0.156=0.003
max0.167-0.167=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.144-21.145=-0.001
σ0.002-0.002=0.000
min21.140-21.142=-0.002
max21.147-21.149=-0.001
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.063-0.064=-0.002
σ0.003-0.002=0.001
min0.059-0.063=-0.004
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.699-1752.699=-0.000
σ0.361-0.362=-0.001
min1752.130-1752.125=0.005
max1753.279-1753.282=-0.003
mean1644.350-1680.250=-35.900
σ634.490-631.871=2.619
min617.000-667.000=-50.000
max2815.000-2691.000=124.000
mean2.827-2.838=-0.010
σ0.156-0.067=0.090
min2.377-2.722=-0.344
max3.083-2.975=0.108

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.513-270.514=-0.001
σ0.007-0.005=0.002
min270.504-270.507=-0.002
max270.521-270.520=0.000
mean2815.000-2691.000=124.000
σ0.000
min2815.000-2691.000=124.000
max2815.000-2691.000=124.000
mean0.381-0.383=-0.002
σ0.005-0.008=-0.002
min0.378-0.378=0.001
max0.391-0.397=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1930.949-1930.940=0.010
σ0.012-0.005=0.007
min1930.940-1930.933=0.007
max1930.970-1930.946=0.025
mean2815.000-2691.000=124.000
σ0.000
min2815.000-2691.000=124.000
max2815.000-2691.000=124.000
mean2.900-3.047=-0.147
σ0.247-0.084=0.163
min2.466-2.968=-0.501
max3.092-3.176=-0.084
iters=5
new-facts=6402
prior-facts=1
mean4751.553-4751.419=0.134
σ0.975-0.428=0.547
min4750.721-4751.161=-0.441
max4753.246-4752.181=1.065
mean2815.000-2691.000=124.000
σ0.000
min2815.000-2691.000=124.000
max2815.000-2691.000=124.000
mean8.618-8.728=-0.110
σ0.124-0.253=-0.129
min8.451-8.405=0.046
max8.781-9.027=-0.246
iters=5
new-facts=6402
prior-facts=6402
mean4942.145-4942.146=-0.001
σ0.012-0.010=0.002
min4942.129-4942.133=-0.004
max4942.158-4942.159=-0.001
mean3053.200-3005.200=48.000
σ221.650-254.354=-32.705
min2815.000-2691.000=124.000
max3368.000-3330.000=38.000
mean8.506-8.630=-0.124
σ0.237-0.339=-0.102
min8.304-8.353=-0.049
max8.824-9.205=-0.381

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.040-1.064=-0.024
σ0.125-0.138=-0.013
min0.927-0.926=0.001
max1.233-1.226=0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.825-466.829=-0.004
σ575.926-575.937=-0.011
min178.854-178.853=0.001
max1330.715-1330.735=-0.020
mean84.000
σ8.000
min80.000
max96.000
mean2815.000-2691.000=124.000
σ0.000
min2815.000-2691.000=124.000
max2815.000-2691.000=124.000
mean0.437-0.559=-0.122
σ0.295-0.553=-0.258
min0.283-0.282=0.001
max0.880-1.388=-0.509
policies=20
mean1788.827-1788.812=0.015
σ0.355-0.351=0.004
min1788.578-1788.590=-0.012
max1789.349-1789.336=0.014
mean800.000
σ0.000
min800.000
max800.000
mean2815.000-2691.000=124.000
σ0.000
min2815.000-2691.000=124.000
max2815.000-2691.000=124.000
mean2.857-2.774=0.082
σ0.064-0.009=0.055
min2.785-2.767=0.017
max2.941-2.787=0.153
policies=200
mean17894.693-17894.817=-0.124
σ0.516-0.453=0.063
min17894.342-17894.572=-0.230
max17895.451-17895.496=-0.044
mean8000.000
σ0.000
min8000.000
max8000.000
mean2815.000-2691.000=124.000
σ0.000
min2815.000-2691.000=124.000
max2815.000-2691.000=124.000
mean27.976-27.938=0.038
σ0.125-0.110=0.015
min27.876-27.847=0.030
max28.155-28.092=0.063