Compare commits

Home / Compare 3c5b88fd .. 00b851f5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-70.391=-0.001
σ0.047-0.048=-0.001
min70.360-70.363=-0.003
max70.520-70.524=-0.004
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.158-0.160=-0.002
σ0.005-0.003=0.002
min0.151-0.158=-0.006
max0.166-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.145-21.145=-0.000
σ0.002-0.002=-0.000
min21.143-21.141=0.002
max21.149-21.149=0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.066-0.065=0.001
σ0.002-0.003=-0.000
min0.063-0.063=0.000
max0.072-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.392=0.002
σ0.362-0.362=0.000
min1751.825-1751.830=-0.005
max1752.996-1752.975=0.021
mean1658.600-1654.550=4.050
σ628.891-616.337=12.554
min619.000-636.000=-17.000
max2773.000-2491.000=282.000
mean2.779-2.836=-0.058
σ0.157-0.140=0.017
min2.373-2.428=-0.055
max2.983-3.141=-0.158

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.231-270.145=0.085
σ0.008-0.007=0.000
min270.220-270.134=0.086
max270.241-270.153=0.088
mean2773.000-2491.000=282.000
σ0.000
min2773.000-2491.000=282.000
max2773.000-2491.000=282.000
mean0.377-0.382=-0.005
σ0.006-0.007=-0.001
min0.370-0.376=-0.007
max0.383-0.393=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1930.700-1930.596=0.104
σ0.017-0.019=-0.002
min1930.673-1930.569=0.104
max1930.717-1930.614=0.102
mean2773.000-2491.000=282.000
σ0.000
min2773.000-2491.000=282.000
max2773.000-2491.000=282.000
mean2.534-2.674=-0.139
σ0.097-0.238=-0.141
min2.417-2.480=-0.063
max2.678-3.080=-0.402
iters=5
new-facts=6402
prior-facts=1
mean4751.442-4751.351=0.090
σ0.885-0.859=0.026
min4750.861-4750.844=0.017
max4753.001-4752.876=0.125
mean2773.000-2491.000=282.000
σ0.000
min2773.000-2491.000=282.000
max2773.000-2491.000=282.000
mean8.258-8.183=0.076
σ0.669-0.518=0.152
min7.608-7.754=-0.146
max9.146-8.844=0.301
iters=5
new-facts=6402
prior-facts=6402
mean4941.718-4941.770=-0.052
σ0.202-0.024=0.178
min4941.465-4941.740=-0.275
max4941.884-4941.792=0.092
mean3052.000-2949.200=102.800
σ342.809-422.145=-79.336
min2773.000-2491.000=282.000
max3563.000-3519.000=44.000
mean8.417-8.480=-0.063
σ0.126-0.126=-0.001
min8.338-8.324=0.014
max8.628-8.665=-0.036

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.045-1.716=-0.671
σ0.133-0.170=-0.036
min0.926-1.443=-0.517
max1.252-1.900=-0.648

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.378-466.361=0.017
σ575.929-575.921=0.008
min178.408-178.398=0.010
max1330.271-1330.242=0.029
mean84.250-84.000=0.250
σ8.500-8.000=0.500
min80.000
max97.000-96.000=1.000
mean2773.000-2491.000=282.000
σ0.000
min2773.000-2491.000=282.000
max2773.000-2491.000=282.000
mean0.442-0.564=-0.123
σ0.303-0.566=-0.262
min0.285-0.277=0.009
max0.897-1.413=-0.516
policies=20
mean1784.367-1784.294=0.074
σ0.359-0.354=0.005
min1784.132-1784.071=0.061
max1784.897-1784.821=0.076
mean800.000
σ0.000
min800.000
max800.000
mean2773.000-2491.000=282.000
σ0.000
min2773.000-2491.000=282.000
max2773.000-2491.000=282.000
mean2.830-2.782=0.048
σ0.120-0.018=0.102
min2.767-2.756=0.010
max3.010-2.798=0.212
policies=200
mean17849.755-17849.882=-0.127
σ0.485-0.469=0.016
min17849.441-17849.611=-0.169
max17850.470-17850.583=-0.113
mean8000.000
σ0.000
min8000.000
max8000.000
mean2773.000-2491.000=282.000
σ0.000
min2773.000-2491.000=282.000
max2773.000-2491.000=282.000
mean27.931-28.217=-0.286
σ0.098-0.192=-0.095
min27.817-28.043=-0.226
max28.023-28.482=-0.459