Compare commits

Home / Compare 321997d1 .. 7b6092ac

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.380-70.379=0.001
σ0.045-0.046=-0.001
min70.351-70.348=0.003
max70.504-70.508=-0.004
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.160-0.160=-0.001
σ0.002-0.003=-0.000
min0.157-0.158=-0.001
max0.164-0.165=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.000
σ0.002-0.002=-0.001
min21.141-21.139=0.003
max21.146-21.147=-0.001
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.064-0.061=0.002
σ0.003-0.004=-0.000
min0.060-0.058=0.001
max0.072-0.069=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.388-1752.387=0.002
σ0.362-0.361=0.001
min1751.819-1751.827=-0.007
max1752.976-1752.960=0.016
mean1633.750-1626.200=7.550
σ609.765-589.531=20.234
min631.000-623.000=8.000
max2455.000-2413.000=42.000
mean2.879-2.806=0.073
σ0.110-0.176=-0.066
min2.684-2.390=0.293
max3.088-3.028=0.060

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.132-270.127=0.005
σ0.009-0.004=0.005
min270.119-270.121=-0.002
max270.141-270.131=0.010
mean2455.000-2413.000=42.000
σ0.000
min2455.000-2413.000=42.000
max2455.000-2413.000=42.000
mean0.389-0.378=0.011
σ0.011-0.001=0.010
min0.373-0.376=-0.003
max0.397-0.379=0.018
iters=5
new-facts=1
prior-facts=6402
mean1930.590-1930.598=-0.008
σ0.019-0.006=0.013
min1930.556-1930.589=-0.033
max1930.600-1930.604=-0.004
mean2455.000-2413.000=42.000
σ0.000
min2455.000-2413.000=42.000
max2455.000-2413.000=42.000
mean2.571-2.595=-0.024
σ0.106-0.094=0.013
min2.472-2.513=-0.040
max2.725-2.750=-0.025
iters=5
new-facts=6402
prior-facts=1
mean4751.108-4751.017=0.091
σ0.924-0.877=0.047
min4750.603-4750.333=0.270
max4752.757-4752.553=0.204
mean2455.000-2413.000=42.000
σ0.000
min2455.000-2413.000=42.000
max2455.000-2413.000=42.000
mean8.394-8.148=0.246
σ0.795-0.361=0.434
min7.668-7.821=-0.153
max9.427-8.602=0.825
iters=5
new-facts=6402
prior-facts=6402
mean4941.523-4941.534=-0.011
σ0.083-0.082=0.001
min4941.455-4941.463=-0.008
max4941.614-4941.627=-0.014
mean2958.000-2966.200=-8.200
σ447.635-413.398=34.238
min2455.000-2445.000=10.000
max3556.000-3520.000=36.000
mean8.489-8.633=-0.145
σ0.088-0.381=-0.293
min8.407-8.349=0.058
max8.620-9.258=-0.638

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.778-1.808=-0.029
σ0.107-0.123=-0.016
min1.609-1.665=-0.056
max1.902-1.984=-0.082

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.354-466.353=0.001
σ575.915-575.916=-0.001
min178.393-178.393=-0.000
max1330.226-1330.227=-0.001
mean84.000
σ8.000
min80.000
max96.000
mean2455.000-2413.000=42.000
σ0.000
min2455.000-2413.000=42.000
max2455.000-2413.000=42.000
mean0.563-0.584=-0.021
σ0.565-0.596=-0.031
min0.277-0.280=-0.003
max1.410-1.478=-0.068
policies=20
mean1784.227-1784.188=0.039
σ0.351-0.365=-0.013
min1783.999-1783.953=0.045
max1784.749-1784.730=0.019
mean800.000
σ0.000
min800.000
max800.000
mean2455.000-2413.000=42.000
σ0.000
min2455.000-2413.000=42.000
max2455.000-2413.000=42.000
mean2.780-2.785=-0.005
σ0.023-0.019=0.004
min2.757-2.760=-0.003
max2.809-2.803=0.006
policies=200
mean17848.890-17848.645=0.246
σ0.486-0.453=0.033
min17848.630-17848.338=0.292
max17849.619-17849.319=0.300
mean8000.000
σ0.000
min8000.000
max8000.000
mean2455.000-2413.000=42.000
σ0.000
min2455.000-2413.000=42.000
max2455.000-2413.000=42.000
mean28.018-27.992=0.026
σ0.077-0.128=-0.051
min27.928-27.835=0.093
max28.108-28.130=-0.022