Compare commits

Home / Compare a19910f9 .. a46db467

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.913-53.913=-0.000
σ0.368-0.366=0.002
min53.785-53.785=0.000
max54.960-54.955=0.005
mean415.800-418.000=-2.200
σ0.422-0.000=0.422
min415.000-418.000=-3.000
max416.000-418.000=-2.000
mean0.138-0.139=-0.001
σ0.003-0.004=-0.000
min0.135-0.135=-0.000
max0.144-0.146=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.142-43.140=0.001
σ0.006-0.005=0.000
min43.131-43.130=0.001
max43.150-43.149=0.001
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.120-0.120=-0.001
σ0.004-0.004=-0.000
min0.114-0.116=-0.002
max0.126-0.128=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.079-992.067=0.012
σ1.235-1.296=-0.061
min991.499-991.514=-0.015
max997.268-997.528=-0.260
mean1074.050-1069.100=4.950
σ325.639-319.812=5.827
min602.000-575.000=27.000
max1645.000-1649.000=-4.000
mean1.521-1.549=-0.029
σ0.070-0.126=-0.056
min1.424-1.460=-0.036
max1.747-2.040=-0.293

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.677-285.677=0.001
σ0.010-0.007=0.004
min285.664-285.667=-0.002
max285.689-285.685=0.004
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean0.382-0.376=0.005
σ0.010-0.001=0.009
min0.374-0.375=-0.001
max0.397-0.378=0.020
iters=5
new-facts=1
prior-facts=6402
mean1285.645-1285.615=0.030
σ0.135-0.076=0.059
min1285.575-1285.572=0.003
max1285.886-1285.750=0.136
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean1.986-1.933=0.053
σ0.074-0.166=-0.092
min1.871-1.846=0.025
max2.055-2.230=-0.174
iters=5
new-facts=6402
prior-facts=1
mean1807.959-1808.011=-0.053
σ6.992-6.982=0.010
min1804.572-1804.627=-0.055
max1820.446-1820.486=-0.040
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean4.072-4.362=-0.290
σ0.251-0.334=-0.083
min3.829-4.000=-0.171
max4.426-4.901=-0.475
iters=5
new-facts=6402
prior-facts=6402
mean2070.472-2070.466=0.006
σ0.040-0.012=0.028
min2070.442-2070.451=-0.009
max2070.541-2070.485=0.056
mean1858.800-1870.600=-11.800
σ193.837-196.070=-2.233
min1645.000-1649.000=-4.000
max2086.000-2092.000=-6.000
mean4.564-4.551=0.012
σ0.237-0.127=0.110
min4.414-4.468=-0.053
max4.985-4.775=0.210

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.210-1.276=-0.066
σ0.273-0.342=-0.070
min0.915-0.910=0.005
max1.615-1.824=-0.209

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.385-437.382=0.003
σ572.364-572.361=0.003
min151.193-151.191=0.002
max1295.931-1295.923=0.007
mean90.250
σ8.500
min86.000
max103.000
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean0.533-0.526=0.007
σ0.561-0.528=0.033
min0.250-0.259=-0.009
max1.375-1.318=0.056
policies=20
mean1512.188-1512.217=-0.029
σ0.241-0.262=-0.021
min1512.032-1512.044=-0.012
max1512.547-1512.606=-0.060
mean860.000
σ0.000
min860.000
max860.000
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean2.522-2.547=-0.026
σ0.023-0.022=0.001
min2.502-2.523=-0.021
max2.554-2.572=-0.018
policies=200
mean15129.698-15129.729=-0.030
σ0.103-0.082=0.020
min15129.559-15129.622=-0.063
max15129.776-15129.796=-0.020
mean8600.000
σ0.000
min8600.000
max8600.000
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean25.587-25.560=0.028
σ0.087-0.120=-0.033
min25.499-25.398=0.102
max25.675-25.680=-0.004