Compare commits

Home / Compare ea9f0e5c .. 84fe63a4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.568-70.563=0.005
σ0.045-0.046=-0.001
min70.541-70.542=-0.001
max70.692-70.691=0.001
mean417.000-413.600=3.400
σ0.000-0.516=-0.516
min417.000-413.000=4.000
max417.000-414.000=3.000
mean0.161-0.156=0.005
σ0.003-0.006=-0.002
min0.157-0.148=0.009
max0.167-0.165=0.002
cache=y
dps=1
iters=10
policies=100
mean21.287-21.292=-0.005
σ0.002-0.010=-0.008
min21.284-21.282=0.002
max21.291-21.319=-0.028
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.061-0.064=-0.003
σ0.003-0.003=0.001
min0.058-0.060=-0.001
max0.067-0.070=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1753.375=-0.001
σ0.361-0.363=-0.002
min1752.811-1752.803=0.008
max1753.976-1753.961=0.015
mean1663.500-1651.000=12.500
σ637.114-645.082=-7.968
min621.000-630.000=-9.000
max2815.000-2890.000=-75.000
mean2.807-2.807=-0.000
σ0.157-0.192=-0.035
min2.380-2.257=0.123
max3.100-3.019=0.081

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.754-271.759=-0.005
σ0.007-0.006=0.001
min271.744-271.750=-0.006
max271.760-271.765=-0.005
mean2815.000-2890.000=-75.000
σ0.000
min2815.000-2890.000=-75.000
max2815.000-2890.000=-75.000
mean0.379-0.381=-0.002
σ0.005-0.006=-0.001
min0.371-0.376=-0.004
max0.386-0.392=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1932.179-1932.174=0.005
σ0.013-0.014=-0.001
min1932.160-1932.158=0.002
max1932.189-1932.191=-0.002
mean2815.000-2890.000=-75.000
σ0.000
min2815.000-2890.000=-75.000
max2815.000-2890.000=-75.000
mean2.976-3.028=-0.051
σ0.081-0.064=0.018
min2.860-2.968=-0.108
max3.087-3.108=-0.020
iters=5
new-facts=6402
prior-facts=1
mean4752.903-4752.898=0.005
σ0.927-0.918=0.009
min4752.399-4752.403=-0.004
max4754.552-4754.530=0.022
mean2815.000-2890.000=-75.000
σ0.000
min2815.000-2890.000=-75.000
max2815.000-2890.000=-75.000
mean8.592-8.598=-0.006
σ0.483-0.561=-0.078
min7.913-7.642=0.271
max9.050-9.022=0.028
iters=5
new-facts=6402
prior-facts=6402
mean4943.302-4943.372=-0.070
σ0.147-0.017=0.131
min4943.039-4943.354=-0.314
max4943.389-4943.396=-0.007
mean3001.000-3042.800=-41.800
σ203.779-232.383=-28.603
min2815.000-2890.000=-75.000
max3309.000-3415.000=-106.000
mean8.465-8.427=0.038
σ0.090-0.029=0.061
min8.327-8.408=-0.081
max8.547-8.479=0.069

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.001-1.126=-0.126
σ0.144-0.156=-0.012
min0.931-0.935=-0.004
max1.259-1.323=-0.064

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.863-467.864=-0.001
σ575.929-575.937=-0.008
min179.891-179.887=0.005
max1331.757-1331.769=-0.013
mean86.250
σ8.500
min82.000
max99.000
mean2815.000-2890.000=-75.000
σ0.000
min2815.000-2890.000=-75.000
max2815.000-2890.000=-75.000
mean0.466-0.446=0.021
σ0.364-0.303=0.060
min0.274-0.292=-0.018
max1.012-0.901=0.111
policies=20
mean1799.171-1799.170=0.001
σ0.364-0.383=-0.019
min1798.921-1798.900=0.020
max1799.713-1799.735=-0.022
mean820.000
σ0.000
min820.000
max820.000
mean2815.000-2890.000=-75.000
σ0.000
min2815.000-2890.000=-75.000
max2815.000-2890.000=-75.000
mean2.817-2.881=-0.064
σ0.023-0.006=0.016
min2.794-2.875=-0.081
max2.837-2.887=-0.049
policies=200
mean17998.400-17998.565=-0.165
σ0.611-0.462=0.148
min17997.986-17998.313=-0.328
max17999.306-17999.258=0.048
mean8200.000
σ0.000
min8200.000
max8200.000
mean2815.000-2890.000=-75.000
σ0.000
min2815.000-2890.000=-75.000
max2815.000-2890.000=-75.000
mean28.216-28.580=-0.364
σ0.158-0.433=-0.274
min28.108-28.170=-0.062
max28.449-29.036=-0.588