Compare commits

Home / Compare 792299d5 .. b9b8ed56

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.648-53.648=0.000
σ0.369-0.367=0.001
min53.520-53.521=-0.001
max54.698-54.693=0.004
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.140-0.140=0.000
σ0.003-0.005=-0.001
min0.136-0.135=0.001
max0.145-0.148=-0.003
cache=y
dps=1
iters=10
policies=100
mean42.942-42.943=-0.001
σ0.006-0.005=0.000
min42.933-42.936=-0.002
max42.950-42.953=-0.003
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.119-0.125=-0.006
σ0.004-0.006=-0.001
min0.115-0.120=-0.005
max0.126-0.139=-0.013

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.861-991.863=-0.002
σ1.215-1.229=-0.013
min991.326-991.267=0.059
max996.953-997.003=-0.050
mean1068.200-1054.600=13.600
σ324.608-313.441=11.166
min602.000-580.000=22.000
max1639.000-1481.000=158.000
mean1.536-1.548=-0.012
σ0.106-0.088=0.018
min1.370-1.451=-0.081
max1.754-1.762=-0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.440-285.440=0.000
σ0.010-0.014=-0.004
min285.425-285.416=0.009
max285.448-285.451=-0.002
mean1639.000-1481.000=158.000
σ0.000
min1639.000-1481.000=158.000
max1639.000-1481.000=158.000
mean0.383-0.383=0.000
σ0.009-0.009=0.000
min0.375-0.375=0.001
max0.396-0.393=0.003
iters=5
new-facts=1
prior-facts=6402
mean1285.498-1285.498=-0.000
σ0.081-0.084=-0.003
min1285.357-1285.354=0.003
max1285.552-1285.560=-0.009
mean1639.000-1481.000=158.000
σ0.000
min1639.000-1481.000=158.000
max1639.000-1481.000=158.000
mean1.953-1.919=0.033
σ0.140-0.051=0.089
min1.827-1.843=-0.016
max2.151-1.980=0.171
iters=5
new-facts=6402
prior-facts=1
mean1705.833-1705.836=-0.004
σ6.868-6.869=-0.002
min1702.618-1702.652=-0.035
max1718.112-1718.122=-0.010
mean1639.000-1481.000=158.000
σ0.000
min1639.000-1481.000=158.000
max1639.000-1481.000=158.000
mean3.051-3.023=0.028
σ0.326-0.219=0.107
min2.671-2.854=-0.183
max3.383-3.360=0.024
iters=5
new-facts=6402
prior-facts=6402
mean1968.452-1968.413=0.039
σ0.020-0.026=-0.005
min1968.432-1968.385=0.046
max1968.481-1968.444=0.037
mean1900.200-1790.000=110.200
σ221.114-188.845=32.268
min1639.000-1541.000=98.000
max2176.000-2024.000=152.000
mean3.264-3.198=0.066
σ0.127-0.215=-0.088
min3.153-3.069=0.084
max3.427-3.581=-0.154

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.339-1.535=-0.196
σ0.370-0.134=0.236
min0.904-1.375=-0.471
max1.773-1.661=0.113

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.695-436.686=0.010
σ572.361-572.356=0.006
min150.509-150.504=0.004
max1295.238-1295.219=0.019
mean90.250
σ8.500
min86.000
max103.000
mean1639.000-1481.000=158.000
σ0.000
min1639.000-1481.000=158.000
max1639.000-1481.000=158.000
mean0.519-0.526=-0.007
σ0.538-0.545=-0.007
min0.249-0.248=0.001
max1.327-1.344=-0.018
policies=20
mean1505.344-1505.353=-0.008
σ0.245-0.229=0.015
min1505.180-1505.197=-0.017
max1505.709-1505.694=0.015
mean860.000
σ0.000
min860.000
max860.000
mean1639.000-1481.000=158.000
σ0.000
min1639.000-1481.000=158.000
max1639.000-1481.000=158.000
mean2.523-2.511=0.012
σ0.015-0.017=-0.002
min2.512-2.491=0.021
max2.545-2.533=0.012
policies=200
mean15061.260-15061.165=0.095
σ0.073-0.094=-0.020
min15061.182-15061.045=0.137
max15061.358-15061.273=0.085
mean8600.000
σ0.000
min8600.000
max8600.000
mean1639.000-1481.000=158.000
σ0.000
min1639.000-1481.000=158.000
max1639.000-1481.000=158.000
mean25.488-25.555=-0.068
σ0.114-0.181=-0.067
min25.369-25.375=-0.006
max25.618-25.741=-0.123