Compare commits

Home / Compare 192ed28e .. e5c5abf9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.647-53.648=-0.001
σ0.366-0.370=-0.004
min53.517-53.520=-0.003
max54.690-54.701=-0.011
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.139-0.145=-0.006
σ0.004-0.008=-0.004
min0.132-0.136=-0.004
max0.145-0.160=-0.015
cache=y
dps=1
iters=10
policies=100
mean42.945-42.945=-0.001
σ0.006-0.009=-0.003
min42.936-42.934=0.001
max42.954-42.964=-0.011
mean416.000-418.400=-2.400
σ0.000-0.843=-0.843
min416.000-418.000=-2.000
max416.000-420.000=-4.000
mean0.129-0.121=0.008
σ0.010-0.004=0.007
min0.118-0.119=-0.000
max0.146-0.128=0.018

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.072-992.068=0.004
σ1.249-1.231=0.018
min991.513-991.500=0.013
max997.327-997.248=0.080
mean1066.350-1064.700=1.650
σ324.582-312.731=11.851
min603.000-607.000=-4.000
max1638.000-1590.000=48.000
mean1.582-1.543=0.038
σ0.142-0.116=0.026
min1.418-1.402=0.017
max1.965-1.993=-0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.657-285.658=-0.001
σ0.012-0.009=0.003
min285.636-285.644=-0.008
max285.668-285.667=0.001
mean1638.000-1590.000=48.000
σ0.000
min1638.000-1590.000=48.000
max1638.000-1590.000=48.000
mean0.377-0.381=-0.005
σ0.002-0.006=-0.004
min0.375-0.376=-0.001
max0.379-0.388=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1285.623-1285.620=0.003
σ0.137-0.137=0.001
min1285.556-1285.555=0.001
max1285.868-1285.865=0.004
mean1638.000-1590.000=48.000
σ0.000
min1638.000-1590.000=48.000
max1638.000-1590.000=48.000
mean1.856-1.927=-0.071
σ0.081-0.139=-0.058
min1.784-1.831=-0.046
max1.989-2.173=-0.185
iters=5
new-facts=6402
prior-facts=1
mean1807.942-1807.928=0.014
σ7.026-6.999=0.027
min1804.574-1804.582=-0.008
max1820.494-1820.432=0.062
mean1638.000-1590.000=48.000
σ0.000
min1638.000-1590.000=48.000
max1638.000-1590.000=48.000
mean4.136-4.070=0.066
σ0.201-0.096=0.104
min3.977-3.961=0.015
max4.467-4.188=0.280
iters=5
new-facts=6402
prior-facts=6402
mean2070.441-2070.442=-0.001
σ0.007-0.010=-0.003
min2070.431-2070.431=-0.000
max2070.448-2070.455=-0.006
mean1853.400-1832.000=21.400
σ204.940-178.526=26.414
min1638.000-1611.000=27.000
max2082.000-2074.000=8.000
mean4.431-4.511=-0.079
σ0.023-0.031=-0.007
min4.404-4.469=-0.065
max4.461-4.547=-0.086

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.305-1.346=-0.041
σ0.291-0.352=-0.062
min1.038-0.909=0.129
max1.638-1.745=-0.107

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.376-437.373=0.004
σ572.365-572.354=0.010
min151.185-151.191=-0.005
max1295.923-1295.905=0.019
mean90.250
σ8.500
min86.000
max103.000
mean1638.000-1590.000=48.000
σ0.000
min1638.000-1590.000=48.000
max1638.000-1590.000=48.000
mean0.530-0.539=-0.009
σ0.556-0.568=-0.011
min0.249-0.251=-0.002
max1.364-1.390=-0.026
policies=20
mean1512.113-1512.122=-0.009
σ0.228-0.248=-0.020
min1511.962-1511.955=0.007
max1512.452-1512.490=-0.038
mean860.000
σ0.000
min860.000
max860.000
mean1638.000-1590.000=48.000
σ0.000
min1638.000-1590.000=48.000
max1638.000-1590.000=48.000
mean2.525-2.532=-0.008
σ0.009-0.014=-0.006
min2.519-2.512=0.007
max2.537-2.543=-0.006
policies=200
mean15128.773-15128.920=-0.147
σ0.149-0.042=0.106
min15128.640-15128.878=-0.237
max15128.954-15128.964=-0.010
mean8600.000
σ0.000
min8600.000
max8600.000
mean1638.000-1590.000=48.000
σ0.000
min1638.000-1590.000=48.000
max1638.000-1590.000=48.000
mean25.679-25.642=0.037
σ0.143-0.114=0.029
min25.513-25.579=-0.066
max25.854-25.813=0.041