Compare commits

Home / Compare 7ac8501b .. d1e4d5c6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.647-53.647=-0.001
σ0.367-0.367=-0.000
min53.510-53.510=0.000
max54.690-54.691=-0.001
mean417.600-417.000=0.600
σ0.843-0.000=0.843
min416.000-417.000=-1.000
max418.000-417.000=1.000
mean0.135-0.139=-0.004
σ0.005-0.003=0.002
min0.130-0.135=-0.005
max0.143-0.145=-0.002
cache=y
dps=1
iters=10
policies=100
mean42.941-42.941=0.000
σ0.007-0.008=-0.001
min42.932-42.925=0.007
max42.950-42.951=-0.000
mean418.000
σ0.000
min418.000
max418.000
mean0.121-0.119=0.002
σ0.004-0.003=0.001
min0.118-0.115=0.002
max0.128-0.125=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.870-991.868=0.002
σ1.187-1.210=-0.022
min991.330-991.335=-0.005
max996.826-996.948=-0.121
mean1059.150-1071.550=-12.400
σ315.797-326.720=-10.923
min586.000-594.000=-8.000
max1542.000-1579.000=-37.000
mean1.532-1.527=0.005
σ0.094-0.088=0.006
min1.374-1.405=-0.031
max1.835-1.813=0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.437-285.438=-0.001
σ0.014-0.013=0.001
min285.418-285.420=-0.003
max285.453-285.455=-0.002
mean1542.000-1579.000=-37.000
σ0.000
min1542.000-1579.000=-37.000
max1542.000-1579.000=-37.000
mean0.377-0.378=-0.000
σ0.006-0.006=-0.000
min0.375-0.373=0.002
max0.388-0.389=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1285.512-1285.505=0.007
σ0.092-0.087=0.005
min1285.351-1285.360=-0.009
max1285.582-1285.564=0.018
mean1542.000-1579.000=-37.000
σ0.000
min1542.000-1579.000=-37.000
max1542.000-1579.000=-37.000
mean2.031-1.866=0.165
σ0.287-0.053=0.234
min1.825-1.814=0.010
max2.533-1.932=0.601
iters=5
new-facts=6402
prior-facts=1
mean1705.825-1705.829=-0.003
σ6.856-6.876=-0.020
min1702.647-1702.619=0.028
max1718.088-1718.124=-0.037
mean1542.000-1579.000=-37.000
σ0.000
min1542.000-1579.000=-37.000
max1542.000-1579.000=-37.000
mean3.010-3.073=-0.064
σ0.214-0.258=-0.044
min2.791-2.767=0.025
max3.312-3.431=-0.119
iters=5
new-facts=6402
prior-facts=6402
mean1968.406-1968.432=-0.027
σ0.022-0.004=0.018
min1968.379-1968.428=-0.050
max1968.428-1968.438=-0.010
mean1791.000-1851.800=-60.800
σ191.591-211.149=-19.558
min1542.000-1596.000=-54.000
max2030.000-2103.000=-73.000
mean3.160-3.200=-0.040
σ0.108-0.051=0.057
min3.090-3.145=-0.055
max3.352-3.275=0.077

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.482-1.558=-0.075
σ0.190-0.286=-0.095
min1.221-1.080=0.141
max1.694-1.770=-0.076

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.770-436.767=0.004
σ572.355-572.353=0.002
min150.589-150.587=0.002
max1295.303-1295.296=0.007
mean90.250
σ8.500
min86.000
max103.000
mean1542.000-1579.000=-37.000
σ0.000
min1542.000-1579.000=-37.000
max1542.000-1579.000=-37.000
mean0.528-0.526=0.002
σ0.557-0.552=0.005
min0.248-0.249=-0.002
max1.363-1.354=0.009
policies=20
mean1506.175-1506.177=-0.002
σ0.227-0.238=-0.012
min1506.019-1506.012=0.007
max1506.512-1506.531=-0.019
mean860.000
σ0.000
min860.000
max860.000
mean1542.000-1579.000=-37.000
σ0.000
min1542.000-1579.000=-37.000
max1542.000-1579.000=-37.000
mean2.512-2.513=-0.001
σ0.013-0.022=-0.009
min2.499-2.493=0.006
max2.528-2.539=-0.011
policies=200
mean15069.453-15069.441=0.012
σ0.111-0.124=-0.013
min15069.340-15069.294=0.046
max15069.593-15069.596=-0.003
mean8600.000
σ0.000
min8600.000
max8600.000
mean1542.000-1579.000=-37.000
σ0.000
min1542.000-1579.000=-37.000
max1542.000-1579.000=-37.000
mean25.499-25.557=-0.058
σ0.167-0.124=0.043
min25.353-25.418=-0.065
max25.673-25.709=-0.035