Compare commits

Home / Compare f554710b .. dd96d79f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.647-53.647=-0.000
σ0.368-0.367=0.001
min53.510-53.516=-0.006
max54.693-54.690=0.003
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.137-0.140=-0.003
σ0.004-0.003=0.001
min0.130-0.136=-0.006
max0.143-0.145=-0.001
cache=y
dps=1
iters=10
policies=100
mean42.943-42.943=-0.001
σ0.006-0.010=-0.003
min42.928-42.932=-0.004
max42.950-42.965=-0.014
mean415.000
σ0.000
min415.000
max415.000
mean0.120-0.116=0.003
σ0.003-0.003=-0.001
min0.117-0.114=0.003
max0.127-0.122=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.860-991.864=-0.004
σ1.214-1.203=0.011
min991.278-991.333=-0.055
max996.928-996.905=0.024
mean1052.500-1059.850=-7.350
σ313.025-316.778=-3.753
min580.000-590.000=-10.000
max1528.000-1546.000=-18.000
mean1.526-1.501=0.025
σ0.073-0.066=0.007
min1.457-1.405=0.052
max1.774-1.655=0.119

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.438-285.438=-0.000
σ0.010-0.011=-0.001
min285.420-285.419=0.001
max285.446-285.448=-0.002
mean1528.000-1546.000=-18.000
σ0.000
min1528.000-1546.000=-18.000
max1528.000-1546.000=-18.000
mean0.378-0.380=-0.002
σ0.010-0.005=0.005
min0.373-0.376=-0.003
max0.396-0.387=0.009
iters=5
new-facts=1
prior-facts=6402
mean1285.510-1285.503=0.008
σ0.091-0.086=0.005
min1285.349-1285.354=-0.005
max1285.568-1285.573=-0.005
mean1528.000-1546.000=-18.000
σ0.000
min1528.000-1546.000=-18.000
max1528.000-1546.000=-18.000
mean1.943-1.922=0.021
σ0.162-0.072=0.090
min1.758-1.816=-0.058
max2.155-2.019=0.135
iters=5
new-facts=6402
prior-facts=1
mean1705.831-1705.831=-0.000
σ6.845-6.824=0.021
min1702.640-1702.643=-0.003
max1718.072-1718.037=0.035
mean1528.000-1546.000=-18.000
σ0.000
min1528.000-1546.000=-18.000
max1528.000-1546.000=-18.000
mean2.937-2.872=0.066
σ0.237-0.194=0.044
min2.543-2.581=-0.037
max3.122-3.092=0.029
iters=5
new-facts=6402
prior-facts=6402
mean1968.440-1968.387=0.053
σ0.018-0.049=-0.031
min1968.421-1968.337=0.083
max1968.469-1968.447=0.023
mean1870.200-1781.800=88.400
σ246.899-181.319=65.580
min1540.000-1546.000=-6.000
max2154.000-2005.000=149.000
mean3.255-3.249=0.006
σ0.089-0.417=-0.328
min3.142-3.028=0.114
max3.355-3.994=-0.639

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.713-1.486=0.228
σ0.142-0.252=-0.110
min1.536-1.203=0.333
max1.856-1.722=0.134

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.761-436.770=-0.009
σ572.344-572.352=-0.008
min150.587-150.590=-0.002
max1295.277-1295.297=-0.021
mean90.250
σ8.500
min86.000
max103.000
mean1528.000-1546.000=-18.000
σ0.000
min1528.000-1546.000=-18.000
max1528.000-1546.000=-18.000
mean0.518-0.527=-0.010
σ0.532-0.552=-0.020
min0.249-0.249=-0.000
max1.316-1.356=-0.040
policies=20
mean1506.167-1506.176=-0.009
σ0.234-0.235=-0.001
min1506.004-1506.011=-0.007
max1506.514-1506.525=-0.011
mean860.000
σ0.000
min860.000
max860.000
mean1528.000-1546.000=-18.000
σ0.000
min1528.000-1546.000=-18.000
max1528.000-1546.000=-18.000
mean2.505-2.513=-0.008
σ0.011-0.010=0.001
min2.497-2.505=-0.008
max2.521-2.528=-0.007
policies=200
mean15069.344-15069.515=-0.171
σ0.110-0.111=-0.001
min15069.261-15069.418=-0.157
max15069.501-15069.614=-0.113
mean8600.000
σ0.000
min8600.000
max8600.000
mean1528.000-1546.000=-18.000
σ0.000
min1528.000-1546.000=-18.000
max1528.000-1546.000=-18.000
mean25.381-25.384=-0.003
σ0.129-0.159=-0.030
min25.239-25.212=0.028
max25.547-25.527=0.020