Compare commits

Home / Compare 15077563 .. 14838ed5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.563=0.004
σ0.046-0.046=-0.000
min70.541-70.541=-0.001
max70.693-70.692=0.001
mean414.000-415.600=-1.600
σ0.000-0.516=-0.516
min414.000-415.000=-1.000
max414.000-416.000=-2.000
mean0.155-0.158=-0.003
σ0.004-0.005=-0.001
min0.148-0.151=-0.003
max0.161-0.167=-0.006
cache=y
dps=1
iters=10
policies=100
mean21.287-21.288=-0.001
σ0.003-0.003=-0.001
min21.282-21.284=-0.001
max21.291-21.295=-0.004
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.065-0.065=-0.000
σ0.002-0.002=0.001
min0.063-0.063=-0.000
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.568-1753.570=-0.002
σ0.358-0.362=-0.004
min1752.998-1753.000=-0.002
max1754.131-1754.153=-0.023
mean1658.450-1655.700=2.750
σ634.535-637.906=-3.371
min642.000-631.000=11.000
max2856.000-2852.000=4.000
mean2.834-2.810=0.024
σ0.184-0.179=0.004
min2.477-2.417=0.059
max3.229-3.061=0.168

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.016-272.018=-0.002
σ0.006-0.008=-0.002
min272.009-272.009=0.001
max272.023-272.029=-0.007
mean2856.000-2852.000=4.000
σ0.000
min2856.000-2852.000=4.000
max2856.000-2852.000=4.000
mean0.393-0.390=0.003
σ0.010-0.012=-0.002
min0.376-0.376=-0.000
max0.402-0.406=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1932.436-1932.436=0.001
σ0.008-0.006=0.002
min1932.421-1932.429=-0.007
max1932.441-1932.444=-0.002
mean2856.000-2852.000=4.000
σ0.000
min2856.000-2852.000=4.000
max2856.000-2852.000=4.000
mean2.957-3.077=-0.120
σ0.071-0.177=-0.105
min2.896-2.951=-0.055
max3.078-3.369=-0.291
iters=5
new-facts=6402
prior-facts=1
mean4753.054-4753.167=-0.114
σ0.916-0.865=0.051
min4752.306-4752.691=-0.385
max4754.643-4754.708=-0.065
mean2856.000-2852.000=4.000
σ0.000
min2856.000-2852.000=4.000
max2856.000-2852.000=4.000
mean8.396-8.522=-0.125
σ0.668-0.465=0.203
min7.748-7.859=-0.111
max9.305-8.949=0.355
iters=5
new-facts=6402
prior-facts=6402
mean4943.629-4943.623=0.006
σ0.022-0.024=-0.002
min4943.604-4943.590=0.014
max4943.654-4943.656=-0.002
mean3057.800-3083.600=-25.800
σ198.944-238.367=-39.423
min2856.000-2852.000=4.000
max3315.000-3428.000=-113.000
mean8.641-8.588=0.054
σ0.199-0.187=0.012
min8.380-8.368=0.012
max8.824-8.850=-0.025

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.030-1.089=-0.059
σ0.136-0.121=0.015
min0.939-0.941=-0.001
max1.248-1.278=-0.030

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.082-473.080=0.002
σ575.913-575.923=-0.010
min185.114-185.115=-0.000
max1336.952-1336.964=-0.012
mean88.250
σ8.500
min84.000
max101.000
mean2856.000-2852.000=4.000
σ0.000
min2856.000-2852.000=4.000
max2856.000-2852.000=4.000
mean0.488-0.488=-0.000
σ0.376-0.378=-0.002
min0.295-0.297=-0.002
max1.052-1.055=-0.003
policies=20
mean1851.469-1851.459=0.010
σ0.371-0.367=0.005
min1851.199-1851.184=0.015
max1852.011-1851.993=0.018
mean840.000
σ0.000
min840.000
max840.000
mean2856.000-2852.000=4.000
σ0.000
min2856.000-2852.000=4.000
max2856.000-2852.000=4.000
mean2.956-2.952=0.004
σ0.020-0.012=0.008
min2.938-2.943=-0.004
max2.982-2.970=0.012
policies=200
mean18521.130-18521.039=0.091
σ0.356-0.430=-0.074
min18520.839-18520.623=0.216
max18521.650-18521.641=0.008
mean8400.000
σ0.000
min8400.000
max8400.000
mean2856.000-2852.000=4.000
σ0.000
min2856.000-2852.000=4.000
max2856.000-2852.000=4.000
mean29.360-29.169=0.191
σ0.534-0.437=0.097
min28.851-28.753=0.098
max29.836-29.648=0.187