Compare commits

Home / Compare 3cb36b19 .. e1e933ac

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.375-70.374=0.000
σ0.057-0.060=-0.003
min70.337-70.333=0.004
max70.535-70.543=-0.008
mean415.000
σ0.000
min415.000
max415.000
mean0.159-0.157=0.001
σ0.003-0.003=-0.000
min0.156-0.154=0.001
max0.165-0.164=0.002
cache=y
dps=1
iters=10
policies=100
mean21.143-21.142=0.001
σ0.001-0.003=-0.001
min21.141-21.138=0.003
max21.145-21.146=-0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.064-0.060=0.005
σ0.002-0.002=-0.000
min0.063-0.058=0.005
max0.070-0.066=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1714.271-1752.199=-37.927
σ169.514-0.359=169.155
min994.087-1751.625=-757.539
max1752.788-1752.764=0.024
mean1655.450-1659.750=-4.300
σ617.148-624.167=-7.019
min641.000-685.000=-44.000
max2493.000-2738.000=-245.000
mean2.759-2.808=-0.049
σ0.349-0.161=0.188
min1.372-2.442=-1.070
max2.967-3.065=-0.098

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.932-269.933=-0.001
σ0.007-0.005=0.002
min269.924-269.929=-0.005
max269.943-269.942=0.001
mean2493.000-2738.000=-245.000
σ0.000
min2493.000-2738.000=-245.000
max2493.000-2738.000=-245.000
mean0.371-0.371=0.000
σ0.005-0.004=0.001
min0.369-0.369=0.000
max0.380-0.378=0.001
iters=5
new-facts=1
prior-facts=6402
mean1930.388-1930.391=-0.003
σ0.017-0.015=0.002
min1930.363-1930.368=-0.005
max1930.407-1930.403=0.004
mean2493.000-2738.000=-245.000
σ0.000
min2493.000-2738.000=-245.000
max2493.000-2738.000=-245.000
mean2.554-2.500=0.054
σ0.164-0.122=0.042
min2.444-2.381=0.063
max2.844-2.694=0.149
iters=5
new-facts=6402
prior-facts=1
mean4750.855-4750.816=0.039
σ0.810-0.852=-0.042
min4750.263-4750.007=0.256
max4752.271-4752.258=0.012
mean2493.000-2738.000=-245.000
σ0.000
min2493.000-2738.000=-245.000
max2493.000-2738.000=-245.000
mean8.589-8.100=0.488
σ0.340-0.349=-0.009
min8.264-7.669=0.595
max9.125-8.516=0.609
iters=5
new-facts=6402
prior-facts=6402
mean4941.332-4941.259=0.073
σ0.087-0.205=-0.118
min4941.253-4940.915=0.338
max4941.430-4941.425=0.004
mean2991.000-3038.200=-47.200
σ283.603-357.650=-74.047
min2603.000-2738.000=-135.000
max3326.000-3564.000=-238.000
mean8.527-8.399=0.128
σ0.181-0.114=0.067
min8.357-8.327=0.030
max8.734-8.597=0.138

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.551-1.071=0.480
σ0.300-0.104=0.196
min1.248-0.935=0.313
max1.963-1.226=0.737

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.903-465.912=-0.009
σ575.760-575.769=-0.009
min178.017-178.018=-0.002
max1329.543-1329.566=-0.023
mean81.750
σ7.500
min78.000
max93.000
mean2493.000-2738.000=-245.000
σ0.000
min2493.000-2738.000=-245.000
max2493.000-2738.000=-245.000
mean0.546-0.539=0.007
σ0.532-0.503=0.029
min0.275-0.279=-0.004
max1.344-1.293=0.051
policies=20
mean1780.453-1780.432=0.021
σ0.358-0.350=0.008
min1780.208-1780.192=0.015
max1780.982-1780.951=0.031
mean780.000
σ0.000
min780.000
max780.000
mean2493.000-2738.000=-245.000
σ0.000
min2493.000-2738.000=-245.000
max2493.000-2738.000=-245.000
mean2.788-2.762=0.026
σ0.072-0.032=0.040
min2.736-2.737=-0.001
max2.895-2.808=0.087
policies=200
mean17811.337-17811.077=0.260
σ0.470-0.519=-0.049
min17811.063-17810.772=0.291
max17812.039-17811.854=0.185
mean7800.000
σ0.000
min7800.000
max7800.000
mean2493.000-2738.000=-245.000
σ0.000
min2493.000-2738.000=-245.000
max2493.000-2738.000=-245.000
mean27.843-27.814=0.029
σ0.117-0.159=-0.042
min27.732-27.720=0.012
max27.989-28.052=-0.064