Compare commits

Home / Compare 2fc0e129 .. a887904a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.388-70.390=-0.002
σ0.045-0.049=-0.004
min70.360-70.362=-0.001
max70.512-70.526=-0.014
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.156-0.161=-0.004
σ0.005-0.002=0.002
min0.149-0.159=-0.010
max0.162-0.166=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.144-21.145=-0.001
σ0.003-0.002=0.001
min21.139-21.140=-0.001
max21.149-21.149=-0.001
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.064-0.065=-0.001
σ0.003-0.004=-0.001
min0.058-0.058=-0.000
max0.070-0.074=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.395-1752.394=0.001
σ0.361-0.361=0.000
min1751.823-1751.828=-0.005
max1752.979-1752.978=0.000
mean1655.700-1658.300=-2.600
σ646.723-638.099=8.624
min618.000-622.000=-4.000
max2778.000-2814.000=-36.000
mean2.828-2.806=0.022
σ0.107-0.168=-0.061
min2.555-2.245=0.310
max3.013-3.031=-0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.140-270.143=-0.004
σ0.009-0.008=0.001
min270.131-270.135=-0.004
max270.150-270.156=-0.006
mean2778.000-2814.000=-36.000
σ0.000
min2778.000-2814.000=-36.000
max2778.000-2814.000=-36.000
mean0.377-0.381=-0.004
σ0.005-0.009=-0.004
min0.370-0.370=-0.000
max0.383-0.393=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1930.597-1930.599=-0.002
σ0.020-0.023=-0.003
min1930.565-1930.560=0.004
max1930.613-1930.614=-0.001
mean2778.000-2814.000=-36.000
σ0.000
min2778.000-2814.000=-36.000
max2778.000-2814.000=-36.000
mean2.563-2.558=0.005
σ0.132-0.122=0.009
min2.474-2.468=0.006
max2.783-2.751=0.033
iters=5
new-facts=6402
prior-facts=1
mean4751.314-4751.325=-0.011
σ0.960-0.886=0.074
min4750.782-4750.854=-0.072
max4753.021-4752.902=0.118
mean2778.000-2814.000=-36.000
σ0.000
min2778.000-2814.000=-36.000
max2778.000-2814.000=-36.000
mean8.621-8.579=0.042
σ0.656-0.389=0.267
min7.625-7.904=-0.279
max9.344-8.873=0.471
iters=5
new-facts=6402
prior-facts=6402
mean4941.769-4941.775=-0.006
σ0.011-0.013=-0.002
min4941.754-4941.760=-0.006
max4941.778-4941.796=-0.017
mean2989.400-3063.000=-73.600
σ218.298-247.004=-28.707
min2778.000-2814.000=-36.000
max3306.000-3310.000=-4.000
mean8.472-8.900=-0.428
σ0.083-0.466=-0.383
min8.405-8.366=0.040
max8.615-9.376=-0.760

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.022-1.045=-0.023
σ0.139-0.128=0.012
min0.928-0.935=-0.007
max1.248-1.248=0.000

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.378-466.376=0.002
σ575.927-575.927=0.001
min178.407-178.407=0.000
max1330.269-1330.266=0.003
mean84.250
σ8.500
min80.000
max97.000
mean2778.000-2814.000=-36.000
σ0.000
min2778.000-2814.000=-36.000
max2778.000-2814.000=-36.000
mean0.443-0.441=0.002
σ0.303-0.307=-0.003
min0.287-0.285=0.003
max0.898-0.902=-0.003
policies=20
mean1784.369-1784.342=0.027
σ0.333-0.343=-0.010
min1784.125-1784.103=0.022
max1784.851-1784.845=0.006
mean800.000
σ0.000
min800.000
max800.000
mean2778.000-2814.000=-36.000
σ0.000
min2778.000-2814.000=-36.000
max2778.000-2814.000=-36.000
mean2.865-2.867=-0.002
σ0.082-0.103=-0.021
min2.762-2.771=-0.009
max2.960-3.012=-0.052
policies=200
mean17849.641-17849.848=-0.207
σ0.516-0.550=-0.034
min17849.346-17849.413=-0.067
max17850.415-17850.654=-0.240
mean8000.000
σ0.000
min8000.000
max8000.000
mean2778.000-2814.000=-36.000
σ0.000
min2778.000-2814.000=-36.000
max2778.000-2814.000=-36.000
mean27.966-27.840=0.126
σ0.122-0.135=-0.013
min27.825-27.706=0.119
max28.077-28.027=0.050