Compare commits

Home / Compare 153df320 .. 3c8c2fa7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.973-53.973=-0.000
σ0.365-0.365=-0.000
min53.834-53.839=-0.006
max55.011-55.011=-0.000
mean414.600-416.800=-2.200
σ0.516-0.422=0.095
min414.000-416.000=-2.000
max415.000-417.000=-2.000
mean0.140-0.140=0.001
σ0.004-0.003=0.001
min0.135-0.137=-0.001
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.178-43.177=0.001
σ0.005-0.006=-0.001
min43.169-43.166=0.002
max43.185-43.189=-0.004
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.122-0.120=0.001
σ0.003-0.004=-0.001
min0.119-0.114=0.005
max0.127-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean994.842-994.847=-0.005
σ1.272-1.266=0.006
min994.267-994.264=0.002
max1000.199-1000.176=0.023
mean1064.900-1067.800=-2.900
σ317.857-317.703=0.154
min574.000-578.000=-4.000
max1611.000-1616.000=-5.000
mean1.474-1.473=0.001
σ0.108-0.102=0.007
min1.404-1.350=0.053
max1.877-1.813=0.065

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.264-297.290=-0.026
σ0.019-0.004=0.014
min297.235-297.285=-0.050
max297.280-297.294=-0.014
mean1611.000-1616.000=-5.000
σ0.000
min1611.000-1616.000=-5.000
max1611.000-1616.000=-5.000
mean0.393-0.382=0.011
σ0.008-0.005=0.004
min0.386-0.379=0.007
max0.407-0.390=0.017
iters=5
new-facts=1
prior-facts=6402
mean1298.534-1298.543=-0.008
σ0.118-0.138=-0.020
min1298.476-1298.476=0.000
max1298.745-1298.789=-0.045
mean1611.000-1616.000=-5.000
σ0.000
min1611.000-1616.000=-5.000
max1611.000-1616.000=-5.000
mean1.956-1.909=0.047
σ0.050-0.054=-0.005
min1.925-1.862=0.063
max2.043-1.995=0.048
iters=5
new-facts=6402
prior-facts=1
mean1820.772-1820.781=-0.009
σ7.035-7.019=0.016
min1817.376-1817.439=-0.063
max1833.341-1833.323=0.018
mean1611.000-1616.000=-5.000
σ0.000
min1611.000-1616.000=-5.000
max1611.000-1616.000=-5.000
mean4.201-4.219=-0.017
σ0.236-0.120=0.116
min3.904-4.091=-0.188
max4.442-4.410=0.032
iters=5
new-facts=6402
prior-facts=6402
mean2083.376-2083.377=-0.001
σ0.010-0.009=0.001
min2083.365-2083.369=-0.003
max2083.391-2083.393=-0.002
mean1811.600-1839.000=-27.400
σ186.905-215.000=-28.095
min1611.000-1616.000=-5.000
max2062.000-2083.000=-21.000
mean4.522-4.474=0.048
σ0.097-0.103=-0.006
min4.388-4.333=0.054
max4.647-4.620=0.028

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.190-1.234=-0.043
σ0.380-0.341=0.040
min0.920-0.952=-0.032
max1.837-1.771=0.066

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.380-440.380=0.000
σ572.883-572.875=0.009
min153.931-153.935=-0.004
max1299.705-1299.692=0.013
mean94.250
σ8.500
min90.000
max107.000
mean1611.000-1616.000=-5.000
σ0.000
min1611.000-1616.000=-5.000
max1611.000-1616.000=-5.000
mean0.523-0.537=-0.014
σ0.513-0.563=-0.050
min0.266-0.254=0.012
max1.293-1.381=-0.088
policies=20
mean1539.603-1539.594=0.009
σ0.304-0.310=-0.006
min1539.418-1539.399=0.019
max1540.057
mean900.000
σ0.000
min900.000
max900.000
mean1611.000-1616.000=-5.000
σ0.000
min1611.000-1616.000=-5.000
max1611.000-1616.000=-5.000
mean2.579-2.577=0.002
σ0.017-0.035=-0.018
min2.567-2.541=0.026
max2.605-2.625=-0.020
policies=200
mean15404.007-15404.044=-0.037
σ0.074-0.097=-0.023
min15403.910-15403.921=-0.011
max15404.081-15404.131=-0.051
mean9000.000
σ0.000
min9000.000
max9000.000
mean1611.000-1616.000=-5.000
σ0.000
min1611.000-1616.000=-5.000
max1611.000-1616.000=-5.000
mean25.990-26.037=-0.047
σ0.149-0.200=-0.051
min25.866-25.874=-0.008
max26.184-26.323=-0.140