Compare commits

Home / Compare 9f435ecf .. db16dff9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.696-70.695=0.001
σ0.047-0.046=0.001
min70.674-70.672=0.002
max70.828-70.824=0.004
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.160-0.160=0.000
σ0.004-0.004=-0.001
min0.157-0.154=0.003
max0.167-0.168=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.421-21.420=0.001
σ0.003-0.003=-0.000
min21.416-21.415=0.001
max21.424-21.423=0.001
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.065-0.061=0.004
σ0.002-0.004=-0.001
min0.063-0.058=0.005
max0.071-0.067=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.457-1754.458=-0.001
σ0.359-0.361=-0.002
min1753.881-1753.891=-0.011
max1755.045-1755.039=0.006
mean1658.800-1675.450=-16.650
σ628.736-649.794=-21.059
min679.000-629.000=50.000
max2603.000-2871.000=-268.000
mean2.740-2.834=-0.094
σ0.212-0.098=0.115
min2.173-2.593=-0.420
max3.056-2.984=0.072

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.496-273.504=-0.007
σ0.009-0.007=0.002
min273.482-273.495=-0.013
max273.508-273.513=-0.006
mean2603.000-2871.000=-268.000
σ0.000
min2603.000-2871.000=-268.000
max2603.000-2871.000=-268.000
mean0.376-0.376=-0.001
σ0.007-0.005=0.001
min0.372-0.372=-0.000
max0.388-0.386=0.002
iters=5
new-facts=1
prior-facts=6402
mean1933.894-1933.893=0.002
σ0.009-0.011=-0.001
min1933.887-1933.881=0.006
max1933.909-1933.902=0.007
mean2603.000-2871.000=-268.000
σ0.000
min2603.000-2871.000=-268.000
max2603.000-2871.000=-268.000
mean2.954-2.955=-0.002
σ0.175-0.057=0.117
min2.700-2.875=-0.175
max3.148-3.020=0.128
iters=5
new-facts=6402
prior-facts=1
mean4754.670-4754.644=0.026
σ0.820-0.805=0.015
min4754.145-4754.158=-0.013
max4756.127-4756.069=0.058
mean2603.000-2871.000=-268.000
σ0.000
min2603.000-2871.000=-268.000
max2603.000-2871.000=-268.000
mean8.538-8.687=-0.149
σ0.569-0.424=0.145
min7.641-8.153=-0.511
max9.095-9.015=0.080
iters=5
new-facts=6402
prior-facts=6402
mean4944.977-4945.121=-0.144
σ0.196-0.013=0.183
min4944.743-4945.109=-0.366
max4945.143-4945.138=0.005
mean3010.400-3067.200=-56.800
σ262.956-193.133=69.823
min2624.000-2871.000=-247.000
max3323.000-3316.000=7.000
mean8.590-8.646=-0.056
σ0.121-0.054=0.067
min8.442-8.584=-0.142
max8.723-8.715=0.008

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.267-1.049=0.219
σ0.341-0.131=0.210
min0.929-0.929=-0.000
max1.732-1.252=0.480

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.062-473.079=-0.017
σ575.931-575.912=0.018
min185.094-185.115=-0.022
max1336.958-1336.947=0.011
mean88.250
σ8.500
min84.000
max101.000
mean2603.000-2871.000=-268.000
σ0.000
min2603.000-2871.000=-268.000
max2603.000-2871.000=-268.000
mean0.571-0.479=0.092
σ0.569-0.361=0.209
min0.285-0.297=-0.012
max1.425-1.020=0.405
policies=20
mean1851.226-1851.447=-0.221
σ0.376-0.375=0.000
min1850.981-1851.160=-0.179
max1851.781-1851.991=-0.210
mean840.000
σ0.000
min840.000
max840.000
mean2603.000-2871.000=-268.000
σ0.000
min2603.000-2871.000=-268.000
max2603.000-2871.000=-268.000
mean2.856-2.944=-0.088
σ0.012-0.005=0.007
min2.844-2.937=-0.093
max2.871-2.948=-0.076
policies=200
mean18518.623-18519.818=-1.195
σ0.694-0.860=-0.166
min18518.159-18518.975=-0.816
max18519.655-18520.830=-1.174
mean8400.000
σ0.000
min8400.000
max8400.000
mean2603.000-2871.000=-268.000
σ0.000
min2603.000-2871.000=-268.000
max2603.000-2871.000=-268.000
mean28.802-29.073=-0.271
σ0.146-0.462=-0.316
min28.594-28.753=-0.159
max28.936-29.758=-0.822