Compare commits

Home / Compare 5ccdcc52 .. 630d703c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.373-70.375=-0.002
σ0.058-0.059=-0.001
min70.333-70.337=-0.004
max70.534-70.538=-0.004
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.158-0.160=-0.001
σ0.003-0.003=0.000
min0.155-0.156=-0.002
max0.164-0.164=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=-0.000
σ0.002-0.002=-0.000
min21.139-21.140=-0.001
max21.146-21.148=-0.002
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.064-0.062=0.002
σ0.003-0.004=-0.002
min0.062-0.058=0.004
max0.071-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.199-1752.199=0.000
σ0.361-0.361=0.000
min1751.627-1751.624=0.004
max1752.786-1752.775=0.011
mean1656.200-1654.950=1.250
σ641.990-648.208=-6.218
min623.000-646.000=-23.000
max2774.000-2861.000=-87.000
mean2.773-2.843=-0.071
σ0.244-0.086=0.158
min2.172-2.704=-0.531
max3.133-3.033=0.099

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.931-269.931=0.000
σ0.006-0.009=-0.004
min269.925-269.919=0.006
max269.939-269.942=-0.002
mean2774.000-2861.000=-87.000
σ0.000
min2774.000-2861.000=-87.000
max2774.000-2861.000=-87.000
mean0.376-0.380=-0.005
σ0.009-0.009=0.001
min0.370-0.372=-0.001
max0.392-0.394=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1930.395-1930.397=-0.002
σ0.017-0.013=0.004
min1930.369-1930.388=-0.019
max1930.411-1930.418=-0.007
mean2774.000-2861.000=-87.000
σ0.000
min2774.000-2861.000=-87.000
max2774.000-2861.000=-87.000
mean2.529-2.552=-0.023
σ0.104-0.132=-0.028
min2.407-2.457=-0.050
max2.641-2.767=-0.127
iters=5
new-facts=6402
prior-facts=1
mean4750.916-4750.753=0.164
σ0.793-0.605=0.188
min4750.470-4750.301=0.169
max4752.329-4751.818=0.511
mean2774.000-2861.000=-87.000
σ0.000
min2774.000-2861.000=-87.000
max2774.000-2861.000=-87.000
mean8.176-8.545=-0.369
σ0.412-0.542=-0.130
min7.681-7.649=0.032
max8.699-9.037=-0.338
iters=5
new-facts=6402
prior-facts=6402
mean4941.258-4941.118=0.140
σ0.195-0.297=-0.102
min4940.939-4940.723=0.216
max4941.417-4941.426=-0.009
mean3051.000-3058.400=-7.400
σ341.981-194.692=147.289
min2774.000-2861.000=-87.000
max3566.000-3343.000=223.000
mean8.443-8.560=-0.117
σ0.136-0.229=-0.094
min8.334-8.361=-0.027
max8.641-8.914=-0.274

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.053-1.047=0.006
σ0.124-0.128=-0.004
min0.940-0.933=0.007
max1.243-1.244=-0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.903-465.909=-0.006
σ575.760-575.757=0.003
min178.019-178.027=-0.008
max1329.543-1329.544=-0.001
mean81.750
σ7.500
min78.000
max93.000
mean2774.000-2861.000=-87.000
σ0.000
min2774.000-2861.000=-87.000
max2774.000-2861.000=-87.000
mean0.442-0.443=-0.001
σ0.306-0.304=0.002
min0.285-0.289=-0.004
max0.901-0.899=0.002
policies=20
mean1780.496-1780.474=0.022
σ0.373-0.349=0.024
min1780.233-1780.229=0.004
max1781.044-1780.986=0.058
mean780.000
σ0.000
min780.000
max780.000
mean2774.000-2861.000=-87.000
σ0.000
min2774.000-2861.000=-87.000
max2774.000-2861.000=-87.000
mean2.844-2.847=-0.003
σ0.105-0.006=0.100
min2.758-2.843=-0.085
max2.990-2.855=0.135
policies=200
mean17811.317-17811.246=0.071
σ0.464-0.417=0.047
min17811.049-17810.875=0.174
max17812.012-17811.834=0.178
mean7800.000
σ0.000
min7800.000
max7800.000
mean2774.000-2861.000=-87.000
σ0.000
min2774.000-2861.000=-87.000
max2774.000-2861.000=-87.000
mean27.913-28.359=-0.446
σ0.157-0.515=-0.358
min27.784-27.849=-0.064
max28.118-28.877=-0.760