Compare commits

Home / Compare 673dd62f .. 9e82eea0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.704-53.707=-0.002
σ0.363-0.364=-0.001
min53.573-53.569=0.004
max54.737-54.743=-0.005
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.139-0.139=-0.000
σ0.004-0.004=-0.001
min0.135-0.135=0.000
max0.147-0.146=0.000
cache=y
dps=1
iters=10
policies=100
mean42.979-42.978=0.001
σ0.005-0.006=-0.001
min42.973-42.965=0.008
max42.989-42.989=0.000
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.121-0.120=0.001
σ0.003-0.003=0.000
min0.118-0.117=0.001
max0.127-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean994.897-994.901=-0.004
σ1.188-1.178=0.010
min994.369-994.344=0.025
max999.878-999.846=0.031
mean1060.950-1063.050=-2.100
σ317.182-319.445=-2.264
min598.000-593.000=5.000
max1621.000-1590.000=31.000
mean1.440-1.431=0.010
σ0.087-0.070=0.018
min1.354-1.363=-0.009
max1.677-1.648=0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.307-297.304=0.003
σ0.015-0.016=-0.001
min297.282-297.276=0.007
max297.319-297.316=0.003
mean1621.000-1590.000=31.000
σ0.000
min1621.000-1590.000=31.000
max1621.000-1590.000=31.000
mean0.389-0.390=-0.001
σ0.007-0.006=0.001
min0.384-0.384=-0.000
max0.401-0.397=0.004
iters=5
new-facts=1
prior-facts=6402
mean1298.668-1298.689=-0.021
σ0.061-0.060=0.001
min1298.566-1298.589=-0.023
max1298.714-1298.735=-0.021
mean1621.000-1590.000=31.000
σ0.000
min1621.000-1590.000=31.000
max1621.000-1590.000=31.000
mean1.950-1.866=0.083
σ0.144-0.023=0.121
min1.837-1.841=-0.004
max2.200-1.897=0.302
iters=5
new-facts=6402
prior-facts=1
mean1718.870-1718.862=0.008
σ6.905-6.895=0.010
min1715.659-1715.676=-0.017
max1731.219-1731.193=0.026
mean1621.000-1590.000=31.000
σ0.000
min1621.000-1590.000=31.000
max1621.000-1590.000=31.000
mean3.084-2.949=0.135
σ0.291-0.284=0.007
min2.713-2.559=0.154
max3.452-3.330=0.122
iters=5
new-facts=6402
prior-facts=6402
mean1981.607-1981.613=-0.006
σ0.002-0.032=-0.030
min1981.604-1981.577=0.027
max1981.610-1981.664=-0.054
mean1893.000-1791.600=101.400
σ226.862-171.173=55.689
min1621.000-1590.000=31.000
max2175.000-2022.000=153.000
mean3.204-3.303=-0.099
σ0.081-0.227=-0.147
min3.096-3.104=-0.008
max3.316-3.691=-0.375

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.374-1.374=-0.000
σ0.384-0.377=0.007
min0.987-0.905=0.082
max1.828-1.754=0.074

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.376-440.374=0.002
σ572.882-572.878=0.004
min153.931-153.931=-0.000
max1299.699-1299.690=0.009
mean94.250
σ8.500
min90.000
max107.000
mean1621.000-1590.000=31.000
σ0.000
min1621.000-1590.000=31.000
max1621.000-1590.000=31.000
mean0.526-0.527=-0.001
σ0.539-0.520=0.019
min0.255-0.266=-0.011
max1.334-1.307=0.027
policies=20
mean1539.517-1539.513=0.004
σ0.305-0.305=0.000
min1539.321-1539.317=0.003
max1539.971-1539.967=0.004
mean900.000
σ0.000
min900.000
max900.000
mean1621.000-1590.000=31.000
σ0.000
min1621.000-1590.000=31.000
max1621.000-1590.000=31.000
mean2.572-2.569=0.003
σ0.015-0.008=0.007
min2.553-2.561=-0.007
max2.586-2.580=0.006
policies=200
mean15403.129-15403.069=0.060
σ0.073-0.079=-0.006
min15403.030-15402.971=0.059
max15403.205-15403.165=0.039
mean9000.000
σ0.000
min9000.000
max9000.000
mean1621.000-1590.000=31.000
σ0.000
min1621.000-1590.000=31.000
max1621.000-1590.000=31.000
mean26.016-26.014=0.002
σ0.219-0.161=0.058
min25.790-25.837=-0.047
max26.224-26.210=0.014