Compare commits

Home / Compare 29cb8a37 .. bca20859

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.563=0.005
σ0.045-0.046=-0.001
min70.537-70.537=-0.000
max70.692-70.691=0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.160-0.159=0.001
σ0.003-0.003=0.000
min0.157-0.156=0.001
max0.165-0.164=0.000
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=0.000
σ0.003-0.003=-0.000
min21.284-21.284=-0.000
max21.292-21.292=-0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.062=0.003
σ0.003-0.004=-0.001
min0.063-0.058=0.005
max0.072-0.067=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1753.374=-0.000
σ0.362-0.362=0.001
min1752.804-1752.809=-0.005
max1753.954-1753.957=-0.002
mean1662.100-1650.000=12.100
σ637.753-640.124=-2.371
min619.000-651.000=-32.000
max2813.000-2846.000=-33.000
mean2.774-2.860=-0.086
σ0.120-0.180=-0.061
min2.454-2.581=-0.127
max2.968-3.493=-0.525

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.755-271.757=-0.003
σ0.004-0.005=-0.001
min271.747-271.751=-0.003
max271.758-271.764=-0.006
mean2813.000-2846.000=-33.000
σ0.000
min2813.000-2846.000=-33.000
max2813.000-2846.000=-33.000
mean0.380-0.380=-0.000
σ0.004-0.006=-0.002
min0.377-0.375=0.002
max0.387-0.391=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1932.174-1932.176=-0.002
σ0.013-0.006=0.006
min1932.154-1932.167=-0.013
max1932.189-1932.182=0.007
mean2813.000-2846.000=-33.000
σ0.000
min2813.000-2846.000=-33.000
max2813.000-2846.000=-33.000
mean3.016-3.065=-0.049
σ0.042-0.104=-0.062
min2.968-2.968=0.001
max3.073-3.197=-0.124
iters=5
new-facts=6402
prior-facts=1
mean4752.873-4752.944=-0.071
σ0.922-0.896=0.027
min4752.415-4752.375=0.040
max4754.521-4754.536=-0.015
mean2813.000-2846.000=-33.000
σ0.000
min2813.000-2846.000=-33.000
max2813.000-2846.000=-33.000
mean8.811-8.383=0.428
σ0.217-0.379=-0.161
min8.519-8.048=0.471
max9.029-9.034=-0.005
iters=5
new-facts=6402
prior-facts=6402
mean4943.373-4943.376=-0.003
σ0.020-0.021=-0.001
min4943.349-4943.346=0.003
max4943.393-4943.396=-0.003
mean3017.000-3061.600=-44.600
σ284.242-231.380=52.862
min2813.000-2846.000=-33.000
max3471.000-3404.000=67.000
mean8.496-8.699=-0.203
σ0.148-0.176=-0.027
min8.371-8.486=-0.116
max8.743-8.968=-0.226

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.076-1.191=-0.115
σ0.110-0.223=-0.114
min0.935-0.946=-0.011
max1.243-1.478=-0.236

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.863-467.863=0.000
σ575.939-575.939=0.000
min179.886-179.889=-0.003
max1331.771-1331.771=0.000
mean86.250
σ8.500
min82.000
max99.000
mean2813.000-2846.000=-33.000
σ0.000
min2813.000-2846.000=-33.000
max2813.000-2846.000=-33.000
mean0.476-0.445=0.031
σ0.386-0.313=0.073
min0.281-0.286=-0.005
max1.055-0.914=0.141
policies=20
mean1799.160-1799.185=-0.026
σ0.374-0.373=0.002
min1798.873-1798.932=-0.059
max1799.710-1799.735=-0.024
mean820.000
σ0.000
min820.000
max820.000
mean2813.000-2846.000=-33.000
σ0.000
min2813.000-2846.000=-33.000
max2813.000-2846.000=-33.000
mean2.803-2.861=-0.058
σ0.018-0.008=0.010
min2.785-2.855=-0.070
max2.825-2.873=-0.047
policies=200
mean17998.394-17998.560=-0.166
σ0.485-0.486=-0.002
min17998.060-17998.221=-0.161
max17999.106-17999.281=-0.175
mean8200.000
σ0.000
min8200.000
max8200.000
mean2813.000-2846.000=-33.000
σ0.000
min2813.000-2846.000=-33.000
max2813.000-2846.000=-33.000
mean28.220-28.493=-0.272
σ0.083-0.409=-0.326
min28.113-28.156=-0.043
max28.296-28.994=-0.698