Compare commits

Home / Compare 3d1eb078 .. c4d77db1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.565=0.002
σ0.045-0.046=-0.001
min70.542-70.540=0.002
max70.690-70.691=-0.000
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.159-0.158=0.001
σ0.004-0.004=0.001
min0.150-0.151=-0.002
max0.165-0.163=0.002
cache=y
dps=1
iters=10
policies=100
mean21.287-21.287=0.000
σ0.003-0.003=-0.000
min21.281-21.281=-0.001
max21.291-21.292=-0.001
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.063-0.063=-0.001
σ0.004-0.003=0.000
min0.058-0.060=-0.001
max0.069-0.072=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1753.374=-0.000
σ0.362-0.360=0.002
min1752.800-1752.801=-0.002
max1753.957-1753.956=0.001
mean1650.900-1650.400=0.500
σ646.390-639.040=7.350
min633.000-627.000=6.000
max2897.000-2845.000=52.000
mean2.792-2.773=0.019
σ0.169-0.210=-0.041
min2.289-2.253=0.036
max3.008-2.982=0.026

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.762-271.753=0.009
σ0.007-0.006=0.001
min271.753-271.748=0.005
max271.770-271.760=0.009
mean2897.000-2845.000=52.000
σ0.000
min2897.000-2845.000=52.000
max2897.000-2845.000=52.000
mean0.387-0.384=0.003
σ0.005-0.008=-0.003
min0.381-0.376=0.005
max0.394-0.396=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.179-1932.183=-0.005
σ0.008-0.017=-0.009
min1932.169-1932.163=0.006
max1932.188-1932.208=-0.019
mean2897.000-2845.000=52.000
σ0.000
min2897.000-2845.000=52.000
max2897.000-2845.000=52.000
mean3.013-2.856=0.157
σ0.061-0.269=-0.208
min2.972-2.472=0.499
max3.116-3.101=0.015
iters=5
new-facts=6402
prior-facts=1
mean4752.894-4752.909=-0.015
σ0.867-0.940=-0.073
min4752.385-4752.374=0.010
max4754.436-4754.579=-0.143
mean2897.000-2845.000=52.000
σ0.000
min2897.000-2845.000=52.000
max2897.000-2845.000=52.000
mean8.726-8.601=0.125
σ0.330-0.542=-0.212
min8.441-7.709=0.732
max9.257-9.113=0.145
iters=5
new-facts=6402
prior-facts=6402
mean4943.371-4943.230=0.141
σ0.013-0.209=-0.196
min4943.355-4942.997=0.358
max4943.388-4943.397=-0.009
mean3038.400-3021.000=17.400
σ169.475-239.465=-69.990
min2897.000-2845.000=52.000
max3312.000-3399.000=-87.000
mean8.575-8.484=0.090
σ0.074-0.071=0.003
min8.498-8.405=0.092
max8.650-8.566=0.084

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.054-1.025=0.029
σ0.128-0.139=-0.011
min0.940-0.932=0.008
max1.252-1.251=0.000

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.857-467.856=0.002
σ575.926-575.928=-0.003
min179.884-179.890=-0.006
max1331.746-1331.749=-0.002
mean86.250
σ8.500
min82.000
max99.000
mean2897.000-2845.000=52.000
σ0.000
min2897.000-2845.000=52.000
max2897.000-2845.000=52.000
mean0.447-0.420=0.027
σ0.306-0.260=0.046
min0.289-0.277=0.013
max0.906-0.809=0.096
policies=20
mean1799.167-1799.184=-0.017
σ0.374-0.381=-0.007
min1798.890-1798.925=-0.035
max1799.713-1799.746=-0.032
mean820.000
σ0.000
min820.000
max820.000
mean2897.000-2845.000=52.000
σ0.000
min2897.000-2845.000=52.000
max2897.000-2845.000=52.000
mean2.907-2.902=0.005
σ0.006-0.006=0.000
min2.898-2.894=0.004
max2.912-2.908=0.004
policies=200
mean17998.515-17998.544=-0.029
σ0.495-0.449=0.046
min17998.221-17998.244=-0.023
max17999.254-17999.211=0.043
mean8200.000
σ0.000
min8200.000
max8200.000
mean2897.000-2845.000=52.000
σ0.000
min2897.000-2845.000=52.000
max2897.000-2845.000=52.000
mean28.703-28.676=0.027
σ0.486-0.441=0.045
min28.243-28.232=0.011
max29.204-29.188=0.016