Compare commits

Home / Compare 6eb3d36d .. 99009c81

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.564-70.567=-0.003
σ0.043-0.046=-0.003
min70.540-70.542=-0.002
max70.686-70.693=-0.007
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.162-0.159=0.003
σ0.003-0.004=-0.001
min0.159-0.155=0.004
max0.170-0.167=0.003
cache=y
dps=1
iters=10
policies=100
mean21.287-21.288=-0.001
σ0.003-0.004=-0.001
min21.282-21.284=-0.001
max21.292-21.295=-0.003
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.064-0.065=-0.000
σ0.003-0.003=0.001
min0.060-0.061=-0.001
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.569-1753.568=0.002
σ0.363-0.363=-0.001
min1752.995-1752.994=0.002
max1754.153-1754.165=-0.012
mean1649.000-1649.100=-0.100
σ619.276-637.310=-18.034
min671.000-619.000=52.000
max2650.000-2845.000=-195.000
mean2.805-2.705=0.100
σ0.115-0.224=-0.109
min2.460-2.233=0.226
max2.973-2.992=-0.019

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.990-272.016=-0.027
σ0.009-0.003=0.006
min271.975-272.012=-0.037
max272.000-272.020=-0.020
mean2650.000-2845.000=-195.000
σ0.000
min2650.000-2845.000=-195.000
max2650.000-2845.000=-195.000
mean0.386-0.384=0.002
σ0.009-0.005=0.004
min0.379-0.380=-0.000
max0.401-0.392=0.008
iters=5
new-facts=1
prior-facts=6402
mean1932.439-1932.440=-0.001
σ0.010-0.013=-0.003
min1932.431-1932.427=0.004
max1932.456-1932.462=-0.006
mean2650.000-2845.000=-195.000
σ0.000
min2650.000-2845.000=-195.000
max2650.000-2845.000=-195.000
mean3.012-2.943=0.069
σ0.114-0.140=-0.026
min2.853-2.714=0.138
max3.148-3.051=0.097
iters=5
new-facts=6402
prior-facts=1
mean4753.170-4753.123=0.047
σ0.816-0.857=-0.041
min4752.713-4752.694=0.019
max4754.623-4754.653=-0.029
mean2650.000-2845.000=-195.000
σ0.000
min2650.000-2845.000=-195.000
max2650.000-2845.000=-195.000
mean8.422-8.732=-0.311
σ0.487-0.200=0.287
min7.634-8.489=-0.855
max8.957-8.924=0.033
iters=5
new-facts=6402
prior-facts=6402
mean4943.562-4943.489=0.072
σ0.164-0.183=-0.019
min4943.270-4943.283=-0.013
max4943.660-4943.641=0.019
mean3023.000-3025.200=-2.200
σ294.201-243.575=50.626
min2650.000-2845.000=-195.000
max3412.000-3402.000=10.000
mean8.542-8.610=-0.068
σ0.146-0.269=-0.124
min8.320-8.382=-0.062
max8.664-8.933=-0.269

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.231-1.022=0.209
σ0.182-0.139=0.043
min1.061-0.931=0.130
max1.502-1.252=0.250

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.080-473.081=-0.001
σ575.923-575.914=0.009
min185.110-185.117=-0.007
max1336.964-1336.951=0.013
mean88.250
σ8.500
min84.000
max101.000
mean2650.000-2845.000=-195.000
σ0.000
min2650.000-2845.000=-195.000
max2650.000-2845.000=-195.000
mean0.559-0.452=0.108
σ0.545-0.302=0.243
min0.285-0.298=-0.014
max1.378-0.905=0.472
policies=20
mean1851.427-1851.474=-0.047
σ0.387-0.376=0.011
min1851.153-1851.200=-0.047
max1851.996-1852.022=-0.026
mean840.000
σ0.000
min840.000
max840.000
mean2650.000-2845.000=-195.000
σ0.000
min2650.000-2845.000=-195.000
max2650.000-2845.000=-195.000
mean2.882-2.961=-0.080
σ0.022-0.016=0.007
min2.861-2.947=-0.085
max2.913-2.982=-0.068
policies=200
mean18521.117-18521.181=-0.064
σ0.387-0.452=-0.065
min18520.889-18520.896=-0.007
max18521.696-18521.854=-0.158
mean8400.000
σ0.000
min8400.000
max8400.000
mean2650.000-2845.000=-195.000
σ0.000
min2650.000-2845.000=-195.000
max2650.000-2845.000=-195.000
mean28.923-29.186=-0.264
σ0.066-0.430=-0.363
min28.835-28.775=0.060
max28.996-29.694=-0.698