Compare commits

Home / Compare 3c40a4d5 .. b931db50

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.568-70.566=0.002
σ0.048-0.045=0.002
min70.545-70.539=0.006
max70.700-70.691=0.008
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.159-0.157=0.001
σ0.003-0.005=-0.002
min0.155-0.151=0.005
max0.164-0.167=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.288-21.290=-0.002
σ0.003-0.002=0.000
min21.283-21.286=-0.003
max21.291-21.294=-0.003
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.063-0.065=-0.002
σ0.003-0.003=0.000
min0.058-0.063=-0.004
max0.068-0.073=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.568-1753.569=-0.001
σ0.361-0.361=0.001
min1752.998-1752.995=0.003
max1754.150-1754.154=-0.004
mean1652.650-1650.000=2.650
σ625.772-616.512=9.260
min623.000-689.000=-66.000
max2849.000-2765.000=84.000
mean2.833-2.803=0.031
σ0.067-0.145=-0.078
min2.716-2.514=0.203
max2.953-2.986=-0.033

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.017-272.012=0.006
σ0.007-0.010=-0.003
min272.010-271.997=0.012
max272.027-272.025=0.001
mean2849.000-2765.000=84.000
σ0.000
min2849.000-2765.000=84.000
max2849.000-2765.000=84.000
mean0.389-0.384=0.005
σ0.011-0.013=-0.002
min0.377-0.375=0.002
max0.403-0.407=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1932.435-1932.438=-0.004
σ0.006-0.007=-0.001
min1932.426-1932.430=-0.004
max1932.441-1932.446=-0.005
mean2849.000-2765.000=84.000
σ0.000
min2849.000-2765.000=84.000
max2849.000-2765.000=84.000
mean3.023-2.976=0.048
σ0.112-0.149=-0.037
min2.907-2.748=0.159
max3.206-3.120=0.086
iters=5
new-facts=6402
prior-facts=1
mean4753.174-4753.235=-0.061
σ0.835-0.922=-0.086
min4752.725-4752.635=0.090
max4754.661-4754.870=-0.209
mean2849.000-2765.000=84.000
σ0.000
min2849.000-2765.000=84.000
max2849.000-2765.000=84.000
mean8.451-8.300=0.151
σ0.439-0.641=-0.202
min7.866-7.778=0.088
max8.938-9.381=-0.443
iters=5
new-facts=6402
prior-facts=6402
mean4943.626-4943.486=0.140
σ0.022-0.188=-0.166
min4943.614-4943.270=0.344
max4943.665-4943.634=0.031
mean3050.800-3028.400=22.400
σ210.010-325.601=-115.591
min2849.000-2765.000=84.000
max3350.000-3524.000=-174.000
mean8.576-8.432=0.144
σ0.201-0.110=0.090
min8.407-8.363=0.044
max8.919-8.625=0.294

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.037-1.063=-0.026
σ0.154-0.214=-0.060
min0.940-0.936=0.004
max1.295-1.431=-0.136

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.080-473.095=-0.015
σ575.915-575.950=-0.035
min185.112-185.110=0.001
max1336.953-1337.021=-0.068
mean88.250
σ8.500
min84.000
max101.000
mean2849.000-2765.000=84.000
σ0.000
min2849.000-2765.000=84.000
max2849.000-2765.000=84.000
mean0.486-0.604=-0.118
σ0.377-0.635=-0.258
min0.295-0.284=0.010
max1.052-1.557=-0.505
policies=20
mean1851.458-1851.426=0.032
σ0.375-0.377=-0.002
min1851.160-1851.171=-0.011
max1851.999-1851.984=0.015
mean840.000
σ0.000
min840.000
max840.000
mean2849.000-2765.000=84.000
σ0.000
min2849.000-2765.000=84.000
max2849.000-2765.000=84.000
mean2.948-2.878=0.069
σ0.002-0.016=-0.014
min2.945-2.858=0.087
max2.950-2.891=0.059
policies=200
mean18521.091-18521.154=-0.063
σ0.462-0.461=0.001
min18520.686-18520.884=-0.198
max18521.734-18521.843=-0.109
mean8400.000
σ0.000
min8400.000
max8400.000
mean2849.000-2765.000=84.000
σ0.000
min2849.000-2765.000=84.000
max2849.000-2765.000=84.000
mean29.233-28.953=0.280
σ0.541-0.035=0.506
min28.756-28.916=-0.160
max29.757-28.995=0.763