Compare commits

Home / Compare 97323145 .. 01e40718

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.566=-0.003
σ0.046-0.044=0.001
min70.542-70.539=0.003
max70.691-70.687=0.005
mean411.000-412.000=-1.000
σ0.000
min411.000-412.000=-1.000
max411.000-412.000=-1.000
mean0.159-0.160=-0.000
σ0.004-0.002=0.002
min0.151-0.157=-0.006
max0.165-0.164=0.001
cache=y
dps=1
iters=10
policies=100
mean21.291-21.288=0.003
σ0.011-0.003=0.009
min21.282-21.282=-0.000
max21.322-21.293=0.029
mean411.000-412.000=-1.000
σ0.000
min411.000-412.000=-1.000
max411.000-412.000=-1.000
mean0.064-0.065=-0.000
σ0.003-0.003=0.000
min0.060-0.062=-0.002
max0.072-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.372-1753.375=-0.003
σ0.359-0.361=-0.002
min1752.802-1752.803=-0.001
max1753.951-1753.958=-0.007
mean1651.250-1649.450=1.800
σ645.919-642.847=3.072
min632.000
max2883.000-2869.000=14.000
mean2.794-2.726=0.068
σ0.125-0.182=-0.058
min2.481-2.341=0.140
max3.015-2.996=0.019

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.759-271.733=0.027
σ0.004-0.005=-0.001
min271.755-271.727=0.028
max271.762-271.738=0.025
mean2883.000-2869.000=14.000
σ0.000
min2883.000-2869.000=14.000
max2883.000-2869.000=14.000
mean0.380-0.381=-0.001
σ0.006-0.008=-0.001
min0.376-0.374=0.001
max0.391-0.393=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.172-1932.176=-0.004
σ0.005-0.004=0.001
min1932.163-1932.172=-0.009
max1932.177-1932.181=-0.005
mean2883.000-2869.000=14.000
σ0.000
min2883.000-2869.000=14.000
max2883.000-2869.000=14.000
mean3.017-2.997=0.020
σ0.072-0.041=0.032
min2.957-2.939=0.019
max3.112-3.040=0.072
iters=5
new-facts=6402
prior-facts=1
mean4752.892-4752.943=-0.051
σ0.867-0.940=-0.073
min4752.462-4752.346=0.115
max4754.442-4754.599=-0.157
mean2883.000-2869.000=14.000
σ0.000
min2883.000-2869.000=14.000
max2883.000-2869.000=14.000
mean8.600-8.474=0.125
σ0.244-0.698=-0.454
min8.267-7.661=0.605
max8.848-9.344=-0.496
iters=5
new-facts=6402
prior-facts=6402
mean4943.377-4943.372=0.005
σ0.013-0.017=-0.004
min4943.359-4943.351=0.008
max4943.390-4943.389=0.000
mean3079.200-3076.800=2.400
σ213.579-222.748=-9.169
min2883.000-2869.000=14.000
max3400.000-3406.000=-6.000
mean8.538-8.587=-0.049
σ0.178-0.262=-0.084
min8.406-8.379=0.027
max8.841-9.041=-0.200

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.055-1.002=0.053
σ0.125-0.140=-0.015
min0.938-0.937=0.001
max1.245-1.252=-0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.863-467.869=-0.006
σ575.924-575.934=-0.011
min179.896-179.897=-0.002
max1331.748-1331.771=-0.023
mean86.250
σ8.500
min82.000
max99.000
mean2883.000-2869.000=14.000
σ0.000
min2883.000-2869.000=14.000
max2883.000-2869.000=14.000
mean0.442-0.442=-0.000
σ0.306-0.305=0.001
min0.286-0.285=0.001
max0.901-0.900=0.001
policies=20
mean1799.195-1799.191=0.004
σ0.370-0.378=-0.008
min1798.938-1798.934=0.003
max1799.741-1799.749=-0.009
mean820.000
σ0.000
min820.000
max820.000
mean2883.000-2869.000=14.000
σ0.000
min2883.000-2869.000=14.000
max2883.000-2869.000=14.000
mean2.876-2.878=-0.003
σ0.007-0.015=-0.008
min2.867-2.860=0.006
max2.882-2.891=-0.009
policies=200
mean17998.432-17998.558=-0.126
σ0.512-0.422=0.090
min17998.056-17998.257=-0.201
max17999.170-17999.184=-0.014
mean8200.000
σ0.000
min8200.000
max8200.000
mean2883.000-2869.000=14.000
σ0.000
min2883.000-2869.000=14.000
max2883.000-2869.000=14.000
mean28.582-28.641=-0.060
σ0.391-0.422=-0.031
min28.154-28.223=-0.069
max29.001-29.092=-0.091