Compare commits

Home / Compare 53247dc8 .. 08acf71e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.729-70.730=-0.001
σ0.046-0.044=0.002
min70.703-70.704=-0.001
max70.857-70.852=0.004
mean414.000
σ0.000
min414.000
max414.000
mean0.160-0.158=0.001
σ0.003-0.004=-0.001
min0.155-0.153=0.003
max0.164-0.166=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.446-21.445=0.001
σ0.002-0.003=-0.002
min21.444-21.441=0.003
max21.449-21.451=-0.003
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.065-0.065=-0.000
σ0.003-0.002=0.001
min0.063-0.063=-0.000
max0.073-0.070=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.529-1754.529=-0.001
σ0.361-0.361=0.001
min1753.954-1753.961=-0.006
max1755.132-1755.114=0.018
mean1659.350-1655.650=3.700
σ647.558-640.477=7.080
min628.000-639.000=-11.000
max2805.000-2846.000=-41.000
mean2.832-2.868=-0.036
σ0.180-0.137=0.043
min2.348-2.606=-0.258
max3.184-3.144=0.040

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.606-273.610=-0.005
σ0.009-0.006=0.002
min273.592-273.604=-0.012
max273.614-273.620=-0.006
mean2805.000-2846.000=-41.000
σ0.000
min2805.000-2846.000=-41.000
max2805.000-2846.000=-41.000
mean0.386-0.383=0.004
σ0.008-0.004=0.003
min0.380-0.381=-0.001
max0.399-0.390=0.009
iters=5
new-facts=1
prior-facts=6402
mean1933.999-1934.003=-0.004
σ0.006-0.009=-0.003
min1933.989-1933.991=-0.003
max1934.004-1934.017=-0.013
mean2805.000-2846.000=-41.000
σ0.000
min2805.000-2846.000=-41.000
max2805.000-2846.000=-41.000
mean3.103-2.978=0.125
σ0.157-0.130=0.027
min2.985-2.792=0.193
max3.352-3.150=0.201
iters=5
new-facts=6402
prior-facts=1
mean4754.774-4754.762=0.012
σ0.836-0.820=0.016
min4754.283-4754.298=-0.015
max4756.264-4756.226=0.038
mean2805.000-2846.000=-41.000
σ0.000
min2805.000-2846.000=-41.000
max2805.000-2846.000=-41.000
mean8.391-8.399=-0.008
σ0.455-0.386=0.069
min7.623-7.803=-0.180
max8.846-8.872=-0.026
iters=5
new-facts=6402
prior-facts=6402
mean4945.218-4945.224=-0.006
σ0.024-0.013=0.011
min4945.192-4945.214=-0.022
max4945.253-4945.242=0.011
mean3033.200-3065.200=-32.000
σ230.749-234.182=-3.433
min2805.000-2846.000=-41.000
max3351.000-3410.000=-59.000
mean8.532-8.509=0.023
σ0.159-0.102=0.057
min8.358-8.404=-0.045
max8.791-8.646=0.145

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.021-1.001=0.021
σ0.139-0.134=0.005
min0.931-0.938=-0.006
max1.256-1.241=0.015

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.842-472.843=-0.001
σ574.934-574.927=0.008
min185.368-185.373=-0.006
max1335.244-1335.233=0.010
mean88.250
σ8.500
min84.000
max101.000
mean2805.000-2846.000=-41.000
σ0.000
min2805.000-2846.000=-41.000
max2805.000-2846.000=-41.000
mean0.489-0.489=0.000
σ0.397-0.379=0.018
min0.286-0.296=-0.010
max1.084-1.057=0.027
policies=20
mean1853.977-1853.996=-0.020
σ0.355-0.373=-0.018
min1853.764-1853.721=0.043
max1854.504-1854.541=-0.037
mean840.000
σ0.000
min840.000
max840.000
mean2805.000-2846.000=-41.000
σ0.000
min2805.000-2846.000=-41.000
max2805.000-2846.000=-41.000
mean2.868-2.938=-0.070
σ0.010-0.014=-0.004
min2.854-2.922=-0.068
max2.875-2.955=-0.079
policies=200
mean18546.535-18546.718=-0.183
σ0.572-0.503=0.069
min18546.179-18546.416=-0.237
max18547.390-18547.470=-0.080
mean8400.000
σ0.000
min8400.000
max8400.000
mean2805.000-2846.000=-41.000
σ0.000
min2805.000-2846.000=-41.000
max2805.000-2846.000=-41.000
mean28.773-29.157=-0.384
σ0.031-0.442=-0.411
min28.742-28.774=-0.031
max28.808-29.744=-0.936