Compare commits

Home / Compare 0dfff9e7 .. 96b54561

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.729-70.730=-0.001
σ0.051-0.053=-0.002
min70.696-70.698=-0.002
max70.869-70.877=-0.007
mean415.000
σ0.000
min415.000
max415.000
mean0.161-0.161=0.000
σ0.003-0.004=-0.000
min0.157-0.155=0.002
max0.167-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.445-21.445=-0.000
σ0.002-0.002=-0.000
min21.443-21.442=0.001
max21.448-21.449=-0.001
mean415.000-415.800=-0.800
σ0.000-0.422=-0.422
min415.000
max415.000-416.000=-1.000
mean0.064-0.065=-0.001
σ0.004-0.002=0.001
min0.059-0.064=-0.004
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.286-1755.284=0.002
σ0.361-0.359=0.002
min1754.726-1754.717=0.009
max1755.879-1755.868=0.012
mean1671.250-1654.550=16.700
σ641.665-634.022=7.643
min630.000-622.000=8.000
max2731.000-2848.000=-117.000
mean2.860-2.817=0.043
σ0.184-0.157=0.027
min2.546-2.458=0.088
max3.359-3.016=0.343

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean274.369-274.364=0.004
σ0.004-0.006=-0.003
min274.363-274.360=0.004
max274.372-274.375=-0.003
mean2731.000-2848.000=-117.000
σ0.000
min2731.000-2848.000=-117.000
max2731.000-2848.000=-117.000
mean0.383-0.382=0.001
σ0.005-0.004=0.001
min0.380-0.375=0.005
max0.391-0.384=0.007
iters=5
new-facts=1
prior-facts=6402
mean1934.751-1934.759=-0.008
σ0.013-0.007=0.006
min1934.734-1934.751=-0.017
max1934.765-1934.770=-0.004
mean2731.000-2848.000=-117.000
σ0.000
min2731.000-2848.000=-117.000
max2731.000-2848.000=-117.000
mean2.964-3.091=-0.127
σ0.197-0.304=-0.107
min2.713-2.856=-0.143
max3.165-3.622=-0.457
iters=5
new-facts=6402
prior-facts=1
mean4755.504-4755.472=0.032
σ0.906-0.895=0.011
min4755.011-4755.037=-0.027
max4757.121-4757.073=0.048
mean2731.000-2848.000=-117.000
σ0.000
min2731.000-2848.000=-117.000
max2731.000-2848.000=-117.000
mean8.676-8.626=0.050
σ0.351-0.501=-0.150
min8.311-7.740=0.571
max9.052-8.956=0.095
iters=5
new-facts=6402
prior-facts=6402
mean4945.914-4945.983=-0.069
σ0.150-0.022=0.127
min4945.648-4945.953=-0.305
max4946.012-4946.007=0.005
mean2988.800-3069.600=-80.800
σ232.396-232.960=-0.564
min2731.000-2848.000=-117.000
max3320.000-3406.000=-86.000
mean8.611-8.545=0.066
σ0.177-0.135=0.041
min8.408-8.410=-0.002
max8.826-8.724=0.102

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.992-0.996=-0.004
σ0.138-0.139=-0.002
min0.928-0.931=-0.003
max1.238-1.246=-0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.842-472.840=0.002
σ574.923-574.924=-0.001
min185.370-185.368=0.001
max1335.227-1335.226=0.001
mean88.250
σ8.500
min84.000
max101.000
mean2731.000-2848.000=-117.000
σ0.000
min2731.000-2848.000=-117.000
max2731.000-2848.000=-117.000
mean0.550-0.456=0.095
σ0.524-0.304=0.220
min0.286-0.303=-0.017
max1.337-0.912=0.425
policies=20
mean1853.994-1853.993=0.001
σ0.368-0.363=0.005
min1853.747-1853.724=0.023
max1854.539-1854.521=0.018
mean840.000
σ0.000
min840.000
max840.000
mean2731.000-2848.000=-117.000
σ0.000
min2731.000-2848.000=-117.000
max2731.000-2848.000=-117.000
mean2.861-2.963=-0.102
σ0.033-0.012=0.022
min2.832-2.950=-0.118
max2.908-2.977=-0.069
policies=200
mean18546.721-18546.518=0.203
σ0.484-0.432=0.052
min18546.464-18546.129=0.335
max18547.447-18547.134=0.313
mean8400.000
σ0.000
min8400.000
max8400.000
mean2731.000-2848.000=-117.000
σ0.000
min2731.000-2848.000=-117.000
max2731.000-2848.000=-117.000
mean28.734-29.306=-0.572
σ0.081-0.502=-0.421
min28.620-28.845=-0.225
max28.801-29.765=-0.964