Compare commits

Home / Compare 51c549ed .. 2e9d8ed5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.731-70.732=-0.001
σ0.052-0.053=-0.001
min70.700-70.698=0.002
max70.876-70.880=-0.004
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.162-0.160=0.002
σ0.004-0.003=0.001
min0.158-0.157=0.001
max0.171-0.165=0.006
cache=y
dps=1
iters=10
policies=100
mean21.446-21.447=-0.001
σ0.002-0.002=-0.000
min21.444-21.443=0.000
max21.450-21.451=-0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.064-0.065=-0.002
σ0.003-0.002=0.001
min0.060-0.064=-0.004
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.286-1755.286=0.000
σ0.359-0.360=-0.001
min1754.717-1754.723=-0.006
max1755.864-1755.869=-0.005
mean1657.350-1651.350=6.000
σ647.133-628.663=18.470
min627.000-621.000=6.000
max2857.000-2846.000=11.000
mean2.838-2.823=0.015
σ0.109-0.195=-0.085
min2.494-2.190=0.304
max2.974-3.025=-0.051

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean274.367-274.365=0.002
σ0.007-0.012=-0.005
min274.361-274.352=0.009
max274.379-274.381=-0.003
mean2857.000-2846.000=11.000
σ0.000
min2857.000-2846.000=11.000
max2857.000-2846.000=11.000
mean0.389-0.386=0.002
σ0.005-0.004=0.001
min0.384-0.384=0.001
max0.396-0.393=0.003
iters=5
new-facts=1
prior-facts=6402
mean1934.751-1934.753=-0.001
σ0.020-0.012=0.008
min1934.725-1934.734=-0.010
max1934.779-1934.763=0.016
mean2857.000-2846.000=11.000
σ0.000
min2857.000-2846.000=11.000
max2857.000-2846.000=11.000
mean3.071-2.989=0.082
σ0.108-0.095=0.012
min2.965-2.901=0.064
max3.237-3.144=0.093
iters=5
new-facts=6402
prior-facts=1
mean4755.513-4755.488=0.026
σ0.950-0.912=0.038
min4754.993-4754.956=0.037
max4757.208-4757.115=0.094
mean2857.000-2846.000=11.000
σ0.000
min2857.000-2846.000=11.000
max2857.000-2846.000=11.000
mean8.650-8.835=-0.185
σ0.530-0.405=0.124
min7.872-8.295=-0.423
max9.316-9.375=-0.059
iters=5
new-facts=6402
prior-facts=6402
mean4945.988-4945.988=-0.001
σ0.019-0.018=0.002
min4945.971-4945.969=0.003
max4946.013-4946.014=-0.001
mean3019.400-3014.800=4.600
σ183.768-188.985=-5.216
min2857.000-2846.000=11.000
max3305.000-3306.000=-1.000
mean8.506-8.526=-0.020
σ0.111-0.117=-0.006
min8.327-8.424=-0.096
max8.590-8.668=-0.078

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.027-1.022=0.005
σ0.137-0.143=-0.006
min0.937-0.924=0.013
max1.255-1.251=0.004

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.847-472.849=-0.002
σ574.923-574.934=-0.011
min185.372-185.369=0.003
max1335.231-1335.250=-0.019
mean88.250
σ8.500
min84.000
max101.000
mean2857.000-2846.000=11.000
σ0.000
min2857.000-2846.000=11.000
max2857.000-2846.000=11.000
mean0.447-0.487=-0.040
σ0.299-0.376=-0.076
min0.295-0.294=0.001
max0.896-1.051=-0.154
policies=20
mean1854.043-1853.999=0.044
σ0.376-0.380=-0.004
min1853.760-1853.718=0.042
max1854.587-1854.555=0.032
mean840.000
σ0.000
min840.000
max840.000
mean2857.000-2846.000=11.000
σ0.000
min2857.000-2846.000=11.000
max2857.000-2846.000=11.000
mean2.966-2.933=0.033
σ0.021-0.013=0.009
min2.940-2.915=0.025
max2.988-2.945=0.043
policies=200
mean18546.713-18546.749=-0.036
σ0.495-0.356=0.139
min18546.346-18546.488=-0.142
max18547.423-18547.274=0.149
mean8400.000
σ0.000
min8400.000
max8400.000
mean2857.000-2846.000=11.000
σ0.000
min2857.000-2846.000=11.000
max2857.000-2846.000=11.000
mean29.251-29.174=0.077
σ0.498-0.476=0.021
min28.786-28.680=0.105
max29.714-29.642=0.072