Compare commits

Home / Compare 751ea797 .. be3db1f5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.616=0.001
σ0.056-0.055=0.000
min35.587-35.584=0.003
max35.775-35.772=0.003
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.086-0.082=0.004
σ0.005-0.005=-0.001
min0.083-0.076=0.007
max0.095-0.089=0.006
cache=y
dps=1
iters=10
policies=100
mean24.047-24.046=0.001
σ0.003-0.002=0.001
min24.042-24.043=-0.000
max24.052-24.049=0.003
mean415.000-416.600=-1.600
σ0.000-0.516=-0.516
min415.000-416.000=-1.000
max415.000-417.000=-2.000
mean0.067-0.066=0.001
σ0.005-0.005=0.000
min0.062-0.061=0.001
max0.077-0.075=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.490=0.000
σ0.365-0.364=0.002
min1755.915-1755.914=0.001
max1757.078-1757.078=-0.000
mean1628.050-1653.650=-25.600
σ593.693-628.929=-35.236
min660.000-623.000=37.000
max2428.000-2708.000=-280.000
mean2.340-2.346=-0.006
σ0.090-0.111=-0.021
min2.176-2.209=-0.033
max2.528-2.635=-0.107

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.771-324.760=0.011
σ0.037-0.058=-0.021
min324.705-324.657=0.048
max324.790-324.791=-0.001
mean2428.000-2708.000=-280.000
σ0.000
min2428.000-2708.000=-280.000
max2428.000-2708.000=-280.000
mean0.419-0.430=-0.011
σ0.003-0.008=-0.006
min0.415-0.424=-0.008
max0.421-0.443=-0.022
iters=5
new-facts=1
prior-facts=6402
mean1985.324-1985.319=0.006
σ0.013-0.015=-0.002
min1985.309-1985.301=0.008
max1985.336-1985.336=-0.001
mean2428.000-2708.000=-280.000
σ0.000
min2428.000-2708.000=-280.000
max2428.000-2708.000=-280.000
mean2.630-2.591=0.039
σ0.141-0.081=0.060
min2.531-2.512=0.020
max2.875-2.704=0.171
iters=5
new-facts=6402
prior-facts=1
mean4808.879-4808.994=-0.116
σ7.787-7.703=0.084
min4804.637-4804.996=-0.359
max4822.786-4822.762=0.024
mean2428.000-2708.000=-280.000
σ0.000
min2428.000-2708.000=-280.000
max2428.000-2708.000=-280.000
mean9.028-8.723=0.304
σ0.244-0.427=-0.183
min8.594-8.111=0.483
max9.173-9.082=0.092
iters=5
new-facts=6402
prior-facts=6402
mean4996.627-4996.629=-0.002
σ0.016-0.021=-0.005
min4996.606-4996.604=0.001
max4996.643-4996.653=-0.009
mean2953.400-2981.800=-28.400
σ439.441-319.080=120.361
min2434.000-2708.000=-274.000
max3545.000-3454.000=91.000
mean8.576-8.595=-0.018
σ0.214-0.160=0.054
min8.369-8.484=-0.115
max8.866-8.877=-0.011

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.782-0.972=0.810
σ0.075-0.069=0.006
min1.660-0.913=0.747
max1.842-1.049=0.793

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.200-463.216=-0.016
σ574.760-574.771=-0.011
min175.817-175.815=0.003
max1325.339-1325.371=-0.032
mean86.250
σ8.500
min82.000
max99.000
mean2428.000-2708.000=-280.000
σ0.000
min2428.000-2708.000=-280.000
max2428.000-2708.000=-280.000
mean0.550-0.547=0.002
σ0.548-0.550=-0.002
min0.273-0.269=0.005
max1.372-1.373=-0.001
policies=20
mean1758.476-1758.502=-0.026
σ0.341-0.336=0.005
min1758.254-1758.292=-0.038
max1758.982-1759.003=-0.021
mean820.000
σ0.000
min820.000
max820.000
mean2428.000-2708.000=-280.000
σ0.000
min2428.000-2708.000=-280.000
max2428.000-2708.000=-280.000
mean2.721-2.726=-0.004
σ0.026-0.026=0.000
min2.692-2.699=-0.007
max2.755-2.760=-0.005
policies=200
mean17592.152-17592.020=0.132
σ0.515-0.555=-0.040
min17591.871-17591.644=0.227
max17592.923-17592.841=0.082
mean8200.000
σ0.000
min8200.000
max8200.000
mean2428.000-2708.000=-280.000
σ0.000
min2428.000-2708.000=-280.000
max2428.000-2708.000=-280.000
mean27.541-27.645=-0.105
σ0.151-0.233=-0.082
min27.347-27.411=-0.064
max27.672-27.900=-0.229