Compare commits

Home / Compare 6a843fcb .. 842d25e6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.262=0.001
σ0.054-0.053=0.001
min35.234-35.233=0.001
max35.416-35.412=0.004
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.085-0.083=0.002
σ0.004-0.007=-0.003
min0.080-0.076=0.004
max0.092-0.094=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.003-0.004=-0.001
min23.766-23.761=0.005
max23.774-23.776=-0.002
mean412.700-417.000=-4.300
σ0.483-0.000=0.483
min412.000-417.000=-5.000
max413.000-417.000=-4.000
mean0.068-0.065=0.003
σ0.003-0.004=-0.001
min0.066-0.061=0.005
max0.075-0.073=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.472-1718.553=37.919
σ0.366-169.693=-169.328
min1755.897-997.607=758.289
max1757.064-1757.072=-0.008
mean1654.000-1610.900=43.100
σ644.000-612.090=31.909
min626.000-680.000=-54.000
max2844.000-2464.000=380.000
mean2.368-2.325=0.043
σ0.087-0.235=-0.149
min2.278-1.462=0.816
max2.569-2.653=-0.084

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.688-324.705=-0.017
σ0.053-0.049=0.004
min324.593-324.617=-0.024
max324.719-324.734=-0.015
mean2844.000-2464.000=380.000
σ0.000
min2844.000-2464.000=380.000
max2844.000-2464.000=380.000
mean0.425-0.424=0.001
σ0.002-0.002=-0.000
min0.424-0.422=0.001
max0.428-0.427=0.001
iters=5
new-facts=1
prior-facts=6402
mean1985.249-1985.258=-0.009
σ0.016-0.022=-0.006
min1985.228-1985.229=-0.000
max1985.263-1985.281=-0.018
mean2844.000-2464.000=380.000
σ0.000
min2844.000-2464.000=380.000
max2844.000-2464.000=380.000
mean2.671-2.603=0.068
σ0.156-0.131=0.025
min2.535-2.469=0.066
max2.851-2.751=0.100
iters=5
new-facts=6402
prior-facts=1
mean4808.856-4808.869=-0.013
σ7.673-7.603=0.070
min4805.322-4805.396=-0.074
max4822.581-4822.469=0.112
mean2844.000-2464.000=380.000
σ0.000
min2844.000-2464.000=380.000
max2844.000-2464.000=380.000
mean8.883-8.812=0.072
σ0.177-0.363=-0.186
min8.635-8.175=0.459
max9.050-9.054=-0.005
iters=5
new-facts=6402
prior-facts=6402
mean4996.444-4996.397=0.047
σ0.021-0.159=-0.138
min4996.417-4996.113=0.304
max4996.464-4996.479=-0.015
mean3067.000-2926.800=140.200
σ297.220-405.867=-108.647
min2844.000-2479.000=365.000
max3529.000-3468.000=61.000
mean8.523-8.493=0.031
σ0.115-0.114=0.002
min8.424-8.402=0.022
max8.723-8.680=0.043

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.117-1.657=-0.540
σ0.245-0.314=-0.069
min0.907-1.104=-0.197
max1.488-1.868=-0.380

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.949-462.944=0.005
σ574.248-574.247=0.001
min175.816-175.817=-0.001
max1324.320-1324.314=0.007
mean86.250
σ8.500
min82.000
max99.000
mean2844.000-2464.000=380.000
σ0.000
min2844.000-2464.000=380.000
max2844.000-2464.000=380.000
mean0.430-0.552=-0.123
σ0.295-0.553=-0.258
min0.278-0.271=0.007
max0.872-1.382=-0.510
policies=20
mean1758.486-1758.501=-0.015
σ0.352-0.351=0.002
min1758.253-1758.262=-0.009
max1759.009-1759.021=-0.012
mean820.000
σ0.000
min820.000
max820.000
mean2844.000-2464.000=380.000
σ0.000
min2844.000-2464.000=380.000
max2844.000-2464.000=380.000
mean2.781-2.726=0.055
σ0.008-0.012=-0.004
min2.774-2.710=0.064
max2.790-2.737=0.053
policies=200
mean17591.100-17592.351=-1.251
σ0.434-0.413=0.021
min17590.517-17592.074=-1.557
max17591.434-17592.959=-1.525
mean8200.000
σ0.000
min8200.000
max8200.000
mean2844.000-2464.000=380.000
σ0.000
min2844.000-2464.000=380.000
max2844.000-2464.000=380.000
mean27.949-27.395=0.553
σ0.298-0.148=0.150
min27.579-27.242=0.337
max28.260-27.559=0.701