Compare commits

Home / Compare 632113cb .. 8a0de1e9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.225-35.224=0.001
σ0.055-0.055=0.000
min35.193-35.199=-0.006
max35.380-35.379=0.001
mean417.000-413.900=3.100
σ0.000-0.316=-0.316
min417.000-413.000=4.000
max417.000-414.000=3.000
mean0.086-0.081=0.006
σ0.004-0.005=-0.001
min0.083-0.076=0.006
max0.093-0.090=0.004
cache=y
dps=1
iters=10
policies=100
mean23.754-23.755=-0.001
σ0.003-0.003=0.000
min23.750-23.751=-0.000
max23.760-23.760=-0.000
mean417.000-414.700=2.300
σ0.000-0.483=-0.483
min417.000-414.000=3.000
max417.000-415.000=2.000
mean0.064-0.066=-0.002
σ0.004-0.004=0.000
min0.061-0.062=-0.001
max0.075-0.075=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.357-1756.359=-0.003
σ0.367-0.367=-0.000
min1755.781-1755.783=-0.002
max1756.953-1756.951=0.002
mean1654.250-1661.600=-7.350
σ641.952-621.821=20.131
min630.000
max2833.000-2501.000=332.000
mean2.354-2.344=0.010
σ0.119-0.119=0.001
min2.203-2.245=-0.042
max2.713-2.776=-0.063

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.593-324.569=0.024
σ0.019-0.052=-0.033
min324.559-324.477=0.082
max324.604-324.604=0.001
mean2833.000-2501.000=332.000
σ0.000
min2833.000-2501.000=332.000
max2833.000-2501.000=332.000
mean0.426-0.425=0.001
σ0.002-0.001=0.001
min0.423-0.424=-0.001
max0.428-0.425=0.003
iters=5
new-facts=1
prior-facts=6402
mean1985.127-1985.133=-0.007
σ0.013-0.007=0.007
min1985.111-1985.122=-0.011
max1985.139-1985.140=-0.000
mean2833.000-2501.000=332.000
σ0.000
min2833.000-2501.000=332.000
max2833.000-2501.000=332.000
mean2.683-2.627=0.056
σ0.177-0.088=0.089
min2.526-2.562=-0.035
max2.963-2.770=0.193
iters=5
new-facts=6402
prior-facts=1
mean4808.730-4808.672=0.059
σ7.674-7.703=-0.029
min4805.256-4804.737=0.519
max4822.459-4822.442=0.017
mean2833.000-2501.000=332.000
σ0.000
min2833.000-2501.000=332.000
max2833.000-2501.000=332.000
mean8.910-8.548=0.362
σ0.137-0.594=-0.457
min8.737-7.713=1.023
max9.067-9.236=-0.169
iters=5
new-facts=6402
prior-facts=6402
mean4996.328-4996.338=-0.010
σ0.026-0.016=0.009
min4996.293-4996.317=-0.024
max4996.358-4996.356=0.003
mean3062.000-2913.000=149.000
σ306.304-394.856=-88.553
min2833.000-2501.000=332.000
max3536.000-3440.000=96.000
mean8.585-8.506=0.078
σ0.156-0.035=0.121
min8.442-8.451=-0.009
max8.801-8.539=0.263

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.012-1.741=-0.729
σ0.137-0.146=-0.009
min0.919-1.491=-0.572
max1.236-1.869=-0.634

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.966-462.934=0.032
σ574.253-574.244=0.009
min175.827-175.809=0.018
max1324.346-1324.300=0.046
mean86.250
σ8.500
min82.000
max99.000
mean2833.000-2501.000=332.000
σ0.000
min2833.000-2501.000=332.000
max2833.000-2501.000=332.000
mean0.435-0.543=-0.108
σ0.304-0.539=-0.235
min0.280-0.272=0.008
max0.890-1.352=-0.461
policies=20
mean1758.617-1758.406=0.210
σ0.343-0.350=-0.007
min1758.377-1758.170=0.207
max1759.123-1758.925=0.198
mean820.000
σ0.000
min820.000
max820.000
mean2833.000-2501.000=332.000
σ0.000
min2833.000-2501.000=332.000
max2833.000-2501.000=332.000
mean2.800-2.728=0.072
σ0.004-0.003=0.001
min2.797-2.724=0.072
max2.806-2.731=0.075
policies=200
mean17592.339-17591.336=1.003
σ0.657-0.391=0.266
min17591.438-17591.028=0.410
max17592.857-17591.909=0.948
mean8200.000
σ0.000
min8200.000
max8200.000
mean2833.000-2501.000=332.000
σ0.000
min2833.000-2501.000=332.000
max2833.000-2501.000=332.000
mean27.872-27.419=0.453
σ0.328-0.135=0.193
min27.585-27.326=0.259
max28.207-27.613=0.594