Compare commits

Home / Compare a7d9aaef .. 4310012a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.618=-0.000
σ0.055-0.056=-0.000
min35.583-35.588=-0.005
max35.774-35.775=-0.001
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.086-0.085=0.000
σ0.003-0.003=0.000
min0.083-0.083=0.000
max0.092-0.090=0.002
cache=y
dps=1
iters=10
policies=100
mean24.046-24.047=-0.001
σ0.002-0.003=-0.001
min24.042-24.043=-0.001
max24.050-24.050=-0.000
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.066-0.069=-0.003
σ0.002-0.003=-0.001
min0.062-0.066=-0.005
max0.068-0.075=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.489-1756.491=-0.003
σ0.365-0.365=0.000
min1755.914-1755.916=-0.002
max1757.081-1757.078=0.003
mean1638.300-1628.500=9.800
σ628.471-593.143=35.328
min658.000-660.000=-2.000
max2829.000-2426.000=403.000
mean2.327-2.338=-0.011
σ0.058-0.079=-0.021
min2.244-2.243=0.001
max2.478-2.511=-0.033

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.741-324.770=-0.029
σ0.045-0.042=0.003
min324.662-324.695=-0.034
max324.769-324.794=-0.025
mean2829.000-2426.000=403.000
σ0.000
min2829.000-2426.000=403.000
max2829.000-2426.000=403.000
mean0.436-0.425=0.011
σ0.013-0.001=0.012
min0.422-0.423=-0.001
max0.450-0.426=0.025
iters=5
new-facts=1
prior-facts=6402
mean1985.328-1985.326=0.002
σ0.018-0.016=0.003
min1985.297-1985.299=-0.002
max1985.342-1985.339=0.003
mean2829.000-2426.000=403.000
σ0.000
min2829.000-2426.000=403.000
max2829.000-2426.000=403.000
mean2.608-2.550=0.058
σ0.075-0.147=-0.072
min2.543-2.304=0.240
max2.726-2.689=0.037
iters=5
new-facts=6402
prior-facts=1
mean4808.969-4809.097=-0.128
σ7.760-7.672=0.089
min4805.056-4805.618=-0.562
max4822.844-4822.821=0.023
mean2829.000-2426.000=403.000
σ0.000
min2829.000-2426.000=403.000
max2829.000-2426.000=403.000
mean8.859-8.960=-0.100
σ0.120-0.152=-0.031
min8.702-8.718=-0.016
max8.956-9.125=-0.170
iters=5
new-facts=6402
prior-facts=6402
mean4996.622-4996.623=-0.002
σ0.021-0.027=-0.005
min4996.603-4996.582=0.021
max4996.649-4996.644=0.004
mean3021.000-2971.800=49.200
σ261.904-289.790=-27.886
min2829.000-2583.000=246.000
max3435.000-3322.000=113.000
mean8.482-8.620=-0.137
σ0.042-0.136=-0.093
min8.424-8.482=-0.058
max8.525-8.828=-0.304

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.974-1.449=-0.475
σ0.067-0.169=-0.103
min0.914-1.227=-0.313
max1.046-1.666=-0.620

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.209-463.206=0.004
σ574.772-574.771=0.001
min175.812-175.818=-0.006
max1325.368-1325.363=0.005
mean86.250
σ8.500
min82.000
max99.000
mean2829.000-2426.000=403.000
σ0.000
min2829.000-2426.000=403.000
max2829.000-2426.000=403.000
mean0.430-0.532=-0.103
σ0.298-0.514=-0.216
min0.277-0.271=0.006
max0.877-1.304=-0.427
policies=20
mean1758.507-1758.504=0.003
σ0.352-0.348=0.004
min1758.266-1758.263=0.004
max1759.028-1759.019=0.009
mean820.000
σ0.000
min820.000
max820.000
mean2829.000-2426.000=403.000
σ0.000
min2829.000-2426.000=403.000
max2829.000-2426.000=403.000
mean2.797-2.732=0.065
σ0.009-0.039=-0.030
min2.784-2.701=0.083
max2.803-2.789=0.015
policies=200
mean17592.056-17592.044=0.012
σ0.449-0.627=-0.178
min17591.555-17591.705=-0.150
max17592.646-17592.983=-0.337
mean8200.000
σ0.000
min8200.000
max8200.000
mean2829.000-2426.000=403.000
σ0.000
min2829.000-2426.000=403.000
max2829.000-2426.000=403.000
mean27.953-27.519=0.433
σ0.372-0.216=0.156
min27.599-27.207=0.392
max28.348-27.695=0.653