Compare commits

Home / Compare a421d224 .. 4edc03a7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.242-35.245=-0.002
σ0.055-0.055=0.000
min35.212-35.218=-0.005
max35.397-35.399=-0.002
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.082-0.085=-0.004
σ0.006-0.004=0.002
min0.076-0.083=-0.006
max0.094-0.094=0.000
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=0.000
σ0.003-0.004=-0.001
min23.766-23.764=0.001
max23.774-23.776=-0.003
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.067-0.066=0.001
σ0.003-0.005=-0.001
min0.061-0.062=-0.001
max0.074-0.075=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.364=0.122
σ0.365-0.364=0.000
min1755.909-1755.788=0.122
max1757.070-1756.956=0.114
mean1655.400-1643.750=11.650
σ642.842-632.651=10.191
min629.000-626.000=3.000
max2838.000
mean2.344-2.333=0.012
σ0.076-0.096=-0.020
min2.241-2.250=-0.009
max2.540-2.595=-0.055

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.705-324.592=0.113
σ0.048-0.030=0.018
min324.621-324.539=0.081
max324.737-324.612=0.125
mean2838.000
σ0.000
min2838.000
max2838.000
mean0.423-0.424=-0.001
σ0.002-0.002=0.000
min0.421-0.422=-0.001
max0.426-0.426=0.000
iters=5
new-facts=1
prior-facts=6402
mean1985.272-1985.140=0.132
σ0.005-0.008=-0.004
min1985.265-1985.128=0.137
max1985.276-1985.147=0.129
mean2838.000
σ0.000
min2838.000
max2838.000
mean2.611-2.681=-0.069
σ0.062-0.116=-0.054
min2.546-2.580=-0.035
max2.694-2.863=-0.169
iters=5
new-facts=6402
prior-facts=1
mean4808.851-4808.735=0.116
σ7.676-7.673=0.002
min4805.390-4805.223=0.167
max4822.581-4822.461=0.120
mean2838.000
σ0.000
min2838.000
max2838.000
mean8.910-9.005=-0.094
σ0.111-0.135=-0.024
min8.799-8.853=-0.054
max9.056-9.159=-0.103
iters=5
new-facts=6402
prior-facts=6402
mean4996.321-4996.284=0.037
σ0.178-0.173=0.005
min4996.115-4995.976=0.139
max4996.467-4996.378=0.089
mean3056.800-3041.000=15.800
σ205.639-212.352=-6.714
min2838.000
max3358.000-3261.000=97.000
mean8.647-8.857=-0.210
σ0.258-0.148=0.110
min8.381-8.649=-0.268
max9.012-9.002=0.010

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.971-0.944=0.027
σ0.060-0.057=0.002
min0.922-0.912=0.010
max1.044-1.045=-0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.975-462.972=0.003
σ574.254-574.250=0.004
min175.841-175.841=-0.000
max1324.356-1324.347=0.009
mean86.250
σ8.500
min82.000
max99.000
mean2838.000
σ0.000
min2838.000
max2838.000
mean0.436-0.427=0.009
σ0.307-0.294=0.013
min0.280-0.279=0.001
max0.896-0.868=0.028
policies=20
mean1758.713-1758.683=0.030
σ0.351-0.346=0.005
min1758.472-1758.474=-0.002
max1759.231-1759.198=0.033
mean820.000
σ0.000
min820.000
max820.000
mean2838.000
σ0.000
min2838.000
max2838.000
mean2.783-2.783=-0.000
σ0.024-0.006=0.018
min2.752-2.776=-0.023
max2.809-2.788=0.021
policies=200
mean17593.315-17593.217=0.098
σ0.618-0.584=0.034
min17592.607-17592.388=0.219
max17593.892-17593.628=0.265
mean8200.000
σ0.000
min8200.000
max8200.000
mean2838.000
σ0.000
min2838.000
max2838.000
mean27.837-27.791=0.046
σ0.434-0.414=0.021
min27.293-27.446=-0.153
max28.223-28.294=-0.070