Compare commits

Home / Compare 89816b4d .. ce1cdc1a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.264=0.000
σ0.055-0.054=0.002
min35.238-35.239=-0.001
max35.421-35.416=0.005
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.085-0.086=-0.000
σ0.003-0.004=-0.000
min0.083-0.083=0.000
max0.092-0.092=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=-0.000
σ0.004-0.002=0.001
min23.764-23.766=-0.002
max23.775-23.774=0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.066-0.069=-0.002
σ0.005-0.003=0.001
min0.062-0.066=-0.005
max0.074-0.075=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.485=0.001
σ0.366-0.364=0.002
min1755.913-1755.910=0.003
max1757.072-1757.063=0.009
mean1650.450-1657.650=-7.200
σ642.861-642.253=0.608
min625.000-630.000=-5.000
max2834.000-2794.000=40.000
mean2.326-2.371=-0.046
σ0.068-0.137=-0.068
min2.239-2.188=0.051
max2.467-2.789=-0.322

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.707-324.712=-0.005
σ0.053-0.058=-0.005
min324.613-324.608=0.005
max324.735-324.742=-0.007
mean2834.000-2794.000=40.000
σ0.000
min2834.000-2794.000=40.000
max2834.000-2794.000=40.000
mean0.422-0.435=-0.013
σ0.000-0.011=-0.010
min0.422-0.423=-0.001
max0.423-0.447=-0.024
iters=5
new-facts=1
prior-facts=6402
mean1985.262-1985.263=-0.002
σ0.014-0.011=0.003
min1985.243-1985.245=-0.002
max1985.278-1985.273=0.004
mean2834.000-2794.000=40.000
σ0.000
min2834.000-2794.000=40.000
max2834.000-2794.000=40.000
mean2.593-2.574=0.020
σ0.156-0.044=0.112
min2.384-2.536=-0.152
max2.809-2.648=0.161
iters=5
new-facts=6402
prior-facts=1
mean4808.862-4808.778=0.084
σ7.677-7.739=-0.061
min4805.402-4804.857=0.545
max4822.596-4822.612=-0.017
mean2834.000-2794.000=40.000
σ0.000
min2834.000-2794.000=40.000
max2834.000-2794.000=40.000
mean8.934-8.680=0.254
σ0.120-0.364=-0.245
min8.829-8.106=0.723
max9.112-9.061=0.051
iters=5
new-facts=6402
prior-facts=6402
mean4996.411-4996.471=-0.060
σ0.133-0.010=0.124
min4996.173-4996.462=-0.289
max4996.480-4996.483=-0.004
mean3089.200-3066.000=23.200
σ258.605-242.328=16.277
min2834.000-2794.000=40.000
max3351.000-3415.000=-64.000
mean8.906-8.663=0.244
σ0.389-0.165=0.224
min8.479-8.440=0.039
max9.491-8.862=0.629

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.922-0.976=-0.054
σ0.012-0.144=-0.133
min0.912-0.907=0.005
max0.941-1.234=-0.293

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.969-462.971=-0.002
σ574.246-574.250=-0.004
min175.841-175.836=0.005
max1324.339-1324.346=-0.008
mean86.250
σ8.500
min82.000
max99.000
mean2834.000-2794.000=40.000
σ0.000
min2834.000-2794.000=40.000
max2834.000-2794.000=40.000
mean0.432-0.426=0.006
σ0.300-0.290=0.010
min0.279-0.276=0.002
max0.883-0.862=0.021
policies=20
mean1758.722-1758.688=0.034
σ0.340-0.353=-0.013
min1758.512-1758.441=0.071
max1759.228-1759.211=0.017
mean820.000
σ0.000
min820.000
max820.000
mean2834.000-2794.000=40.000
σ0.000
min2834.000-2794.000=40.000
max2834.000-2794.000=40.000
mean2.788-2.819=-0.031
σ0.006-0.079=-0.072
min2.780-2.766=0.014
max2.794-2.936=-0.142
policies=200
mean17593.346-17592.375=0.971
σ0.701-0.560=0.141
min17592.377-17591.974=0.403
max17593.921-17593.198=0.722
mean8200.000
σ0.000
min8200.000
max8200.000
mean2834.000-2794.000=40.000
σ0.000
min2834.000-2794.000=40.000
max2834.000-2794.000=40.000
mean27.860-27.403=0.457
σ0.399-0.080=0.319
min27.428-27.314=0.114
max28.360-27.504=0.855