Compare commits

Home / Compare ce1cdc1a .. aa7a7933

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.262-35.264=-0.002
σ0.052-0.055=-0.003
min35.237-35.238=-0.001
max35.409-35.421=-0.012
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.082-0.085=-0.003
σ0.005-0.003=0.002
min0.077-0.083=-0.007
max0.090-0.092=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.771-23.769=0.002
σ0.002-0.004=-0.002
min23.768-23.764=0.004
max23.774-23.775=-0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.070-0.066=0.003
σ0.004-0.005=-0.001
min0.067-0.062=0.005
max0.077-0.074=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.487-1756.485=0.002
σ0.365-0.366=-0.000
min1755.910-1755.913=-0.003
max1757.077-1757.072=0.005
mean1640.450-1650.450=-10.000
σ625.620-642.861=-17.242
min651.000-625.000=26.000
max2836.000-2834.000=2.000
mean2.356-2.326=0.030
σ0.129-0.068=0.061
min2.250-2.239=0.012
max2.812-2.467=0.345

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.704-324.707=-0.002
σ0.056-0.053=0.004
min324.605-324.613=-0.008
max324.739-324.735=0.004
mean2836.000-2834.000=2.000
σ0.000
min2836.000-2834.000=2.000
max2836.000-2834.000=2.000
mean0.423-0.422=0.001
σ0.001-0.000=0.000
min0.423-0.422=0.001
max0.424-0.423=0.002
iters=5
new-facts=1
prior-facts=6402
mean1985.269-1985.262=0.007
σ0.008-0.014=-0.006
min1985.259-1985.243=0.016
max1985.281-1985.278=0.004
mean2836.000-2834.000=2.000
σ0.000
min2836.000-2834.000=2.000
max2836.000-2834.000=2.000
mean2.592-2.593=-0.001
σ0.067-0.156=-0.089
min2.535-2.384=0.151
max2.675-2.809=-0.134
iters=5
new-facts=6402
prior-facts=1
mean4808.858-4808.862=-0.004
σ7.683-7.677=0.006
min4805.394-4805.402=-0.008
max4822.601-4822.596=0.006
mean2836.000-2834.000=2.000
σ0.000
min2836.000-2834.000=2.000
max2836.000-2834.000=2.000
mean8.824-8.934=-0.110
σ0.285-0.120=0.165
min8.344-8.829=-0.485
max9.060-9.112=-0.052
iters=5
new-facts=6402
prior-facts=6402
mean4996.467-4996.411=0.056
σ0.018-0.133=-0.115
min4996.449-4996.173=0.276
max4996.494-4996.480=0.015
mean3067.400-3089.200=-21.800
σ219.865-258.605=-38.740
min2836.000-2834.000=2.000
max3391.000-3351.000=40.000
mean8.683-8.906=-0.224
σ0.165-0.389=-0.223
min8.509-8.479=0.029
max8.879-9.491=-0.612

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.980-0.922=0.057
σ0.069-0.012=0.058
min0.916-0.912=0.004
max1.060-0.941=0.118

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.966-462.969=-0.003
σ574.255-574.246=0.009
min175.832-175.841=-0.009
max1324.349-1324.339=0.010
mean86.250
σ8.500
min82.000
max99.000
mean2836.000-2834.000=2.000
σ0.000
min2836.000-2834.000=2.000
max2836.000-2834.000=2.000
mean0.429-0.432=-0.004
σ0.297-0.300=-0.003
min0.279-0.279=0.000
max0.875-0.883=-0.008
policies=20
mean1758.687-1758.722=-0.035
σ0.353-0.340=0.013
min1758.443-1758.512=-0.069
max1759.210-1759.228=-0.019
mean820.000
σ0.000
min820.000
max820.000
mean2836.000-2834.000=2.000
σ0.000
min2836.000-2834.000=2.000
max2836.000-2834.000=2.000
mean2.788-2.788=0.000
σ0.018-0.006=0.012
min2.770-2.780=-0.010
max2.812-2.794=0.018
policies=200
mean17593.266-17593.346=-0.080
σ0.589-0.701=-0.112
min17592.439-17592.377=0.062
max17593.721-17593.921=-0.199
mean8200.000
σ0.000
min8200.000
max8200.000
mean2836.000-2834.000=2.000
σ0.000
min2836.000-2834.000=2.000
max2836.000-2834.000=2.000
mean27.835-27.860=-0.025
σ0.443-0.399=0.044
min27.348-27.428=-0.080
max28.333-28.360=-0.027