Compare commits

Home / Compare 39fef913 .. 99065824

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.244=-0.001
σ0.054-0.053=0.000
min35.216-35.219=-0.003
max35.395-35.395=-0.000
mean412.700-412.900=-0.200
σ0.483-0.316=0.167
min412.000
max413.000
mean0.083-0.085=-0.002
σ0.004-0.003=0.001
min0.077-0.082=-0.005
max0.091-0.091=0.000
cache=y
dps=1
iters=10
policies=100
mean23.768-23.770=-0.001
σ0.003-0.003=-0.001
min23.764-23.764=-0.000
max23.772-23.775=-0.003
mean413.000
σ0.000
min413.000
max413.000
mean0.067-0.065=0.002
σ0.004-0.002=0.001
min0.060-0.062=-0.001
max0.075-0.068=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.364-1756.364=0.000
σ0.366-0.365=0.001
min1755.787-1755.787=0.000
max1756.952-1756.949=0.003
mean1642.450-1656.050=-13.600
σ644.105-639.478=4.627
min621.000-676.000=-55.000
max2729.000-2845.000=-116.000
mean2.342-2.324=0.018
σ0.126-0.079=0.047
min2.075-2.246=-0.171
max2.605-2.515=0.090

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.591-324.581=0.011
σ0.029-0.051=-0.022
min324.539-324.490=0.049
max324.608-324.612=-0.004
mean2729.000-2845.000=-116.000
σ0.000
min2729.000-2845.000=-116.000
max2729.000-2845.000=-116.000
mean0.421-0.423=-0.002
σ0.002-0.001=0.000
min0.419-0.421=-0.002
max0.423-0.424=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1985.134-1985.148=-0.013
σ0.027-0.012=0.015
min1985.105-1985.132=-0.027
max1985.162-1985.164=-0.002
mean2729.000-2845.000=-116.000
σ0.000
min2729.000-2845.000=-116.000
max2729.000-2845.000=-116.000
mean2.646-2.590=0.056
σ0.182-0.053=0.129
min2.441-2.539=-0.098
max2.895-2.658=0.236
iters=5
new-facts=6402
prior-facts=1
mean4808.645-4808.455=0.190
σ7.725-7.839=-0.114
min4804.672-4804.354=0.318
max4822.452-4822.453=-0.000
mean2729.000-2845.000=-116.000
σ0.000
min2729.000-2845.000=-116.000
max2729.000-2845.000=-116.000
mean8.651-8.672=-0.021
σ0.481-0.852=-0.370
min7.812-7.655=0.157
max8.973-9.873=-0.899
iters=5
new-facts=6402
prior-facts=6402
mean4996.347-4996.272=0.075
σ0.013-0.149=-0.136
min4996.327-4996.008=0.319
max4996.357-4996.366=-0.010
mean3020.800-3049.000=-28.200
σ342.092-215.781=126.311
min2729.000-2845.000=-116.000
max3522.000-3363.000=159.000
mean8.496-8.640=-0.144
σ0.152-0.242=-0.090
min8.400-8.397=0.003
max8.764-9.011=-0.247

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.978-0.977=0.001
σ0.065-0.069=-0.005
min0.924-0.915=0.009
max1.052-1.054=-0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.968-462.971=-0.003
σ574.282-574.256=0.027
min175.819-175.837=-0.019
max1324.391-1324.355=0.037
mean86.250
σ8.500
min82.000
max99.000
mean2729.000-2845.000=-116.000
σ0.000
min2729.000-2845.000=-116.000
max2729.000-2845.000=-116.000
mean0.582-0.430=0.151
σ0.609-0.294=0.315
min0.274-0.282=-0.008
max1.495-0.872=0.623
policies=20
mean1758.522-1758.714=-0.192
σ0.325-0.350=-0.025
min1758.308-1758.474=-0.166
max1759.004-1759.232=-0.229
mean820.000
σ0.000
min820.000
max820.000
mean2729.000-2845.000=-116.000
σ0.000
min2729.000-2845.000=-116.000
max2729.000-2845.000=-116.000
mean2.705-2.800=-0.096
σ0.024-0.038=-0.014
min2.683-2.776=-0.093
max2.732-2.857=-0.125
policies=200
mean17592.429-17593.364=-0.935
σ0.462-0.505=-0.043
min17592.158-17592.733=-0.576
max17593.120-17593.812=-0.692
mean8200.000
σ0.000
min8200.000
max8200.000
mean2729.000-2845.000=-116.000
σ0.000
min2729.000-2845.000=-116.000
max2729.000-2845.000=-116.000
mean27.385-27.868=-0.483
σ0.210-0.397=-0.186
min27.204-27.396=-0.192
max27.680-28.276=-0.596