Compare commits

Home / Compare 161dd918 .. d3737f25

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.264=-0.001
σ0.054-0.051=0.003
min35.239-35.237=0.002
max35.414-35.409=0.006
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.084-0.085=-0.001
σ0.005-0.004=0.001
min0.077-0.077=0.000
max0.091-0.091=0.001
cache=y
dps=1
iters=10
policies=100
mean23.769-23.770=-0.000
σ0.003-0.005=-0.002
min23.764-23.764=-0.000
max23.774-23.777=-0.003
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.067-0.067=-0.001
σ0.003-0.004=-0.001
min0.060-0.061=-0.001
max0.074-0.074=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.471-1756.485=-0.014
σ0.366-0.366=0.000
min1755.894-1755.910=-0.016
max1757.065-1757.080=-0.014
mean1652.650-1656.400=-3.750
σ643.702-640.491=3.211
min627.000
max2840.000-2768.000=72.000
mean2.314-2.348=-0.034
σ0.074-0.089=-0.015
min2.152-2.252=-0.100
max2.457-2.539=-0.082

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.691-324.712=-0.021
σ0.056-0.030=0.026
min324.591-324.660=-0.068
max324.723-324.733=-0.009
mean2840.000-2768.000=72.000
σ0.000
min2840.000-2768.000=72.000
max2840.000-2768.000=72.000
mean0.424-0.422=0.003
σ0.003-0.001=0.002
min0.422-0.421=0.001
max0.429-0.423=0.006
iters=5
new-facts=1
prior-facts=6402
mean1985.239-1985.262=-0.023
σ0.014-0.016=-0.002
min1985.223-1985.243=-0.020
max1985.259-1985.281=-0.022
mean2840.000-2768.000=72.000
σ0.000
min2840.000-2768.000=72.000
max2840.000-2768.000=72.000
mean2.577-2.655=-0.077
σ0.090-0.106=-0.016
min2.468-2.555=-0.087
max2.697-2.808=-0.111
iters=5
new-facts=6402
prior-facts=1
mean4808.748-4808.882=-0.134
σ7.753-7.669=0.084
min4804.811-4805.392=-0.581
max4822.609-4822.601=0.008
mean2840.000-2768.000=72.000
σ0.000
min2840.000-2768.000=72.000
max2840.000-2768.000=72.000
mean8.687-9.064=-0.377
σ0.256-0.304=-0.048
min8.306-8.890=-0.584
max8.951-9.604=-0.653
iters=5
new-facts=6402
prior-facts=6402
mean4996.453-4996.460=-0.007
σ0.019-0.018=0.000
min4996.427-4996.433=-0.006
max4996.471-4996.475=-0.004
mean3031.600-3040.400=-8.800
σ263.215-331.509=-68.294
min2840.000-2768.000=72.000
max3448.000-3535.000=-87.000
mean8.483-8.533=-0.050
σ0.034-0.116=-0.082
min8.441-8.438=0.003
max8.534-8.728=-0.194

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.946-1.059=-0.113
σ0.055-0.242=-0.188
min0.913-0.914=-0.001
max1.041-1.482=-0.441

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.946-462.974=-0.028
σ574.247-574.255=-0.008
min175.817-175.839=-0.022
max1324.317-1324.357=-0.040
mean86.250
σ8.500
min82.000
max99.000
mean2840.000-2768.000=72.000
σ0.000
min2840.000-2768.000=72.000
max2840.000-2768.000=72.000
mean0.418-0.431=-0.012
σ0.273-0.299=-0.026
min0.281-0.279=0.002
max0.828-0.879=-0.052
policies=20
mean1758.493-1758.719=-0.227
σ0.349-0.354=-0.006
min1758.279-1758.492=-0.213
max1759.012-1759.246=-0.235
mean820.000
σ0.000
min820.000
max820.000
mean2840.000-2768.000=72.000
σ0.000
min2840.000-2768.000=72.000
max2840.000-2768.000=72.000
mean2.782-2.770=0.012
σ0.014-0.038=-0.024
min2.765-2.716=0.048
max2.799-2.804=-0.005
policies=200
mean17591.012-17592.405=-1.393
σ0.683-0.436=0.247
min17590.095-17592.089=-1.994
max17591.668-17593.048=-1.380
mean8200.000
σ0.000
min8200.000
max8200.000
mean2840.000-2768.000=72.000
σ0.000
min2840.000-2768.000=72.000
max2840.000-2768.000=72.000
mean27.828-27.417=0.412
σ0.381-0.148=0.234
min27.347-27.225=0.122
max28.226-27.585=0.641