Compare commits

Home / Compare d246aa57 .. 4b4d4499

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.618=-0.000
σ0.054-0.055=-0.001
min35.590-35.586=0.004
max35.770-35.773=-0.003
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.085-0.085=0.001
σ0.003-0.003=0.000
min0.082-0.082=0.001
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean24.048-24.046=0.001
σ0.003-0.003=-0.000
min24.044-24.044=-0.000
max24.051-24.053=-0.001
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.067-0.067=0.000
σ0.005-0.004=0.001
min0.061-0.061=-0.000
max0.076-0.073=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.490=0.001
σ0.365-0.364=0.001
min1755.916-1755.918=-0.002
max1757.085-1757.081=0.004
mean1645.650-1659.550=-13.900
σ640.550-639.153=1.397
min630.000-632.000=-2.000
max2823.000-2781.000=42.000
mean2.351-2.375=-0.024
σ0.067-0.127=-0.060
min2.270-2.251=0.019
max2.484-2.844=-0.359

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.736-324.759=-0.023
σ0.043-0.053=-0.010
min324.661-324.664=-0.004
max324.771-324.788=-0.017
mean2823.000-2781.000=42.000
σ0.000
min2823.000-2781.000=42.000
max2823.000-2781.000=42.000
mean0.427-0.426=0.001
σ0.005-0.008=-0.004
min0.424-0.421=0.003
max0.436-0.441=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1985.328-1985.322=0.006
σ0.007-0.016=-0.008
min1985.319-1985.301=0.018
max1985.337-1985.338=-0.000
mean2823.000-2781.000=42.000
σ0.000
min2823.000-2781.000=42.000
max2823.000-2781.000=42.000
mean2.639-2.637=0.002
σ0.091-0.127=-0.036
min2.580-2.513=0.067
max2.794-2.832=-0.037
iters=5
new-facts=6402
prior-facts=1
mean4808.986-4808.852=0.134
σ7.756-7.838=-0.082
min4804.968-4805.034=-0.066
max4822.848-4822.865=-0.017
mean2823.000-2781.000=42.000
σ0.000
min2823.000-2781.000=42.000
max2823.000-2781.000=42.000
mean8.776-8.756=0.021
σ0.563-0.195=0.368
min7.784-8.465=-0.680
max9.115-8.985=0.130
iters=5
new-facts=6402
prior-facts=6402
mean4996.634-4816.406=180.228
σ0.019-402.780=-402.761
min4996.610-4095.891=900.719
max4996.656-4996.656=-0.000
mean3035.200-3023.200=12.000
σ205.359-297.616=-92.257
min2823.000-2781.000=42.000
max3288.000-3473.000=-185.000
mean8.670-8.368=0.302
σ0.150-0.608=-0.458
min8.506-7.339=1.167
max8.847-8.881=-0.035

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.945-0.944=0.001
σ0.049-0.056=-0.007
min0.911-0.912=-0.001
max1.030-1.042=-0.012

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.202-463.208=-0.005
σ574.767-574.774=-0.006
min175.813-175.813=-0.000
max1325.353-1325.368=-0.015
mean86.250
σ8.500
min82.000
max99.000
mean2823.000-2781.000=42.000
σ0.000
min2823.000-2781.000=42.000
max2823.000-2781.000=42.000
mean0.433-0.432=0.001
σ0.300-0.302=-0.002
min0.283-0.279=0.004
max0.884-0.885=-0.002
policies=20
mean1758.503-1758.513=-0.010
σ0.355-0.346=0.010
min1758.272-1758.284=-0.012
max1759.030-1759.026=0.004
mean820.000
σ0.000
min820.000
max820.000
mean2823.000-2781.000=42.000
σ0.000
min2823.000-2781.000=42.000
max2823.000-2781.000=42.000
mean2.803-2.785=0.018
σ0.005-0.008=-0.003
min2.799-2.776=0.023
max2.810-2.794=0.016
policies=200
mean17592.068-17591.936=0.132
σ0.493-0.373=0.120
min17591.768-17591.735=0.033
max17592.799-17592.494=0.305
mean8200.000
σ0.000
min8200.000
max8200.000
mean2823.000-2781.000=42.000
σ0.000
min2823.000-2781.000=42.000
max2823.000-2781.000=42.000
mean28.004-27.560=0.444
σ0.559-0.077=0.482
min27.504-27.444=0.060
max28.701-27.609=1.091