Compare commits

Home / Compare ac175aa9 .. 0a9685e1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.046-73.045=0.001
σ0.049-0.046=0.003
min73.018-73.021=-0.003
max73.185-73.175=0.010
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.157-0.159=-0.003
σ0.005-0.004=0.000
min0.149-0.153=-0.003
max0.164-0.166=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.741-23.741=0.000
σ0.002-0.003=-0.001
min23.737-23.735=0.001
max23.745-23.745=-0.000
mean415.500-413.000=2.500
σ0.527-0.000=0.527
min415.000-413.000=2.000
max416.000-413.000=3.000
mean0.065-0.066=-0.001
σ0.000-0.003=-0.003
min0.065-0.060=0.004
max0.066-0.073=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.787-1758.788=-0.001
σ0.360-0.362=-0.002
min1758.218-1758.218=-0.000
max1759.381-1759.370=0.011
mean1646.150-1619.650=26.500
σ624.771-594.528=30.243
min623.000-629.000=-6.000
max2775.000-2409.000=366.000
mean2.809-2.807=0.001
σ0.194-0.164=0.030
min2.267-2.303=-0.037
max3.104-3.016=0.088

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.012-324.012=0.000
σ0.058-0.054=0.003
min323.910-323.915=-0.005
max324.042-324.040=0.001
mean2775.000-2409.000=366.000
σ0.000
min2775.000-2409.000=366.000
max2775.000-2409.000=366.000
mean0.428-0.429=-0.001
σ0.004-0.004=-0.000
min0.423-0.425=-0.002
max0.433-0.436=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1984.586-1984.582=0.004
σ0.024-0.020=0.003
min1984.547-1984.560=-0.014
max1984.605-1984.601=0.004
mean2775.000-2409.000=366.000
σ0.000
min2775.000-2409.000=366.000
max2775.000-2409.000=366.000
mean2.709-2.592=0.117
σ0.267-0.049=0.219
min2.517-2.560=-0.044
max3.168-2.675=0.493
iters=5
new-facts=6402
prior-facts=1
mean4808.231-4808.253=-0.022
σ7.758-7.847=-0.089
min4804.702-4804.687=0.015
max4822.108-4822.290=-0.181
mean2775.000-2409.000=366.000
σ0.000
min2775.000-2409.000=366.000
max2775.000-2409.000=366.000
mean8.848-8.942=-0.095
σ0.189-0.302=-0.113
min8.553-8.542=0.010
max9.046-9.326=-0.280
iters=5
new-facts=6402
prior-facts=6402
mean4995.809-4995.806=0.003
σ0.017-0.020=-0.003
min4995.784-4995.780=0.004
max4995.828-4995.825=0.003
mean3035.600-2968.800=66.800
σ233.793-263.383=-29.590
min2775.000-2634.000=141.000
max3334.000-3319.000=15.000
mean8.687-8.521=0.166
σ0.150-0.118=0.032
min8.527-8.315=0.212
max8.933-8.602=0.331

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.030-1.691=-0.661
σ0.242-0.147=0.094
min0.916-1.489=-0.572
max1.463-1.836=-0.372

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.355-468.327=0.028
σ574.229-574.231=-0.003
min181.230-181.207=0.023
max1329.698-1329.674=0.024
mean88.250
σ8.500
min84.000
max101.000
mean2775.000-2409.000=366.000
σ0.000
min2775.000-2409.000=366.000
max2775.000-2409.000=366.000
mean0.446-0.563=-0.117
σ0.304-0.555=-0.250
min0.287-0.282=0.005
max0.902-1.395=-0.492
policies=20
mean1812.646-1812.432=0.214
σ0.391-0.393=-0.001
min1812.363-1812.159=0.204
max1813.214-1813.012=0.202
mean840.000
σ0.000
min840.000
max840.000
mean2775.000-2409.000=366.000
σ0.000
min2775.000-2409.000=366.000
max2775.000-2409.000=366.000
mean2.946-2.816=0.130
σ0.047-0.016=0.031
min2.912-2.800=0.112
max3.013-2.837=0.177
policies=200
mean18131.632-18131.586=0.047
σ0.457-0.384=0.073
min18131.267-18131.272=-0.004
max18132.301-18132.146=0.155
mean8400.000
σ0.000
min8400.000
max8400.000
mean2775.000-2409.000=366.000
σ0.000
min2775.000-2409.000=366.000
max2775.000-2409.000=366.000
mean28.427-28.387=0.040
σ0.189-0.084=0.105
min28.250-28.279=-0.029
max28.664-28.466=0.198