Compare commits

Home / Compare 1903d62e .. 8ff111f3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.701-70.701=0.000
σ0.047-0.047=0.000
min70.666-70.670=-0.003
max70.831-70.831=-0.000
mean411.600-411.000=0.600
σ0.516-0.000=0.516
min411.000
max412.000-411.000=1.000
mean0.160-0.159=0.002
σ0.005-0.006=-0.000
min0.154-0.147=0.006
max0.171-0.167=0.003
cache=y
dps=1
iters=10
policies=100
mean21.409-21.408=0.001
σ0.002-0.003=-0.001
min21.406-21.405=0.001
max21.411-21.413=-0.002
mean412.000-411.000=1.000
σ0.000
min412.000-411.000=1.000
max412.000-411.000=1.000
mean0.065-0.065=0.000
σ0.002-0.004=-0.002
min0.064-0.059=0.004
max0.071-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.930-1754.929=0.001
σ0.362-0.361=0.000
min1754.354-1754.362=-0.008
max1755.510-1755.519=-0.008
mean1675.150-1665.950=9.200
σ630.521-625.436=5.084
min680.000-623.000=57.000
max2734.000-2522.000=212.000
mean2.836-2.845=-0.009
σ0.086-0.111=-0.024
min2.584-2.503=0.081
max2.970-3.027=-0.058

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.792-272.793=-0.001
σ0.008-0.006=0.002
min272.785-272.787=-0.002
max272.804-272.803=0.002
mean2734.000-2522.000=212.000
σ0.000
min2734.000-2522.000=212.000
max2734.000-2522.000=212.000
mean0.382-0.382=-0.000
σ0.007-0.008=-0.001
min0.378-0.378=0.001
max0.395-0.397=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1933.222-1933.215=0.007
σ0.011-0.015=-0.004
min1933.211-1933.198=0.013
max1933.239-1933.233=0.006
mean2734.000-2522.000=212.000
σ0.000
min2734.000-2522.000=212.000
max2734.000-2522.000=212.000
mean3.039-3.052=-0.014
σ0.183-0.182=0.001
min2.731-2.895=-0.163
max3.167-3.347=-0.181
iters=5
new-facts=6402
prior-facts=1
mean4756.821-4756.939=-0.118
σ7.682-7.648=0.034
min4752.547-4753.459=-0.912
max4770.534-4770.619=-0.085
mean2734.000-2522.000=212.000
σ0.000
min2734.000-2522.000=212.000
max2734.000-2522.000=212.000
mean7.953-8.658=-0.705
σ0.390-0.467=-0.077
min7.648-7.874=-0.226
max8.576-9.004=-0.428
iters=5
new-facts=6402
prior-facts=6402
mean4944.396-4944.389=0.007
σ0.154-0.153=0.001
min4944.122-4944.117=0.005
max4944.482-4944.478=0.004
mean2987.400-2948.800=38.600
σ303.379-366.627=-63.248
min2734.000-2522.000=212.000
max3438.000-3460.000=-22.000
mean8.515-8.600=-0.085
σ0.266-0.245=0.020
min8.252-8.329=-0.078
max8.847-8.969=-0.122

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.999-1.541=-0.542
σ0.140-0.206=-0.066
min0.906-1.226=-0.319
max1.226-1.792=-0.566

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.323-468.304=0.019
σ574.253-574.232=0.021
min181.194-181.183=0.011
max1329.702-1329.652=0.050
mean88.250
σ8.500
min84.000
max101.000
mean2734.000-2522.000=212.000
σ0.000
min2734.000-2522.000=212.000
max2734.000-2522.000=212.000
mean0.567-0.558=0.009
σ0.563-0.547=0.016
min0.285-0.282=0.003
max1.412-1.379=0.033
policies=20
mean1812.178-1812.144=0.034
σ0.388-0.385=0.004
min1811.919-1811.881=0.038
max1812.754-1812.712=0.042
mean840.000
σ0.000
min840.000
max840.000
mean2734.000-2522.000=212.000
σ0.000
min2734.000-2522.000=212.000
max2734.000-2522.000=212.000
mean2.804-2.815=-0.011
σ0.011-0.010=0.001
min2.790-2.808=-0.018
max2.816-2.829=-0.013
policies=200
mean18129.042-18128.857=0.185
σ0.517-0.608=-0.091
min18128.716-18128.450=0.266
max18129.813-18129.753=0.060
mean8400.000
σ0.000
min8400.000
max8400.000
mean2734.000-2522.000=212.000
σ0.000
min2734.000-2522.000=212.000
max2734.000-2522.000=212.000
mean28.289-28.274=0.016
σ0.173-0.086=0.086
min28.179-28.194=-0.015
max28.546-28.349=0.197