Compare commits

Home / Compare 2ff6f446 .. 7d0b26f9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.703-70.701=0.002
σ0.048-0.045=0.003
min70.668-70.668=-0.000
max70.835-70.824=0.010
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.161-0.160=0.000
σ0.004-0.003=0.001
min0.152-0.158=-0.006
max0.167-0.166=0.001
cache=y
dps=1
iters=10
policies=100
mean21.408-21.408=-0.000
σ0.002-0.003=-0.000
min21.404-21.402=0.002
max21.412-21.411=0.001
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.065-0.065=-0.000
σ0.004-0.003=0.001
min0.059-0.063=-0.004
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.931-1754.930=0.001
σ0.363-0.362=0.001
min1754.359-1754.362=-0.003
max1755.514-1755.531=-0.017
mean1649.250-1647.850=1.400
σ632.320-633.637=-1.318
min626.000-624.000=2.000
max2774.000-2796.000=-22.000
mean2.829-2.817=0.013
σ0.192-0.180=0.012
min2.264-2.295=-0.032
max3.204-3.151=0.053

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.760-272.758=0.001
σ0.007-0.005=0.001
min272.754-272.751=0.003
max272.768-272.765=0.003
mean2774.000-2796.000=-22.000
σ0.000
min2774.000-2796.000=-22.000
max2774.000-2796.000=-22.000
mean0.391-0.383=0.008
σ0.008-0.008=0.000
min0.379-0.378=0.001
max0.401-0.396=0.005
iters=5
new-facts=1
prior-facts=6402
mean1933.157-1933.166=-0.009
σ0.018-0.014=0.004
min1933.132-1933.147=-0.015
max1933.177-1933.183=-0.006
mean2774.000-2796.000=-22.000
σ0.000
min2774.000-2796.000=-22.000
max2774.000-2796.000=-22.000
mean3.044-3.250=-0.207
σ0.130-0.233=-0.103
min2.931-3.041=-0.109
max3.257-3.650=-0.393
iters=5
new-facts=6402
prior-facts=1
mean4756.922-4757.001=-0.079
σ7.639-7.575=0.064
min4753.442-4753.465=-0.023
max4770.588-4770.551=0.037
mean2774.000-2796.000=-22.000
σ0.000
min2774.000-2796.000=-22.000
max2774.000-2796.000=-22.000
mean8.576-8.097=0.480
σ0.399-0.403=-0.004
min7.928-7.793=0.135
max8.906-8.800=0.106
iters=5
new-facts=6402
prior-facts=6402
mean4944.396-4944.397=-0.001
σ0.015-0.012=0.003
min4944.380-4944.383=-0.003
max4944.413-4944.409=0.004
mean2991.600-3019.800=-28.200
σ208.858-285.486=-76.628
min2774.000-2796.000=-22.000
max3291.000-3452.000=-161.000
mean8.527-8.597=-0.069
σ0.096-0.267=-0.171
min8.430-8.394=0.035
max8.630-9.047=-0.417

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.002-1.005=-0.003
σ0.132-0.139=-0.007
min0.910-0.911=-0.001
max1.220-1.233=-0.012

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.339-468.346=-0.007
σ574.255-574.254=0.001
min181.202-181.210=-0.008
max1329.721-1329.727=-0.005
mean88.250
σ8.500
min84.000
max101.000
mean2774.000-2796.000=-22.000
σ0.000
min2774.000-2796.000=-22.000
max2774.000-2796.000=-22.000
mean0.444-0.443=0.000
σ0.302-0.300=0.002
min0.289-0.293=-0.004
max0.897-0.893=0.004
policies=20
mean1812.380-1812.372=0.008
σ0.389-0.382=0.007
min1812.112-1812.107=0.005
max1812.951-1812.934=0.018
mean840.000
σ0.000
min840.000
max840.000
mean2774.000-2796.000=-22.000
σ0.000
min2774.000-2796.000=-22.000
max2774.000-2796.000=-22.000
mean2.891-2.884=0.007
σ0.008-0.007=0.002
min2.883-2.875=0.009
max2.903-2.889=0.014
policies=200
mean18128.915-18129.196=-0.281
σ0.749-0.473=0.275
min18128.019-18128.817=-0.798
max18129.841-18129.829=0.012
mean8400.000
σ0.000
min8400.000
max8400.000
mean2774.000-2796.000=-22.000
σ0.000
min2774.000-2796.000=-22.000
max2774.000-2796.000=-22.000
mean28.488-28.474=0.015
σ0.227-0.202=0.025
min28.370-28.331=0.039
max28.829-28.772=0.057