Compare commits

Home / Compare 0ba8a440 .. 37c8e860

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.703-70.701=0.001
σ0.048-0.046=0.001
min70.667-70.673=-0.006
max70.834-70.830=0.004
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.158-0.159=-0.002
σ0.005-0.002=0.003
min0.150-0.157=-0.008
max0.166-0.164=0.002
cache=y
dps=1
iters=10
policies=100
mean21.408-21.408=0.001
σ0.003-0.003=-0.000
min21.405-21.404=0.001
max21.412-21.413=-0.002
mean412.000-416.500=-4.500
σ0.000-0.527=-0.527
min412.000-416.000=-4.000
max412.000-417.000=-5.000
mean0.066-0.065=0.001
σ0.003-0.003=0.000
min0.064-0.063=0.001
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.930-1754.931=-0.001
σ0.360-0.361=-0.001
min1754.354-1754.364=-0.010
max1755.519-1755.530=-0.011
mean1645.600-1638.350=7.250
σ631.984-618.781=13.204
min622.000-632.000=-10.000
max2772.000-2480.000=292.000
mean2.814-2.801=0.013
σ0.181-0.152=0.030
min2.467-2.423=0.043
max3.194-2.978=0.216

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.755-272.757=-0.002
σ0.009-0.004=0.004
min272.746-272.753=-0.007
max272.768-272.765=0.003
mean2772.000-2480.000=292.000
σ0.000
min2772.000-2480.000=292.000
max2772.000-2480.000=292.000
mean0.383-0.381=0.002
σ0.009-0.007=0.001
min0.378-0.377=0.001
max0.398-0.394=0.004
iters=5
new-facts=1
prior-facts=6402
mean1933.167-1933.159=0.009
σ0.011-0.008=0.004
min1933.155-1933.147=0.008
max1933.182-1933.168=0.014
mean2772.000-2480.000=292.000
σ0.000
min2772.000-2480.000=292.000
max2772.000-2480.000=292.000
mean3.027-3.094=-0.067
σ0.170-0.146=0.025
min2.819-2.927=-0.108
max3.233-3.254=-0.021
iters=5
new-facts=6402
prior-facts=1
mean4757.016-4757.002=0.013
σ7.521-7.549=-0.028
min4753.588-4753.515=0.072
max4770.469-4770.506=-0.037
mean2772.000-2480.000=292.000
σ0.000
min2772.000-2480.000=292.000
max2772.000-2480.000=292.000
mean7.981-8.139=-0.157
σ0.236-0.326=-0.090
min7.730-7.837=-0.108
max8.358-8.633=-0.275
iters=5
new-facts=6402
prior-facts=6402
mean4944.401-4944.398=0.003
σ0.017-0.017=-0.001
min4944.379-4944.375=0.005
max4944.420-4944.416=0.004
mean3018.600-2940.200=78.400
σ304.273-385.563=-81.290
min2772.000-2480.000=292.000
max3473.000-3461.000=12.000
mean8.620-8.534=0.087
σ0.227-0.154=0.073
min8.411-8.404=0.007
max8.941-8.723=0.218

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.028-1.705=-0.677
σ0.132-0.152=-0.021
min0.916-1.455=-0.539
max1.238-1.835=-0.597

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.343-468.320=0.022
σ574.255-574.255=-0.001
min181.207-181.189=0.018
max1329.725-1329.704=0.021
mean88.250
σ8.500
min84.000
max101.000
mean2772.000-2480.000=292.000
σ0.000
min2772.000-2480.000=292.000
max2772.000-2480.000=292.000
mean0.462-0.564=-0.103
σ0.337-0.554=-0.216
min0.292-0.286=0.006
max0.968-1.395=-0.427
policies=20
mean1812.369-1812.163=0.205
σ0.391-0.390=0.001
min1812.098-1811.917=0.181
max1812.945-1812.743=0.201
mean840.000
σ0.000
min840.000
max840.000
mean2772.000-2480.000=292.000
σ0.000
min2772.000-2480.000=292.000
max2772.000-2480.000=292.000
mean2.876-2.808=0.068
σ0.007-0.017=-0.010
min2.868-2.790=0.078
max2.886-2.830=0.056
policies=200
mean18129.136-18129.057=0.079
σ0.447-0.511=-0.063
min18128.759-18128.785=-0.027
max18129.768-18129.822=-0.055
mean8400.000
σ0.000
min8400.000
max8400.000
mean2772.000-2480.000=292.000
σ0.000
min2772.000-2480.000=292.000
max2772.000-2480.000=292.000
mean28.494-28.447=0.047
σ0.209-0.065=0.144
min28.305-28.402=-0.098
max28.732-28.542=0.190