Compare commits

Home / Compare 6a240738 .. 27e88eeb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.781=0.000
σ0.052-0.052=-0.000
min70.755-70.751=0.004
max70.926-70.926=-0.000
mean414.000-415.600=-1.600
σ0.000-0.516=-0.516
min414.000-415.000=-1.000
max414.000-416.000=-2.000
mean0.159-0.159=0.001
σ0.003-0.006=-0.003
min0.155-0.151=0.005
max0.166-0.171=-0.005
cache=y
dps=1
iters=10
policies=100
mean21.494-21.493=0.001
σ0.003-0.003=-0.000
min21.489-21.488=0.001
max21.497-21.497=0.000
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.066-0.063=0.003
σ0.004-0.004=0.000
min0.063-0.059=0.004
max0.073-0.070=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1713.950-1751.882=-37.932
σ169.563-0.362=169.201
min993.558-1751.309=-757.751
max1752.451-1752.469=-0.018
mean1640.650-1665.700=-25.050
σ604.305-637.804=-33.499
min613.000-679.000=-66.000
max2701.000-2693.000=8.000
mean2.787-2.796=-0.009
σ0.346-0.179=0.167
min1.460-2.251=-0.792
max3.156-3.031=0.125

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.377-269.379=-0.002
σ0.001-0.007=-0.006
min269.377-269.370=0.006
max269.379-269.386=-0.007
mean2701.000-2693.000=8.000
σ0.000
min2701.000-2693.000=8.000
max2701.000-2693.000=8.000
mean0.374-0.377=-0.003
σ0.001-0.004=-0.003
min0.373-0.374=-0.001
max0.375-0.383=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1929.746-1929.751=-0.005
σ0.016-0.006=0.010
min1929.726-1929.745=-0.019
max1929.768-1929.761=0.007
mean2701.000-2693.000=8.000
σ0.000
min2701.000-2693.000=8.000
max2701.000-2693.000=8.000
mean2.928-3.063=-0.135
σ0.141-0.069=0.072
min2.729-3.000=-0.270
max3.098-3.167=-0.069
iters=5
new-facts=6402
prior-facts=1
mean4750.482-4750.519=-0.037
σ0.885-0.866=0.019
min4750.050-4749.975=0.074
max4752.064-4752.051=0.013
mean2701.000-2693.000=8.000
σ0.000
min2701.000-2693.000=8.000
max2701.000-2693.000=8.000
mean8.757-8.675=0.082
σ0.152-0.682=-0.530
min8.541-7.892=0.648
max8.907-9.761=-0.854
iters=5
new-facts=6402
prior-facts=6402
mean4940.981-4940.988=-0.007
σ0.018-0.013=0.005
min4940.953-4940.970=-0.017
max4940.999-4940.998=0.001
mean2978.800-3034.200=-55.400
σ320.082-281.615=38.467
min2701.000-2693.000=8.000
max3434.000-3411.000=23.000
mean8.368-8.584=-0.216
σ0.027-0.187=-0.160
min8.323-8.395=-0.072
max8.398-8.840=-0.442

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.018-1.067=-0.049
σ0.135-0.140=-0.006
min0.925-0.927=-0.002
max1.237-1.237=-0.000

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.738-462.726=0.012
σ574.950-574.936=0.013
min175.247-175.249=-0.002
max1325.162-1325.131=0.032
mean86.250
σ8.500
min82.000
max99.000
mean2701.000-2693.000=8.000
σ0.000
min2701.000-2693.000=8.000
max2701.000-2693.000=8.000
mean0.481-0.554=-0.073
σ0.413-0.545=-0.131
min0.271-0.276=-0.005
max1.101-1.372=-0.270
policies=20
mean1752.742-1752.726=0.015
σ0.333-0.354=-0.021
min1752.527-1752.519=0.008
max1753.238-1753.257=-0.019
mean820.000
σ0.000
min820.000
max820.000
mean2701.000-2693.000=8.000
σ0.000
min2701.000-2693.000=8.000
max2701.000-2693.000=8.000
mean2.718-2.730=-0.012
σ0.008-0.017=-0.009
min2.707-2.707=-0.001
max2.726-2.745=-0.020
policies=200
mean17534.656-17534.670=-0.014
σ0.556-0.591=-0.034
min17534.302-17534.277=0.025
max17535.486-17535.540=-0.054
mean8200.000
σ0.000
min8200.000
max8200.000
mean2701.000-2693.000=8.000
σ0.000
min2701.000-2693.000=8.000
max2701.000-2693.000=8.000
mean27.534-27.499=0.035
σ0.140-0.124=0.015
min27.379-27.413=-0.033
max27.659-27.678=-0.018