Compare commits

Home / Compare cf6284b0 .. bccb319f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.952-35.952=-0.000
σ0.102-0.103=-0.001
min35.906-35.909=-0.003
max36.240-36.244=-0.004
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.077-0.077=-0.001
σ0.004-0.004=0.000
min0.071-0.074=-0.002
max0.084-0.083=0.000
cache=y
dps=1
iters=10
policies=100
mean26.200-26.200=0.000
σ0.005-0.004=0.000
min26.192-26.195=-0.002
max26.207-26.206=0.000
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.060-0.060=0.000
σ0.003-0.003=-0.000
min0.057-0.056=0.001
max0.068-0.067=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.298-1756.299=-0.001
σ0.366-0.369=-0.003
min1755.721-1755.723=-0.002
max1756.889-1756.895=-0.006
mean1649.250-1661.200=-11.950
σ637.072-637.747=-0.675
min618.000-614.000=4.000
max2728.000-2696.000=32.000
mean2.372-2.367=0.004
σ0.108-0.190=-0.082
min2.266-2.180=0.086
max2.650-3.109=-0.460

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.813-278.819=-0.007
σ0.003-0.006=-0.003
min278.809-278.810=-0.000
max278.818-278.826=-0.009
mean2728.000-2696.000=32.000
σ0.000
min2728.000-2696.000=32.000
max2728.000-2696.000=32.000
mean0.409-0.409=-0.000
σ0.007-0.002=0.005
min0.403-0.406=-0.003
max0.416-0.412=0.005
iters=5
new-facts=1
prior-facts=6402
mean2268.880-2268.885=-0.005
σ0.006-0.016=-0.010
min2268.876-2268.863=0.013
max2268.889-2268.903=-0.013
mean2728.000-2696.000=32.000
σ0.000
min2728.000-2696.000=32.000
max2728.000-2696.000=32.000
mean3.128-3.044=0.084
σ0.276-0.165=0.111
min2.906-2.852=0.054
max3.593-3.208=0.385
iters=5
new-facts=6402
prior-facts=1
mean4954.261-4954.002=0.259
σ0.830-1.150=-0.320
min4953.815-4952.648=1.167
max4955.741-4955.837=-0.096
mean2728.000-2696.000=32.000
σ0.000
min2728.000-2696.000=32.000
max2728.000-2696.000=32.000
mean7.890-8.209=-0.319
σ0.342-0.412=-0.070
min7.714-7.870=-0.156
max8.499-8.866=-0.366
iters=5
new-facts=6402
prior-facts=6402
mean5168.786-5168.783=0.002
σ0.081-0.072=0.008
min5168.718-5168.724=-0.006
max5168.875-5168.870=0.005
mean3435.400-3468.400=-33.000
σ507.863-508.551=-0.688
min2843.000-2840.000=3.000
max4192.000-4184.000=8.000
mean9.238-9.388=-0.150
σ0.312-0.523=-0.211
min8.934-8.513=0.421
max9.583-9.795=-0.211

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.031-1.150=-0.118
σ0.143-0.381=-0.238
min0.938-0.932=0.006
max1.265-1.821=-0.556

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.809-459.806=0.003
σ571.584-571.588=-0.004
min174.007-174.008=-0.002
max1317.185-1317.189=-0.004
mean79.500
σ7.000
min76.000
max90.000
mean2728.000-2696.000=32.000
σ0.000
min2728.000-2696.000=32.000
max2728.000-2696.000=32.000
mean0.545-0.549=-0.004
σ0.559-0.553=0.006
min0.264-0.272=-0.007
max1.384-1.379=0.005
policies=20
mean1740.322-1740.322=-0.000
σ0.311-0.318=-0.007
min1740.125-1740.119=0.005
max1740.786-1740.796=-0.010
mean760.000
σ0.000
min760.000
max760.000
mean2728.000-2696.000=32.000
σ0.000
min2728.000-2696.000=32.000
max2728.000-2696.000=32.000
mean2.677-2.686=-0.010
σ0.012-0.012=0.001
min2.662-2.672=-0.010
max2.691-2.698=-0.007
policies=200
mean17410.144-17410.178=-0.034
σ0.394-0.497=-0.102
min17409.935-17409.883=0.052
max17410.735-17410.918=-0.183
mean7600.000
σ0.000
min7600.000
max7600.000
mean2728.000-2696.000=32.000
σ0.000
min2728.000-2696.000=32.000
max2728.000-2696.000=32.000
mean26.974-26.980=-0.006
σ0.107-0.093=0.014
min26.884-26.914=-0.030
max27.100-27.114=-0.013