Compare commits

Home / Compare 92ec9b1e .. 159d0174

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-35.799=-5.030
σ0.047-0.109=-0.062
min30.726-35.747=-5.021
max30.899-36.108=-5.209
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.074-0.078=-0.004
σ0.004-0.004=-0.000
min0.070-0.074=-0.004
max0.080-0.086=-0.006
cache=y
dps=1
iters=10
policies=100
mean21.061-26.065=-5.004
σ0.002-0.004=-0.002
min21.057-26.058=-5.001
max21.064-26.070=-5.006
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.061-0.061=-0.000
σ0.003-0.003=0.001
min0.057-0.060=-0.002
max0.068-0.069=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.420-1755.923=-4.503
σ0.360-0.363=-0.003
min1750.851-1755.345=-4.494
max1752.005-1756.509=-4.504
mean1650.450-1663.600=-13.150
σ624.593-625.503=-0.910
min680.000-608.000=72.000
max2652.000-2690.000=-38.000
mean2.837-2.839=-0.002
σ0.127-0.183=-0.056
min2.528-2.303=0.225
max3.081-3.159=-0.078

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.730-277.202=-1.472
σ0.009-0.007=0.002
min275.721-277.192=-1.471
max275.744-277.210=-1.466
mean2652.000-2690.000=-38.000
σ0.000
min2652.000-2690.000=-38.000
max2652.000-2690.000=-38.000
mean0.402-0.418=-0.017
σ0.008-0.017=-0.009
min0.397-0.401=-0.004
max0.415-0.441=-0.026
iters=5
new-facts=1
prior-facts=6402
mean2168.274-2174.435=-6.161
σ0.021-0.008=0.013
min2168.254-2174.426=-6.173
max2168.300-2174.445=-6.145
mean2652.000-2690.000=-38.000
σ0.000
min2652.000-2690.000=-38.000
max2652.000-2690.000=-38.000
mean2.970-2.992=-0.022
σ0.134-0.142=-0.008
min2.757-2.774=-0.017
max3.090-3.139=-0.048
iters=5
new-facts=6402
prior-facts=1
mean5048.100-5052.537=-4.438
σ0.917-1.056=-0.139
min5047.515-5051.688=-4.173
max5049.709-5054.370=-4.661
mean2652.000-2690.000=-38.000
σ0.000
min2652.000-2690.000=-38.000
max2652.000-2690.000=-38.000
mean8.980-8.812=0.168
σ0.557-0.540=0.017
min8.163-8.189=-0.026
max9.597-9.441=0.156
iters=5
new-facts=6402
prior-facts=6402
mean5179.097-5188.431=-9.333
σ0.341-0.086=0.256
min5178.501-5188.359=-9.859
max5179.328-5188.529=-9.201
mean3225.600-3219.000=6.600
σ369.873-386.312=-16.439
min2697.000-2690.000=7.000
max3678.000-3706.000=-28.000
mean9.951-9.049=0.902
σ0.198-0.335=-0.137
min9.610-8.812=0.797
max10.118-9.627=0.492

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.127-1.124=0.003
σ0.272-0.246=0.026
min0.936-0.944=-0.008
max1.542-1.548=-0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.576-464.857=-1.281
σ572.674-572.667=0.007
min177.236-178.521=-1.285
max1322.587-1323.858=-1.271
mean79.750-79.500=0.250
σ7.500-7.000=0.500
min76.000
max91.000-90.000=1.000
mean2652.000-2690.000=-38.000
σ0.000
min2652.000-2690.000=-38.000
max2652.000-2690.000=-38.000
mean0.548-0.533=0.014
σ0.532-0.504=0.028
min0.276-0.276=0.001
max1.345-1.289=0.056
policies=20
mean1772.616-1785.484=-12.868
σ0.332-0.349=-0.017
min1772.400-1785.251=-12.851
max1773.109-1786.002=-12.893
mean760.000
σ0.000
min760.000
max760.000
mean2652.000-2690.000=-38.000
σ0.000
min2652.000-2690.000=-38.000
max2652.000-2690.000=-38.000
mean2.754-2.789=-0.035
σ0.020-0.013=0.007
min2.731-2.775=-0.044
max2.779-2.806=-0.027
policies=200
mean17732.916-17861.395=-128.479
σ0.425-0.480=-0.055
min17732.550-17861.071=-128.521
max17733.521-17862.098=-128.577
mean7600.000
σ0.000
min7600.000
max7600.000
mean2652.000-2690.000=-38.000
σ0.000
min2652.000-2690.000=-38.000
max2652.000-2690.000=-38.000
mean27.743-28.195=-0.452
σ0.089-0.142=-0.053
min27.649-28.038=-0.390
max27.847-28.322=-0.475