Compare commits

Home / Compare c1466924 .. 1764053b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-30.769=5.030
σ0.109-0.047=0.062
min35.747-30.726=5.021
max36.108-30.899=5.209
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.078-0.074=0.004
σ0.004-0.004=0.000
min0.074-0.070=0.004
max0.086-0.080=0.006
cache=y
dps=1
iters=10
policies=100
mean26.065-21.061=5.004
σ0.004-0.002=0.002
min26.058-21.057=5.001
max26.070-21.064=5.006
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.061-0.061=0.000
σ0.003-0.003=-0.001
min0.060-0.057=0.002
max0.069-0.068=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.923-1751.420=4.503
σ0.363-0.360=0.003
min1755.345-1750.851=4.494
max1756.509-1752.005=4.504
mean1663.600-1650.450=13.150
σ625.503-624.593=0.910
min608.000-680.000=-72.000
max2690.000-2652.000=38.000
mean2.839-2.837=0.002
σ0.183-0.127=0.056
min2.303-2.528=-0.225
max3.159-3.081=0.078

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.202-275.730=1.472
σ0.007-0.009=-0.002
min277.192-275.721=1.471
max277.210-275.744=1.466
mean2690.000-2652.000=38.000
σ0.000
min2690.000-2652.000=38.000
max2690.000-2652.000=38.000
mean0.418-0.402=0.017
σ0.017-0.008=0.009
min0.401-0.397=0.004
max0.441-0.415=0.026
iters=5
new-facts=1
prior-facts=6402
mean2174.435-2168.274=6.161
σ0.008-0.021=-0.013
min2174.426-2168.254=6.173
max2174.445-2168.300=6.145
mean2690.000-2652.000=38.000
σ0.000
min2690.000-2652.000=38.000
max2690.000-2652.000=38.000
mean2.992-2.970=0.022
σ0.142-0.134=0.008
min2.774-2.757=0.017
max3.139-3.090=0.048
iters=5
new-facts=6402
prior-facts=1
mean5052.537-5048.100=4.438
σ1.056-0.917=0.139
min5051.688-5047.515=4.173
max5054.370-5049.709=4.661
mean2690.000-2652.000=38.000
σ0.000
min2690.000-2652.000=38.000
max2690.000-2652.000=38.000
mean8.812-8.980=-0.168
σ0.540-0.557=-0.017
min8.189-8.163=0.026
max9.441-9.597=-0.156
iters=5
new-facts=6402
prior-facts=6402
mean5188.431-5179.097=9.333
σ0.086-0.341=-0.256
min5188.359-5178.501=9.859
max5188.529-5179.328=9.201
mean3219.000-3225.600=-6.600
σ386.312-369.873=16.439
min2690.000-2697.000=-7.000
max3706.000-3678.000=28.000
mean9.049-9.951=-0.902
σ0.335-0.198=0.137
min8.812-9.610=-0.797
max9.627-10.118=-0.492

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.124-1.127=-0.003
σ0.246-0.272=-0.026
min0.944-0.936=0.008
max1.548-1.542=0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.857-463.576=1.281
σ572.667-572.674=-0.007
min178.521-177.236=1.285
max1323.858-1322.587=1.271
mean79.500-79.750=-0.250
σ7.000-7.500=-0.500
min76.000
max90.000-91.000=-1.000
mean2690.000-2652.000=38.000
σ0.000
min2690.000-2652.000=38.000
max2690.000-2652.000=38.000
mean0.533-0.548=-0.014
σ0.504-0.532=-0.028
min0.276-0.276=-0.001
max1.289-1.345=-0.056
policies=20
mean1785.484-1772.616=12.868
σ0.349-0.332=0.017
min1785.251-1772.400=12.851
max1786.002-1773.109=12.893
mean760.000
σ0.000
min760.000
max760.000
mean2690.000-2652.000=38.000
σ0.000
min2690.000-2652.000=38.000
max2690.000-2652.000=38.000
mean2.789-2.754=0.035
σ0.013-0.020=-0.007
min2.775-2.731=0.044
max2.806-2.779=0.027
policies=200
mean17861.395-17732.916=128.479
σ0.480-0.425=0.055
min17861.071-17732.550=128.521
max17862.098-17733.521=128.577
mean7600.000
σ0.000
min7600.000
max7600.000
mean2690.000-2652.000=38.000
σ0.000
min2690.000-2652.000=38.000
max2690.000-2652.000=38.000
mean28.195-27.743=0.452
σ0.142-0.089=0.053
min28.038-27.649=0.390
max28.322-27.847=0.475