Compare commits

Home / Compare c93b39a4 .. 4c8c334d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.770-35.799=-5.029
σ0.046-0.109=-0.063
min30.734-35.747=-5.013
max30.896-36.108=-5.212
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.079-0.078=0.000
σ0.003-0.004=-0.001
min0.076-0.074=0.002
max0.085-0.086=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.060-26.065=-5.004
σ0.003-0.004=-0.001
min21.056-26.058=-5.002
max21.064-26.070=-5.006
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.062-0.061=0.000
σ0.004-0.003=0.001
min0.058-0.060=-0.002
max0.069-0.069=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.418-1755.923=-4.505
σ0.361-0.363=-0.002
min1750.848-1755.345=-4.497
max1752.006-1756.509=-4.502
mean1659.950-1663.600=-3.650
σ620.430-625.503=-5.073
min661.000-608.000=53.000
max2497.000-2690.000=-193.000
mean2.800-2.839=-0.040
σ0.211-0.183=0.027
min2.189-2.303=-0.114
max3.085-3.159=-0.075

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.757-277.202=-1.445
σ0.008-0.007=0.001
min275.748-277.192=-1.444
max275.766-277.210=-1.443
mean2497.000-2690.000=-193.000
σ0.000
min2497.000-2690.000=-193.000
max2497.000-2690.000=-193.000
mean0.403-0.418=-0.015
σ0.009-0.017=-0.008
min0.398-0.401=-0.003
max0.418-0.441=-0.023
iters=5
new-facts=1
prior-facts=6402
mean2168.274-2174.435=-6.161
σ0.017-0.008=0.009
min2168.251-2174.426=-6.175
max2168.290-2174.445=-6.155
mean2497.000-2690.000=-193.000
σ0.000
min2497.000-2690.000=-193.000
max2497.000-2690.000=-193.000
mean2.977-2.992=-0.015
σ0.123-0.142=-0.020
min2.810-2.774=0.036
max3.117-3.139=-0.022
iters=5
new-facts=6402
prior-facts=1
mean5047.866-5052.537=-4.672
σ1.184-1.056=0.128
min5046.413-5051.688=-5.275
max5049.709-5054.370=-4.661
mean2497.000-2690.000=-193.000
σ0.000
min2497.000-2690.000=-193.000
max2497.000-2690.000=-193.000
mean8.901-8.812=0.089
σ0.480-0.540=-0.060
min8.139-8.189=-0.050
max9.456-9.441=0.015
iters=5
new-facts=6402
prior-facts=6402
mean5179.246-5188.431=-9.185
σ0.083-0.086=-0.003
min5179.176-5188.359=-9.183
max5179.360-5188.529=-9.169
mean3271.400-3219.000=52.400
σ379.796-386.312=-6.516
min2734.000-2690.000=44.000
max3728.000-3706.000=22.000
mean10.129-9.049=1.080
σ0.453-0.335=0.118
min9.579-8.812=0.767
max10.837-9.627=1.210

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.756-1.124=0.632
σ0.135-0.246=-0.111
min1.517-0.944=0.573
max1.843-1.548=0.295

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.563-464.857=-1.294
σ572.650-572.667=-0.017
min177.238-178.521=-1.283
max1322.538-1323.858=-1.320
mean79.750-79.500=0.250
σ7.500-7.000=0.500
min76.000
max91.000-90.000=1.000
mean2497.000-2690.000=-193.000
σ0.000
min2497.000-2690.000=-193.000
max2497.000-2690.000=-193.000
mean0.541-0.533=0.008
σ0.533-0.504=0.029
min0.273-0.276=-0.003
max1.341-1.289=0.052
policies=20
mean1772.610-1785.484=-12.874
σ0.329-0.349=-0.020
min1772.400-1785.251=-12.851
max1773.099-1786.002=-12.904
mean760.000
σ0.000
min760.000
max760.000
mean2497.000-2690.000=-193.000
σ0.000
min2497.000-2690.000=-193.000
max2497.000-2690.000=-193.000
mean2.741-2.789=-0.048
σ0.015-0.013=0.002
min2.721-2.775=-0.054
max2.755-2.806=-0.051
policies=200
mean17733.022-17861.395=-128.373
σ0.498-0.480=0.018
min17732.626-17861.071=-128.445
max17733.750-17862.098=-128.348
mean7600.000
σ0.000
min7600.000
max7600.000
mean2497.000-2690.000=-193.000
σ0.000
min2497.000-2690.000=-193.000
max2497.000-2690.000=-193.000
mean27.726-28.195=-0.470
σ0.135-0.142=-0.007
min27.583-28.038=-0.455
max27.855-28.322=-0.467