Compare commits

Home / Compare b902c1f8 .. 18c64ab6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.732-70.730=0.002
σ0.053-0.046=0.007
min70.703-70.699=0.004
max70.878-70.857=0.022
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.160-0.160=0.000
σ0.004-0.003=0.001
min0.153-0.156=-0.003
max0.164-0.167=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.446-21.446=-0.000
σ0.003-0.003=-0.000
min21.441-21.441=0.000
max21.449-21.450=-0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.064-0.063=0.001
σ0.003-0.003=-0.001
min0.060-0.059=0.001
max0.070-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.528-1754.527=0.001
σ0.361-0.362=-0.001
min1753.961-1753.956=0.005
max1755.116-1755.112=0.003
mean1665.400-1659.950=5.450
σ621.107-627.898=-6.792
min695.000-626.000=69.000
max2841.000-2853.000=-12.000
mean2.852-2.801=0.052
σ0.098-0.127=-0.029
min2.672-2.401=0.270
max3.064-2.955=0.109

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.613-273.593=0.020
σ0.006-0.017=-0.012
min273.608-273.575=0.033
max273.622-273.619=0.003
mean2841.000-2853.000=-12.000
σ0.000
min2841.000-2853.000=-12.000
max2841.000-2853.000=-12.000
mean0.384-0.390=-0.006
σ0.002-0.006=-0.004
min0.381-0.384=-0.003
max0.386-0.399=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1933.990-1933.993=-0.003
σ0.012-0.006=0.005
min1933.973-1933.986=-0.013
max1934.002-1934.004=-0.002
mean2841.000-2853.000=-12.000
σ0.000
min2841.000-2853.000=-12.000
max2841.000-2853.000=-12.000
mean3.011-3.050=-0.038
σ0.071-0.198=-0.127
min2.939-2.763=0.176
max3.109-3.234=-0.125
iters=5
new-facts=6402
prior-facts=1
mean4754.652-4614.225=140.427
σ0.658-314.655=-313.997
min4754.259-4051.356=702.903
max4755.819-4756.350=-0.530
mean2841.000-2853.000=-12.000
σ0.000
min2841.000-2853.000=-12.000
max2841.000-2853.000=-12.000
mean8.629-8.313=0.316
σ0.679-0.628=0.051
min7.432-7.680=-0.247
max9.072-9.225=-0.153
iters=5
new-facts=6402
prior-facts=6402
mean4945.155-4945.235=-0.080
σ0.165-0.020=0.145
min4944.863-4945.213=-0.350
max4945.254-4945.264=-0.011
mean3015.800-3087.400=-71.600
σ194.172-298.900=-104.728
min2841.000-2853.000=-12.000
max3313.000-3544.000=-231.000
mean8.503-8.703=-0.201
σ0.079-0.233=-0.154
min8.426-8.541=-0.115
max8.597-9.108=-0.511

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.036-1.006=0.030
σ0.235-0.123=0.111
min0.928-0.920=0.008
max1.456-1.201=0.254

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean469.482-472.845=-3.362
σ574.935-574.927=0.008
min182.004-185.376=-3.372
max1331.885-1335.236=-3.351
mean88.250
σ8.500
min84.000
max101.000
mean2841.000-2853.000=-12.000
σ0.000
min2841.000-2853.000=-12.000
max2841.000-2853.000=-12.000
mean0.449-0.486=-0.037
σ0.304-0.372=-0.068
min0.295-0.298=-0.003
max0.906-1.044=-0.138
policies=20
mean1820.381-1854.021=-33.639
σ0.383-0.367=0.016
min1820.098-1853.743=-33.645
max1820.943-1854.555=-33.612
mean840.000
σ0.000
min840.000
max840.000
mean2841.000-2853.000=-12.000
σ0.000
min2841.000-2853.000=-12.000
max2841.000-2853.000=-12.000
mean2.915-2.950=-0.035
σ0.005-0.006=-0.001
min2.908-2.943=-0.036
max2.919-2.958=-0.040
policies=200
mean18210.581-18546.648=-336.067
σ0.434-0.565=-0.132
min18210.326-18546.324=-335.998
max18211.230-18547.492=-336.262
mean8400.000
σ0.000
min8400.000
max8400.000
mean2841.000-2853.000=-12.000
σ0.000
min2841.000-2853.000=-12.000
max2841.000-2853.000=-12.000
mean28.875-29.193=-0.317
σ0.458-0.439=0.019
min28.472-28.791=-0.320
max29.426-29.722=-0.296