Compare commits

Home / Compare 1eecfa4e .. 4d834549

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.700-70.374=0.326
σ0.047-0.057=-0.010
min70.673-70.341=0.332
max70.832-70.535=0.297
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.152-0.156=-0.005
σ0.011-0.004=0.006
min0.126-0.148=-0.023
max0.165-0.163=0.002
cache=y
dps=1
iters=10
policies=100
mean21.407-21.144=0.263
σ0.001-0.002=-0.001
min21.405-21.139=0.266
max21.409-21.148=0.261
mean415.800-413.000=2.800
σ0.422-0.000=0.422
min415.000-413.000=2.000
max416.000-413.000=3.000
mean0.053-0.064=-0.010
σ0.004-0.003=0.001
min0.050-0.058=-0.008
max0.061-0.069=-0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.932-1752.201=2.731
σ0.363-0.361=0.002
min1754.367-1751.627=2.741
max1755.529-1752.795=2.734
mean1667.500-1649.100=18.400
σ620.926-618.747=2.178
min625.000-673.000=-48.000
max2504.000-2641.000=-137.000
mean2.795-2.818=-0.024
σ0.186-0.172=0.014
min2.178-2.463=-0.286
max3.034-3.205=-0.172

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.756-269.936=2.820
σ0.008-0.007=0.001
min272.744-269.929=2.815
max272.766-269.947=2.819
mean2504.000-2641.000=-137.000
σ0.000
min2504.000-2641.000=-137.000
max2504.000-2641.000=-137.000
mean0.383-0.383=0.000
σ0.010-0.008=0.002
min0.371-0.371=-0.000
max0.397-0.391=0.007
iters=5
new-facts=1
prior-facts=6402
mean1933.158-1930.401=2.757
σ0.017-0.023=-0.005
min1933.130-1930.364=2.766
max1933.177-1930.422=2.754
mean2504.000-2641.000=-137.000
σ0.000
min2504.000-2641.000=-137.000
max2504.000-2641.000=-137.000
mean3.070-2.557=0.513
σ0.214-0.158=0.056
min2.771-2.473=0.298
max3.373-2.839=0.534
iters=5
new-facts=6402
prior-facts=1
mean4756.813-4750.609=6.204
σ7.653-1.103=6.550
min4753.000-4749.209=3.791
max4770.497-4752.284=18.213
mean2504.000-2641.000=-137.000
σ0.000
min2504.000-2641.000=-137.000
max2504.000-2641.000=-137.000
mean8.513-8.766=-0.253
σ0.427-0.292=0.135
min7.843-8.380=-0.537
max9.034-9.055=-0.021
iters=5
new-facts=6402
prior-facts=6402
mean4944.398-4941.266=3.131
σ0.025-0.200=-0.175
min4944.363-4940.939=3.424
max4944.423-4941.431=2.992
mean2961.400-2974.000=-12.600
σ402.498-262.865=139.633
min2504.000-2646.000=-142.000
max3479.000-3332.000=147.000
mean8.495-8.518=-0.022
σ0.086-0.192=-0.106
min8.408-8.298=0.110
max8.616-8.777=-0.161

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.620-1.141=0.479
σ0.274-0.183=0.091
min1.223-0.933=0.289
max1.842-1.402=0.440

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.319-465.911=2.408
σ574.258-575.769=-1.511
min181.187-178.021=3.166
max1329.706-1329.564=0.142
mean88.250-81.750=6.500
σ8.500-7.500=1.000
min84.000-78.000=6.000
max101.000-93.000=8.000
mean2504.000-2641.000=-137.000
σ0.000
min2504.000-2641.000=-137.000
max2504.000-2641.000=-137.000
mean0.560-0.538=0.023
σ0.548-0.516=0.032
min0.285-0.278=0.006
max1.382-1.311=0.071
policies=20
mean1812.181-1780.438=31.743
σ0.386-0.344=0.043
min1811.932-1780.228=31.704
max1812.753-1780.950=31.803
mean840.000-780.000=60.000
σ0.000
min840.000-780.000=60.000
max840.000-780.000=60.000
mean2504.000-2641.000=-137.000
σ0.000
min2504.000-2641.000=-137.000
max2504.000-2641.000=-137.000
mean2.825-2.752=0.073
σ0.010-0.012=-0.002
min2.812-2.737=0.074
max2.836-2.763=0.073
policies=200
mean18128.905-17811.420=317.484
σ0.629-0.573=0.057
min18128.495-17811.037=317.457
max18129.842-17812.259=317.583
mean8400.000-7800.000=600.000
σ0.000
min8400.000-7800.000=600.000
max8400.000-7800.000=600.000
mean2504.000-2641.000=-137.000
σ0.000
min2504.000-2641.000=-137.000
max2504.000-2641.000=-137.000
mean28.423-27.806=0.616
σ0.009-0.092=-0.083
min28.415-27.715=0.700
max28.435-27.920=0.514