Compare commits

Home / Compare f13bed70 .. d50e4510

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.708-70.706=0.002
σ0.048-0.047=0.001
min70.672-70.680=-0.008
max70.841-70.838=0.003
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.159-0.155=0.004
σ0.004-0.004=-0.000
min0.156-0.149=0.007
max0.165-0.162=0.003
cache=y
dps=1
iters=10
policies=100
mean21.411-21.413=-0.001
σ0.003-0.002=0.000
min21.408-21.409=-0.002
max21.415-21.416=-0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.065-0.065=0.000
σ0.003-0.003=0.000
min0.063-0.063=-0.000
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.934-1754.930=0.004
σ0.358-0.361=-0.002
min1754.358-1754.357=0.001
max1755.516-1755.522=-0.006
mean1661.750-1655.950=5.800
σ646.843-620.054=26.789
min625.000-682.000=-57.000
max2780.000-2770.000=10.000
mean2.866-2.778=0.088
σ0.101-0.163=-0.062
min2.744-2.316=0.429
max3.106-3.014=0.092

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.787-272.779=0.008
σ0.005-0.013=-0.007
min272.779-272.766=0.013
max272.792-272.794=-0.002
mean2780.000-2770.000=10.000
σ0.000
min2780.000-2770.000=10.000
max2780.000-2770.000=10.000
mean0.376-0.384=-0.008
σ0.002-0.010=-0.008
min0.374-0.378=-0.004
max0.378-0.403=-0.025
iters=5
new-facts=1
prior-facts=6402
mean1933.220-1933.227=-0.007
σ0.018-0.014=0.004
min1933.194-1933.206=-0.012
max1933.237-1933.241=-0.004
mean2780.000-2770.000=10.000
σ0.000
min2780.000-2770.000=10.000
max2780.000-2770.000=10.000
mean3.053-3.130=-0.077
σ0.046-0.146=-0.100
min3.008-3.026=-0.017
max3.125-3.376=-0.250
iters=5
new-facts=6402
prior-facts=1
mean4756.965-4756.939=0.026
σ7.562-7.667=-0.105
min4753.402-4753.435=-0.033
max4770.491-4770.654=-0.163
mean2780.000-2770.000=10.000
σ0.000
min2780.000-2770.000=10.000
max2780.000-2770.000=10.000
mean8.657-8.897=-0.240
σ0.562-0.425=0.137
min7.986-8.487=-0.501
max9.528-9.587=-0.059
iters=5
new-facts=6402
prior-facts=6402
mean4944.377-4944.449=-0.071
σ0.164-0.018=0.146
min4944.085-4944.429=-0.344
max4944.474-4944.472=0.002
mean3012.800-3037.400=-24.600
σ292.224-326.239=-34.015
min2780.000-2770.000=10.000
max3446.000-3526.000=-80.000
mean8.544-8.420=0.125
σ0.497-0.066=0.431
min8.273-8.350=-0.076
max9.429-8.517=0.912

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.031-1.003=0.028
σ0.129-0.145=-0.017
min0.914-0.905=0.009
max1.230-1.240=-0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.328-468.344=-0.016
σ574.226-574.233=-0.006
min181.206-181.221=-0.014
max1329.668-1329.693=-0.025
mean88.250
σ8.500
min84.000
max101.000
mean2780.000-2770.000=10.000
σ0.000
min2780.000-2770.000=10.000
max2780.000-2770.000=10.000
mean0.442-0.442=-0.000
σ0.305-0.299=0.005
min0.286-0.289=-0.003
max0.899-0.891=0.008
policies=20
mean1812.356-1812.545=-0.189
σ0.387-0.385=0.002
min1812.084-1812.281=-0.197
max1812.925-1813.112=-0.187
mean840.000
σ0.000
min840.000
max840.000
mean2780.000-2770.000=10.000
σ0.000
min2780.000-2770.000=10.000
max2780.000-2770.000=10.000
mean2.872-2.868=0.004
σ0.021-0.007=0.014
min2.846-2.860=-0.014
max2.897-2.876=0.020
policies=200
mean18129.146-18129.285=-0.139
σ0.323-0.493=-0.170
min18128.890-18128.917=-0.028
max18129.578-18129.966=-0.389
mean8400.000
σ0.000
min8400.000
max8400.000
mean2780.000-2770.000=10.000
σ0.000
min2780.000-2770.000=10.000
max2780.000-2770.000=10.000
mean28.385-28.342=0.043
σ0.213-0.227=-0.014
min28.201-28.104=0.097
max28.681-28.616=0.065