Compare commits

Home / Compare a4c2b492 .. c7e43967

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.706-70.706=0.000
σ0.046-0.048=-0.002
min70.674-70.674=0.001
max70.834-70.838=-0.004
mean417.800-415.000=2.800
σ0.422-0.000=0.422
min417.000-415.000=2.000
max418.000-415.000=3.000
mean0.159-0.156=0.003
σ0.006-0.006=-0.000
min0.145-0.148=-0.003
max0.165-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.412-21.412=-0.000
σ0.004-0.002=0.002
min21.407-21.409=-0.002
max21.419-21.414=0.005
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.065-0.065=-0.000
σ0.002-0.002=0.000
min0.063-0.063=0.000
max0.071-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.930-1754.932=-0.002
σ0.359-0.360=-0.001
min1754.366-1754.358=0.008
max1755.504-1755.519=-0.015
mean1630.850
σ597.899-593.962=3.937
min645.000-627.000=18.000
max2419.000-2416.000=3.000
mean2.809-2.805=0.003
σ0.207-0.193=0.014
min2.175-2.182=-0.007
max3.068-3.033=0.035

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.790-272.792=-0.002
σ0.008-0.006=0.001
min272.783-272.785=-0.001
max272.803-272.801=0.002
mean2419.000-2416.000=3.000
σ0.000
min2419.000-2416.000=3.000
max2419.000-2416.000=3.000
mean0.378-0.379=-0.002
σ0.002-0.005=-0.003
min0.376-0.376=0.000
max0.380-0.388=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1933.223-1933.222=0.001
σ0.010-0.015=-0.005
min1933.212-1933.201=0.012
max1933.235-1933.237=-0.002
mean2419.000-2416.000=3.000
σ0.000
min2419.000-2416.000=3.000
max2419.000-2416.000=3.000
mean2.980-3.066=-0.085
σ0.189-0.151=0.038
min2.738-2.874=-0.136
max3.193-3.275=-0.081
iters=5
new-facts=6402
prior-facts=1
mean4756.937-4756.957=-0.020
σ7.572-7.591=-0.019
min4753.480-4753.491=-0.011
max4770.483-4770.536=-0.054
mean2419.000-2416.000=3.000
σ0.000
min2419.000-2416.000=3.000
max2419.000-2416.000=3.000
mean8.597-8.532=0.065
σ0.393-0.369=0.024
min7.983-7.919=0.064
max8.972-8.865=0.107
iters=5
new-facts=6402
prior-facts=6402
mean4944.455-4944.378=0.077
σ0.018-0.145=-0.126
min4944.441-4944.121=0.320
max4944.476-4944.472=0.004
mean2979.000-2900.600=78.400
σ272.838-399.259=-126.421
min2608.000-2416.000=192.000
max3315.000-3438.000=-123.000
mean8.532-8.359=0.173
σ0.084-0.034=0.050
min8.406-8.320=0.086
max8.642-8.404=0.238

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.761-1.643=0.117
σ0.086-0.194=-0.108
min1.672-1.379=0.293
max1.856-1.828=0.029

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.301-468.303=-0.001
σ574.223-574.228=-0.005
min181.185-181.183=0.002
max1329.636-1329.645=-0.009
mean88.250
σ8.500
min84.000
max101.000
mean2419.000-2416.000=3.000
σ0.000
min2419.000-2416.000=3.000
max2419.000-2416.000=3.000
mean0.558-0.561=-0.003
σ0.539-0.551=-0.013
min0.281-0.277=0.004
max1.367-1.388=-0.022
policies=20
mean1812.163-1812.159=0.004
σ0.382-0.383=-0.000
min1811.909-1811.910=-0.001
max1812.728-1812.726=0.003
mean840.000
σ0.000
min840.000
max840.000
mean2419.000-2416.000=3.000
σ0.000
min2419.000-2416.000=3.000
max2419.000-2416.000=3.000
mean2.825-2.814=0.011
σ0.019-0.018=0.001
min2.804-2.795=0.009
max2.849-2.830=0.019
policies=200
mean18129.023-18129.134=-0.111
σ0.383-0.518=-0.135
min18128.740-18128.732=0.008
max18129.585-18129.895=-0.310
mean8400.000
σ0.000
min8400.000
max8400.000
mean2419.000-2416.000=3.000
σ0.000
min2419.000-2416.000=3.000
max2419.000-2416.000=3.000
mean28.469-28.384=0.085
σ0.030-0.030=0.000
min28.440-28.357=0.082
max28.511-28.415=0.097