Compare commits

Home / Compare 9ea1471d .. 88de4ace

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.697-70.697=0.001
σ0.048-0.046=0.002
min70.665-70.669=-0.003
max70.828-70.824=0.004
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.157-0.158=-0.001
σ0.005-0.005=0.000
min0.151-0.150=0.001
max0.166-0.167=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.409-21.409=-0.000
σ0.002-0.003=-0.001
min21.406-21.405=0.001
max21.412-21.413=-0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.065-0.066=-0.001
σ0.003-0.003=0.000
min0.063-0.064=-0.001
max0.073-0.073=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.896-1754.897=-0.001
σ0.362-0.361=0.001
min1754.329-1754.340=-0.011
max1755.481-1755.480=0.001
mean1630.650-1628.400=2.250
σ620.050-609.832=10.219
min623.000-661.000=-38.000
max2762.000-2445.000=317.000
mean2.803-2.797=0.006
σ0.247-0.188=0.059
min2.244-2.414=-0.170
max3.116-3.109=0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.759-272.755=0.003
σ0.005-0.006=-0.001
min272.752-272.747=0.005
max272.764-272.763=0.002
mean2762.000-2445.000=317.000
σ0.000
min2762.000-2445.000=317.000
max2762.000-2445.000=317.000
mean0.384-0.388=-0.004
σ0.005-0.007=-0.003
min0.381-0.381=-0.001
max0.392-0.397=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1933.123-1933.128=-0.005
σ0.020-0.017=0.003
min1933.093-1933.107=-0.014
max1933.141-1933.147=-0.006
mean2762.000-2445.000=317.000
σ0.000
min2762.000-2445.000=317.000
max2762.000-2445.000=317.000
mean3.033-2.992=0.041
σ0.421-0.195=0.226
min2.476-2.721=-0.245
max3.664-3.181=0.482
iters=5
new-facts=6402
prior-facts=1
mean4753.915-4753.897=0.018
σ0.909-0.914=-0.005
min4753.364-4753.376=-0.012
max4755.530-4755.525=0.005
mean2762.000-2445.000=317.000
σ0.000
min2762.000-2445.000=317.000
max2762.000-2445.000=317.000
mean8.377-8.510=-0.133
σ0.537-0.438=0.100
min7.722-7.925=-0.203
max9.078-9.039=0.039
iters=5
new-facts=6402
prior-facts=6402
mean4944.364-4944.291=0.074
σ0.013-0.151=-0.137
min4944.348-4944.022=0.326
max4944.380-4944.375=0.005
mean2993.000-2875.600=117.400
σ287.566-364.389=-76.823
min2762.000-2445.000=317.000
max3423.000-3380.000=43.000
mean8.554-8.332=0.222
σ0.229-0.034=0.195
min8.334-8.277=0.057
max8.915-8.367=0.548

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.014-1.718=-0.704
σ0.118-0.144=-0.026
min0.933-1.547=-0.614
max1.199-1.909=-0.710

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.656-468.635=0.021
σ574.920-574.882=0.038
min181.184-181.190=-0.006
max1331.036-1330.958=0.078
mean88.250
σ8.500
min84.000
max101.000
mean2762.000-2445.000=317.000
σ0.000
min2762.000-2445.000=317.000
max2762.000-2445.000=317.000
mean0.595-0.573=0.023
σ0.620-0.574=0.046
min0.281-0.283=-0.002
max1.526-1.433=0.092
policies=20
mean1812.206-1812.206=0.000
σ0.394-0.392=0.002
min1811.924-1811.943=-0.019
max1812.786-1812.784=0.001
mean840.000
σ0.000
min840.000
max840.000
mean2762.000-2445.000=317.000
σ0.000
min2762.000-2445.000=317.000
max2762.000-2445.000=317.000
mean2.845-2.847=-0.002
σ0.017-0.014=0.004
min2.824-2.833=-0.009
max2.861-2.864=-0.003
policies=200
mean18129.081-18129.098=-0.018
σ0.479-0.259=0.220
min18128.766-18128.943=-0.177
max18129.781-18129.484=0.297
mean8400.000
σ0.000
min8400.000
max8400.000
mean2762.000-2445.000=317.000
σ0.000
min2762.000-2445.000=317.000
max2762.000-2445.000=317.000
mean28.637-28.726=-0.089
σ0.048-0.100=-0.052
min28.583-28.596=-0.013
max28.691-28.833=-0.142