Compare commits

Home / Compare e581033f .. 4436ca1a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.784-70.781=0.002
σ0.047-0.045=0.002
min70.748-70.751=-0.002
max70.914-70.906=0.008
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.158-0.159=-0.001
σ0.005-0.005=0.000
min0.150-0.150=0.000
max0.165-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.493-21.492=0.001
σ0.002-0.003=-0.001
min21.490-21.488=0.002
max21.496-21.496=-0.001
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.065-0.065=0.000
σ0.002-0.003=-0.001
min0.064-0.063=0.000
max0.072-0.074=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.895-1754.895=0.001
σ0.360-0.361=-0.001
min1754.322-1754.330=-0.009
max1755.486-1755.478=0.007
mean1665.700-1636.150=29.550
σ642.651-606.544=36.107
min678.000-646.000=32.000
max2704.000-2435.000=269.000
mean2.798-2.750=0.049
σ0.254-0.235=0.019
min2.150-2.201=-0.051
max3.503-3.046=0.457

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.759-272.760=-0.001
σ0.006-0.005=0.001
min272.754-272.755=-0.001
max272.767-272.768=-0.000
mean2704.000-2435.000=269.000
σ0.000
min2704.000-2435.000=269.000
max2704.000-2435.000=269.000
mean0.383-0.382=0.002
σ0.004-0.001=0.003
min0.379-0.380=-0.001
max0.390-0.383=0.006
iters=5
new-facts=1
prior-facts=6402
mean1933.130-1792.866=140.264
σ0.011-313.660=-313.650
min1933.121-1231.774=701.347
max1933.146-1933.162=-0.016
mean2704.000-2435.000=269.000
σ0.000
min2704.000-2435.000=269.000
max2704.000-2435.000=269.000
mean3.103-2.812=0.290
σ0.094-0.644=-0.549
min2.990-1.681=1.309
max3.189-3.300=-0.111
iters=5
new-facts=6402
prior-facts=1
mean4753.838-4753.875=-0.038
σ0.938-0.985=-0.047
min4753.128-4753.376=-0.248
max4755.479-4755.634=-0.155
mean2704.000-2435.000=269.000
σ0.000
min2704.000-2435.000=269.000
max2704.000-2435.000=269.000
mean8.480-8.811=-0.331
σ0.498-0.639=-0.141
min7.962-7.884=0.078
max9.063-9.566=-0.503
iters=5
new-facts=6402
prior-facts=6402
mean4944.357-4944.289=0.068
σ0.018-0.167=-0.148
min4944.332-4943.990=0.341
max4944.375-4944.372=0.003
mean2996.000-2821.200=174.800
σ328.917-330.353=-1.436
min2704.000-2435.000=269.000
max3465.000-3269.000=196.000
mean8.433-8.404=0.029
σ0.095-0.074=0.022
min8.327-8.329=-0.002
max8.564-8.507=0.058

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.104-1.798=-0.694
σ0.142-0.071=0.072
min0.930-1.733=-0.803
max1.257-1.897=-0.640

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.644-468.652=-0.008
σ574.894-574.923=-0.029
min181.186-181.189=-0.003
max1330.985-1331.036=-0.051
mean88.250
σ8.500
min84.000
max101.000
mean2704.000-2435.000=269.000
σ0.000
min2704.000-2435.000=269.000
max2704.000-2435.000=269.000
mean0.583-0.571=0.013
σ0.594-0.554=0.040
min0.284-0.289=-0.004
max1.475-1.402=0.073
policies=20
mean1812.172-1812.199=-0.027
σ0.379-0.390=-0.011
min1811.926-1811.935=-0.009
max1812.733-1812.775=-0.041
mean840.000
σ0.000
min840.000
max840.000
mean2704.000-2435.000=269.000
σ0.000
min2704.000-2435.000=269.000
max2704.000-2435.000=269.000
mean2.833-2.831=0.002
σ0.022-0.016=0.006
min2.804-2.807=-0.003
max2.856-2.840=0.016
policies=200
mean18129.190-18129.204=-0.014
σ0.528-0.503=0.024
min18128.806-18128.899=-0.093
max18129.970-18129.955=0.015
mean8400.000
σ0.000
min8400.000
max8400.000
mean2704.000-2435.000=269.000
σ0.000
min2704.000-2435.000=269.000
max2704.000-2435.000=269.000
mean28.500-28.657=-0.156
σ0.071-0.087=-0.016
min28.413-28.552=-0.140
max28.563-28.762=-0.199