Compare commits

Home / Compare 02677f55 .. 773a1a1f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.699-70.781=-0.082
σ0.048-0.045=0.003
min70.667-70.751=-0.084
max70.831-70.906=-0.074
mean420.000-416.000=4.000
σ0.000
min420.000-416.000=4.000
max420.000-416.000=4.000
mean0.159-0.159=0.000
σ0.005-0.005=0.001
min0.150-0.150=-0.000
max0.167-0.165=0.002
cache=y
dps=1
iters=10
policies=100
mean21.409-21.492=-0.083
σ0.003-0.003=0.000
min21.405-21.488=-0.083
max21.414-21.496=-0.082
mean420.000-416.000=4.000
σ0.000
min420.000-416.000=4.000
max420.000-416.000=4.000
mean0.066-0.065=0.000
σ0.003-0.003=-0.000
min0.064-0.063=0.000
max0.073-0.074=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.898-1754.895=0.003
σ0.361-0.361=0.001
min1754.336-1754.330=0.006
max1755.477-1755.478=-0.001
mean1630.550-1636.150=-5.600
σ606.205-606.544=-0.339
min667.000-646.000=21.000
max2439.000-2435.000=4.000
mean2.865-2.750=0.115
σ0.112-0.235=-0.123
min2.726-2.201=0.525
max3.098-3.046=0.053

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.760-272.760=-0.000
σ0.007-0.005=0.002
min272.752-272.755=-0.003
max272.769-272.768=0.002
mean2439.000-2435.000=4.000
σ0.000
min2439.000-2435.000=4.000
max2439.000-2435.000=4.000
mean0.387-0.382=0.006
σ0.008-0.001=0.006
min0.383-0.380=0.003
max0.401-0.383=0.017
iters=5
new-facts=1
prior-facts=6402
mean1933.131-1792.866=140.264
σ0.003-313.660=-313.657
min1933.126-1231.774=701.352
max1933.134-1933.162=-0.028
mean2439.000-2435.000=4.000
σ0.000
min2439.000-2435.000=4.000
max2439.000-2435.000=4.000
mean3.143-2.812=0.330
σ0.136-0.644=-0.507
min3.013-1.681=1.332
max3.293-3.300=-0.007
iters=5
new-facts=6402
prior-facts=1
mean4753.833-4753.875=-0.042
σ0.642-0.985=-0.343
min4753.384-4753.376=0.008
max4754.967-4755.634=-0.667
mean2439.000-2435.000=4.000
σ0.000
min2439.000-2435.000=4.000
max2439.000-2435.000=4.000
mean8.181-8.811=-0.630
σ0.558-0.639=-0.080
min7.711-7.884=-0.173
max9.008-9.566=-0.558
iters=5
new-facts=6402
prior-facts=6402
mean4944.364-4944.289=0.076
σ0.013-0.167=-0.154
min4944.350-4943.990=0.359
max4944.378-4944.372=0.006
mean2928.400-2821.200=107.200
σ389.628-330.353=59.275
min2439.000-2435.000=4.000
max3446.000-3269.000=177.000
mean8.479-8.404=0.074
σ0.114-0.074=0.040
min8.382-8.329=0.054
max8.619-8.507=0.113

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.794-1.798=-0.003
σ0.117-0.071=0.047
min1.605-1.733=-0.128
max1.893-1.897=-0.004

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.625-468.652=-0.028
σ574.876-574.923=-0.047
min181.181-181.189=-0.008
max1330.938-1331.036=-0.098
mean88.250
σ8.500
min84.000
max101.000
mean2439.000-2435.000=4.000
σ0.000
min2439.000-2435.000=4.000
max2439.000-2435.000=4.000
mean0.565-0.571=-0.005
σ0.548-0.554=-0.006
min0.289-0.289=-0.000
max1.387-1.402=-0.014
policies=20
mean1812.167-1812.199=-0.031
σ0.397-0.390=0.007
min1811.896-1811.935=-0.039
max1812.752-1812.775=-0.023
mean840.000
σ0.000
min840.000
max840.000
mean2439.000-2435.000=4.000
σ0.000
min2439.000-2435.000=4.000
max2439.000-2435.000=4.000
mean2.868-2.831=0.037
σ0.038-0.016=0.022
min2.830-2.807=0.023
max2.907-2.840=0.067
policies=200
mean18128.977-18129.204=-0.228
σ0.527-0.503=0.024
min18128.589-18128.899=-0.311
max18129.737-18129.955=-0.219
mean8400.000
σ0.000
min8400.000
max8400.000
mean2439.000-2435.000=4.000
σ0.000
min2439.000-2435.000=4.000
max2439.000-2435.000=4.000
mean28.790-28.657=0.133
σ0.209-0.087=0.121
min28.673-28.552=0.121
max29.103-28.762=0.341