Compare commits

Home / Compare 95f5cb5a .. c5f508f2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.980=0.000
σ0.048-0.048=-0.001
min33.946-33.952=-0.006
max34.110-34.114=-0.004
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.084-0.084=0.000
σ0.004-0.004=0.001
min0.078-0.082=-0.004
max0.092-0.092=0.000
cache=y
dps=1
iters=10
policies=100
mean23.316-23.316=-0.000
σ0.003-0.002=0.001
min23.312-23.312=-0.000
max23.323-23.320=0.003
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.061-0.064=-0.002
σ0.003-0.003=-0.000
min0.059-0.060=-0.001
max0.069-0.069=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.429-1757.431=-0.002
σ0.366-0.365=0.001
min1756.854-1756.855=-0.001
max1758.015-1758.022=-0.008
mean1670.750-1647.500=23.250
σ642.806-625.552=17.254
min679.000-637.000=42.000
max2649.000-2838.000=-189.000
mean2.353-2.361=-0.008
σ0.086-0.090=-0.004
min2.230-2.222=0.008
max2.536-2.646=-0.110

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.570-326.572=-0.002
σ0.063-0.051=0.013
min326.459-326.484=-0.024
max326.612-326.610=0.003
mean2649.000-2838.000=-189.000
σ0.000
min2649.000-2838.000=-189.000
max2649.000-2838.000=-189.000
mean0.439-0.422=0.017
σ0.014-0.002=0.012
min0.421-0.419=0.002
max0.455-0.424=0.031
iters=5
new-facts=1
prior-facts=6402
mean1988.739-1988.742=-0.003
σ0.016-0.006=0.010
min1988.722-1988.732=-0.010
max1988.760-1988.748=0.012
mean2649.000-2838.000=-189.000
σ0.000
min2649.000-2838.000=-189.000
max2649.000-2838.000=-189.000
mean2.724-2.754=-0.029
σ0.090-0.175=-0.085
min2.636-2.656=-0.019
max2.872-3.066=-0.194
iters=5
new-facts=6402
prior-facts=1
mean4813.491-4813.602=-0.111
σ7.803-7.724=0.080
min4809.522-4810.044=-0.523
max4827.441-4827.418=0.023
mean2649.000-2838.000=-189.000
σ0.000
min2649.000-2838.000=-189.000
max2649.000-2838.000=-189.000
mean8.469-8.470=-0.001
σ0.642-0.430=0.212
min7.707-8.083=-0.376
max9.251-9.165=0.086
iters=5
new-facts=6402
prior-facts=6402
mean5001.134-5001.052=0.083
σ0.036-0.164=-0.127
min5001.108-5000.761=0.347
max5001.194-5001.142=0.052
mean2960.200-3068.600=-108.400
σ326.651-314.593=12.058
min2649.000-2838.000=-189.000
max3427.000-3558.000=-131.000
mean9.811-9.690=0.121
σ0.187-0.236=-0.049
min9.666-9.302=0.364
max10.135-9.914=0.221

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.266-0.924=0.342
σ0.366-0.008=0.358
min0.919-0.918=0.001
max1.838-0.938=0.899

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.569-464.565=0.003
σ574.786-574.766=0.021
min177.169-177.177=-0.008
max1326.748-1326.714=0.034
mean88.250
σ8.500
min84.000
max101.000
mean2649.000-2838.000=-189.000
σ0.000
min2649.000-2838.000=-189.000
max2649.000-2838.000=-189.000
mean0.557-0.433=0.124
σ0.565-0.307=0.258
min0.273-0.277=-0.004
max1.405-0.894=0.511
policies=20
mean1772.028-1772.076=-0.047
σ0.340-0.364=-0.024
min1771.798-1771.837=-0.039
max1772.532-1772.616=-0.084
mean840.000
σ0.000
min840.000
max840.000
mean2649.000-2838.000=-189.000
σ0.000
min2649.000-2838.000=-189.000
max2649.000-2838.000=-189.000
mean2.724-2.788=-0.064
σ0.016-0.018=-0.003
min2.706-2.766=-0.060
max2.744-2.807=-0.063
policies=200
mean17727.486-17727.649=-0.163
σ0.637-0.454=0.183
min17727.055-17727.278=-0.224
max17728.429-17728.312=0.117
mean8400.000
σ0.000
min8400.000
max8400.000
mean2649.000-2838.000=-189.000
σ0.000
min2649.000-2838.000=-189.000
max2649.000-2838.000=-189.000
mean27.490-27.924=-0.434
σ0.143-0.470=-0.326
min27.305-27.509=-0.204
max27.656-28.396=-0.740