Compare commits

Home / Compare aac57b09 .. c03e2d64

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.703-70.701=0.002
σ0.047-0.046=0.002
min70.671-70.674=-0.004
max70.835-70.829=0.006
mean415.000-415.900=-0.900
σ0.000-0.316=-0.316
min415.000
max415.000-416.000=-1.000
mean0.160-0.159=0.001
σ0.004-0.006=-0.002
min0.153-0.150=0.003
max0.167-0.167=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.408-21.409=-0.001
σ0.003-0.003=0.000
min21.403-21.405=-0.002
max21.414-21.414=-0.001
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.064-0.065=-0.001
σ0.004-0.003=0.001
min0.058-0.063=-0.005
max0.074-0.074=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.899-1716.959=37.939
σ0.363-169.530=-169.167
min1754.324-996.709=757.615
max1755.482-1755.414=0.069
mean1637.550-1637.150=0.400
σ618.937-611.781=7.156
min630.000-635.000=-5.000
max2479.000-2461.000=18.000
mean2.840-2.727=0.114
σ0.094-0.358=-0.264
min2.650-1.376=1.274
max2.994-3.026=-0.032

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.758-272.746=0.012
σ0.006-0.015=-0.008
min272.748-272.722=0.025
max272.763-272.760=0.003
mean2479.000-2461.000=18.000
σ0.000
min2479.000-2461.000=18.000
max2479.000-2461.000=18.000
mean0.386-0.385=0.002
σ0.007-0.002=0.006
min0.381-0.383=-0.002
max0.400-0.388=0.012
iters=5
new-facts=1
prior-facts=6402
mean1933.129-1933.124=0.005
σ0.010-0.012=-0.002
min1933.122-1933.110=0.012
max1933.147-1933.137=0.009
mean2479.000-2461.000=18.000
σ0.000
min2479.000-2461.000=18.000
max2479.000-2461.000=18.000
mean3.056-3.067=-0.011
σ0.054-0.170=-0.116
min3.021-2.852=0.169
max3.151-3.312=-0.161
iters=5
new-facts=6402
prior-facts=1
mean4753.860-4753.883=-0.023
σ0.933-0.934=-0.002
min4753.416-4753.393=0.023
max4755.527-4755.549=-0.022
mean2479.000-2461.000=18.000
σ0.000
min2479.000-2461.000=18.000
max2479.000-2461.000=18.000
mean8.733-8.653=0.080
σ0.475-0.542=-0.066
min7.945-7.800=0.145
max9.069-9.108=-0.038
iters=5
new-facts=6402
prior-facts=6402
mean4944.360-4944.285=0.075
σ0.020-0.168=-0.148
min4944.330-4943.986=0.345
max4944.377-4944.378=-0.001
mean2918.000-2915.600=2.400
σ374.483-393.182=-18.699
min2479.000-2461.000=18.000
max3420.000-3465.000=-45.000
mean8.426-8.414=0.012
σ0.056-0.047=0.010
min8.353-8.362=-0.008
max8.506-8.470=0.035

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.626-1.559=0.067
σ0.087-0.071=0.016
min1.552-1.447=0.106
max1.728-1.634=0.095

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean469.002-469.005=-0.003
σ575.616-575.625=-0.009
min181.190-181.187=0.002
max1332.425-1332.442=-0.017
mean88.250
σ8.500
min84.000
max101.000
mean2479.000-2461.000=18.000
σ0.000
min2479.000-2461.000=18.000
max2479.000-2461.000=18.000
mean0.576-0.583=-0.007
σ0.576-0.586=-0.010
min0.286-0.287=-0.000
max1.440-1.462=-0.022
policies=20
mean1812.191-1812.207=-0.015
σ0.380-0.393=-0.013
min1811.940-1811.939=0.000
max1812.751-1812.785=-0.034
mean840.000
σ0.000
min840.000
max840.000
mean2479.000-2461.000=18.000
σ0.000
min2479.000-2461.000=18.000
max2479.000-2461.000=18.000
mean2.845-2.871=-0.026
σ0.014-0.029=-0.016
min2.826-2.844=-0.017
max2.859-2.911=-0.052
policies=200
mean18129.227-18129.174=0.053
σ0.466-0.364=0.102
min18128.902-18128.870=0.032
max18129.918-18129.703=0.215
mean8400.000
σ0.000
min8400.000
max8400.000
mean2479.000-2461.000=18.000
σ0.000
min2479.000-2461.000=18.000
max2479.000-2461.000=18.000
mean28.632-28.692=-0.061
σ0.105-0.096=0.009
min28.533-28.572=-0.038
max28.779-28.804=-0.025