Compare commits

Home / Compare 9e5b3d72 .. cf01fea4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.730-70.728=0.002
σ0.053-0.052=0.001
min70.699-70.695=0.004
max70.877-70.872=0.006
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.159-0.158=0.001
σ0.004-0.005=-0.001
min0.155-0.152=0.002
max0.169-0.167=0.001
cache=y
dps=1
iters=10
policies=100
mean21.446-21.445=0.001
σ0.003-0.003=-0.001
min21.442-21.442=-0.000
max21.450-21.451=-0.002
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.065-0.064=0.001
σ0.002-0.003=-0.001
min0.061-0.059=0.002
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.288-1755.286=0.002
σ0.361-0.358=0.003
min1754.708-1754.723=-0.014
max1755.872-1755.858=0.013
mean1653.350-1649.900=3.450
σ629.319-631.887=-2.568
min623.000-640.000=-17.000
max2850.000-2849.000=1.000
mean2.889-2.888=0.001
σ0.081-0.177=-0.097
min2.739-2.598=0.141
max3.039-3.403=-0.365

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean274.366-274.364=0.002
σ0.013-0.014=-0.001
min274.353-274.349=0.004
max274.382-274.384=-0.002
mean2850.000-2849.000=1.000
σ0.000
min2850.000-2849.000=1.000
max2850.000-2849.000=1.000
mean0.385-0.386=-0.002
σ0.001-0.005=-0.004
min0.383-0.383=0.001
max0.386-0.396=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1934.757-1934.757=-0.000
σ0.023-0.010=0.012
min1934.730-1934.744=-0.014
max1934.790-1934.770=0.020
mean2850.000-2849.000=1.000
σ0.000
min2850.000-2849.000=1.000
max2850.000-2849.000=1.000
mean2.873-3.163=-0.290
σ0.267-0.156=0.111
min2.405-3.018=-0.613
max3.051-3.392=-0.341
iters=5
new-facts=6402
prior-facts=1
mean4755.373-4755.279=0.094
σ1.018-1.043=-0.025
min4754.504-4754.536=-0.032
max4757.137-4757.078=0.058
mean2850.000-2849.000=1.000
σ0.000
min2850.000-2849.000=1.000
max2850.000-2849.000=1.000
mean8.925-8.780=0.145
σ0.211-0.243=-0.031
min8.592-8.508=0.084
max9.094-9.038=0.056
iters=5
new-facts=6402
prior-facts=6402
mean4945.988-4945.977=0.010
σ0.017-0.014=0.003
min4945.970-4945.960=0.009
max4946.007-4945.992=0.016
mean3027.600-3060.000=-32.400
σ200.993-272.310=-71.317
min2850.000-2849.000=1.000
max3340.000-3479.000=-139.000
mean8.563-8.425=0.138
σ0.085-0.116=-0.031
min8.437-8.333=0.104
max8.674-8.627=0.046

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.059-1.025=0.034
σ0.270-0.137=0.133
min0.934-0.930=0.004
max1.542-1.249=0.293

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.845-472.840=0.005
σ574.940-574.925=0.015
min185.367-185.368=-0.001
max1335.255-1335.228=0.027
mean88.250
σ8.500
min84.000
max101.000
mean2850.000-2849.000=1.000
σ0.000
min2850.000-2849.000=1.000
max2850.000-2849.000=1.000
mean0.449-0.484=-0.036
σ0.295-0.370=-0.075
min0.298-0.297=0.000
max0.891-1.039=-0.148
policies=20
mean1853.999-1854.005=-0.006
σ0.370-0.370=0.000
min1853.711-1853.734=-0.023
max1854.536-1854.545=-0.009
mean840.000
σ0.000
min840.000
max840.000
mean2850.000-2849.000=1.000
σ0.000
min2850.000-2849.000=1.000
max2850.000-2849.000=1.000
mean2.961-2.961=-0.001
σ0.009-0.014=-0.004
min2.952-2.950=0.002
max2.973-2.977=-0.004
policies=200
mean18546.725-18546.709=0.016
σ0.505-0.500=0.005
min18546.402-18546.417=-0.015
max18547.476-18547.457=0.019
mean8400.000
σ0.000
min8400.000
max8400.000
mean2850.000-2849.000=1.000
σ0.000
min2850.000-2849.000=1.000
max2850.000-2849.000=1.000
mean29.378-29.345=0.033
σ0.463-0.425=0.038
min28.883-28.938=-0.054
max29.817-29.789=0.027