Compare commits

Home / Compare 43339168 .. 1e0f03c5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.563=0.003
σ0.046-0.045=0.001
min70.532-70.541=-0.009
max70.691-70.690=0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.160-0.159=0.001
σ0.004-0.002=0.002
min0.154-0.157=-0.004
max0.167-0.163=0.004
cache=y
dps=1
iters=10
policies=100
mean21.287-21.292=-0.004
σ0.003-0.010=-0.007
min21.281-21.286=-0.005
max21.292-21.319=-0.027
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.062-0.064=-0.001
σ0.003-0.003=-0.000
min0.059-0.059=-0.000
max0.067-0.072=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.568-1753.569=-0.002
σ0.360-0.361=-0.002
min1753.002-1753.000=0.002
max1754.153-1754.167=-0.014
mean1666.900-1640.750=26.150
σ646.692-601.480=45.212
min688.000-643.000=45.000
max2773.000-2425.000=348.000
mean2.829-2.789=0.040
σ0.140-0.169=-0.029
min2.428-2.342=0.085
max3.007-3.119=-0.111

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.014-272.017=-0.003
σ0.009-0.011=-0.002
min272.000-272.002=-0.001
max272.022-272.031=-0.009
mean2773.000-2425.000=348.000
σ0.000
min2773.000-2425.000=348.000
max2773.000-2425.000=348.000
mean0.387-0.399=-0.012
σ0.008-0.017=-0.010
min0.377-0.378=-0.001
max0.395-0.418=-0.022
iters=5
new-facts=1
prior-facts=6402
mean1932.433-1932.435=-0.002
σ0.007-0.005=0.002
min1932.426-1932.429=-0.003
max1932.444-1932.440=0.004
mean2773.000-2425.000=348.000
σ0.000
min2773.000-2425.000=348.000
max2773.000-2425.000=348.000
mean3.054-2.908=0.147
σ0.198-0.125=0.073
min2.931-2.767=0.165
max3.406-3.038=0.368
iters=5
new-facts=6402
prior-facts=1
mean4753.213-4752.930=0.283
σ0.839-0.360=0.479
min4752.760-4752.678=0.082
max4754.708-4753.559=1.150
mean2773.000-2425.000=348.000
σ0.000
min2773.000-2425.000=348.000
max2773.000-2425.000=348.000
mean8.211-8.641=-0.429
σ0.390-0.272=0.118
min7.735-8.294=-0.558
max8.703-8.988=-0.285
iters=5
new-facts=6402
prior-facts=6402
mean4943.554-4943.633=-0.079
σ0.151-0.015=0.135
min4943.285-4943.619=-0.334
max4943.629-4943.652=-0.022
mean3053.800-2996.000=57.800
σ340.625-264.791=75.833
min2773.000-2632.000=141.000
max3565.000-3299.000=266.000
mean8.455-8.457=-0.002
σ0.120-0.231=-0.111
min8.362-8.157=0.205
max8.661-8.764=-0.103

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.045-1.836=-0.792
σ0.129-0.074=0.055
min0.931-1.732=-0.801
max1.247-1.909=-0.662

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.091-473.071=0.020
σ575.948-575.910=0.038
min185.112-185.112=-0.000
max1337.013-1336.935=0.078
mean88.250
σ8.500
min84.000
max101.000
mean2773.000-2425.000=348.000
σ0.000
min2773.000-2425.000=348.000
max2773.000-2425.000=348.000
mean0.556-0.561=-0.005
σ0.547-0.540=0.006
min0.268-0.290=-0.021
max1.376-1.372=0.004
policies=20
mean1851.425-1851.426=-0.001
σ0.385-0.369=0.015
min1851.159-1851.173=-0.014
max1851.994-1851.970=0.024
mean840.000
σ0.000
min840.000
max840.000
mean2773.000-2425.000=348.000
σ0.000
min2773.000-2425.000=348.000
max2773.000-2425.000=348.000
mean2.855-2.865=-0.009
σ0.015-0.022=-0.007
min2.842-2.840=0.002
max2.875-2.894=-0.018
policies=200
mean18521.043-18521.090=-0.047
σ0.425-0.340=0.085
min18520.728-18520.894=-0.166
max18521.667-18521.600=0.068
mean8400.000
σ0.000
min8400.000
max8400.000
mean2773.000-2425.000=348.000
σ0.000
min2773.000-2425.000=348.000
max2773.000-2425.000=348.000
mean28.892-28.947=-0.055
σ0.129-0.066=0.063
min28.790-28.865=-0.075
max29.080-29.020=0.060