Compare commits

Home / Compare 7749a89f .. c7f1d819

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.695-70.697=-0.002
σ0.047-0.048=-0.001
min70.672-70.669=0.003
max70.827-70.832=-0.005
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.158-0.161=-0.003
σ0.004-0.004=0.000
min0.151-0.157=-0.006
max0.164-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.420-21.419=0.000
σ0.002-0.004=-0.002
min21.417-21.415=0.002
max21.423-21.427=-0.004
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.065-0.062=0.003
σ0.003-0.004=-0.001
min0.063-0.059=0.005
max0.074-0.071=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.459-1754.458=0.001
σ0.362-0.360=0.002
min1753.890-1753.893=-0.003
max1755.059-1755.039=0.020
mean1663.050-1647.450=15.600
σ635.748-635.064=0.684
min674.000-613.000=61.000
max2688.000-2774.000=-86.000
mean2.844-2.835=0.009
σ0.194-0.204=-0.010
min2.163-2.182=-0.019
max3.063-3.196=-0.134

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.500-273.499=0.000
σ0.007-0.007=-0.000
min273.489-273.490=-0.000
max273.508-273.508=-0.000
mean2688.000-2774.000=-86.000
σ0.000
min2688.000-2774.000=-86.000
max2688.000-2774.000=-86.000
mean0.373-0.380=-0.006
σ0.001-0.001=-0.000
min0.372-0.379=-0.007
max0.374-0.381=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1933.897-1933.892=0.004
σ0.013-0.021=-0.008
min1933.876-1933.864=0.013
max1933.906-1933.913=-0.007
mean2688.000-2774.000=-86.000
σ0.000
min2688.000-2774.000=-86.000
max2688.000-2774.000=-86.000
mean2.974-3.127=-0.153
σ0.065-0.198=-0.133
min2.872-2.919=-0.047
max3.054-3.368=-0.314
iters=5
new-facts=6402
prior-facts=1
mean4754.631-4754.587=0.044
σ0.878-0.893=-0.015
min4754.220-4754.137=0.083
max4756.201-4756.182=0.018
mean2688.000-2774.000=-86.000
σ0.000
min2688.000-2774.000=-86.000
max2688.000-2774.000=-86.000
mean8.768-8.884=-0.115
σ0.109-0.203=-0.093
min8.644-8.576=0.068
max8.930-9.047=-0.117
iters=5
new-facts=6402
prior-facts=6402
mean4944.905-4945.122=-0.216
σ0.323-0.020=0.303
min4944.390-4945.099=-0.709
max4945.136-4945.143=-0.007
mean2967.000-3078.800=-111.800
σ321.950-296.405=25.545
min2688.000-2774.000=-86.000
max3430.000-3371.000=59.000
mean8.485-8.702=-0.217
σ0.215-0.219=-0.005
min8.275-8.432=-0.157
max8.775-8.908=-0.133

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.076-1.030=0.046
σ0.149-0.133=0.015
min0.931-0.939=-0.008
max1.260-1.244=0.016

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.061-473.058=0.003
σ575.919-575.914=0.005
min185.093-185.095=-0.002
max1336.940-1336.929=0.010
mean88.250
σ8.500
min84.000
max101.000
mean2688.000-2774.000=-86.000
σ0.000
min2688.000-2774.000=-86.000
max2688.000-2774.000=-86.000
mean0.548-0.490=0.059
σ0.535-0.378=0.157
min0.266-0.297=-0.031
max1.350-1.057=0.294
policies=20
mean1851.252-1851.297=-0.045
σ0.393-0.374=0.019
min1850.986-1851.023=-0.037
max1851.832-1851.843=-0.011
mean840.000
σ0.000
min840.000
max840.000
mean2688.000-2774.000=-86.000
σ0.000
min2688.000-2774.000=-86.000
max2688.000-2774.000=-86.000
mean2.882-2.941=-0.059
σ0.039-0.110=-0.071
min2.853-2.840=0.013
max2.938-3.094=-0.156
policies=200
mean18519.331-18519.351=-0.019
σ0.399-0.365=0.034
min18519.050-18519.135=-0.085
max18519.907-18519.897=0.009
mean8400.000
σ0.000
min8400.000
max8400.000
mean2688.000-2774.000=-86.000
σ0.000
min2688.000-2774.000=-86.000
max2688.000-2774.000=-86.000
mean28.844-28.838=0.006
σ0.064-0.096=-0.032
min28.759-28.745=0.014
max28.912-28.933=-0.021