Compare commits

Home / Compare 82dff322 .. 85ac4c41

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.562-70.567=-0.005
σ0.044-0.046=-0.002
min70.534-70.542=-0.008
max70.686-70.696=-0.010
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.159-0.159=0.000
σ0.004-0.004=0.000
min0.150-0.152=-0.002
max0.164-0.164=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.287-21.287=-0.000
σ0.002-0.003=-0.001
min21.284-21.283=0.001
max21.290-21.291=-0.001
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.061-0.063=-0.002
σ0.003-0.004=-0.000
min0.058-0.059=-0.001
max0.067-0.071=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1753.374=0.001
σ0.361-0.361=0.001
min1752.806-1752.802=0.004
max1753.952-1753.959=-0.007
mean1651.100-1664.300=-13.200
σ640.987-637.646=3.341
min634.000-677.000=-43.000
max2849.000-2694.000=155.000
mean2.824-2.772=0.052
σ0.105-0.156=-0.051
min2.610-2.448=0.162
max2.995-3.012=-0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.755-271.752=0.003
σ0.009-0.007=0.002
min271.749-271.744=0.005
max271.770-271.762=0.008
mean2849.000-2694.000=155.000
σ0.000
min2849.000-2694.000=155.000
max2849.000-2694.000=155.000
mean0.383-0.381=0.002
σ0.005-0.007=-0.002
min0.379-0.377=0.002
max0.391-0.393=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.175-1932.178=-0.003
σ0.009-0.015=-0.007
min1932.165-1932.160=0.006
max1932.185-1932.203=-0.017
mean2849.000-2694.000=155.000
σ0.000
min2849.000-2694.000=155.000
max2849.000-2694.000=155.000
mean3.056-3.002=0.055
σ0.111-0.483=-0.372
min2.910-2.420=0.490
max3.167-3.728=-0.561
iters=5
new-facts=6402
prior-facts=1
mean4752.871-4752.911=-0.040
σ0.909-0.827=0.082
min4752.079-4752.442=-0.362
max4754.439-4754.381=0.058
mean2849.000-2694.000=155.000
σ0.000
min2849.000-2694.000=155.000
max2849.000-2694.000=155.000
mean7.983-8.302=-0.319
σ0.347-0.492=-0.144
min7.699-7.801=-0.102
max8.583-8.825=-0.243
iters=5
new-facts=6402
prior-facts=6402
mean4943.308-4943.309=-0.001
σ0.149-0.157=-0.007
min4943.044-4943.030=0.014
max4943.402-4943.401=0.001
mean3056.400-3037.400=19.000
σ244.599-273.004=-28.405
min2849.000-2694.000=155.000
max3427.000-3400.000=27.000
mean8.453-8.623=-0.170
σ0.126-0.115=0.012
min8.370-8.434=-0.064
max8.672-8.715=-0.043

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.139-1.087=0.052
σ0.236-0.213=0.023
min0.935-0.930=0.005
max1.499-1.372=0.126

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.856-472.854=0.002
σ575.923-575.924=-0.001
min184.892-184.884=0.008
max1336.740-1336.740=0.000
mean88.250
σ8.500
min84.000
max101.000
mean2849.000-2694.000=155.000
σ0.000
min2849.000-2694.000=155.000
max2849.000-2694.000=155.000
mean0.453-0.565=-0.112
σ0.304-0.557=-0.253
min0.300-0.285=0.015
max0.909-1.400=-0.492
policies=20
mean1849.226-1849.153=0.073
σ0.368-0.381=-0.013
min1848.948-1848.895=0.053
max1849.759-1849.716=0.044
mean840.000
σ0.000
min840.000
max840.000
mean2849.000-2694.000=155.000
σ0.000
min2849.000-2694.000=155.000
max2849.000-2694.000=155.000
mean2.956-2.862=0.094
σ0.038-0.023=0.015
min2.934-2.845=0.089
max3.013-2.894=0.118
policies=200
mean18498.650-18498.624=0.026
σ0.392-0.506=-0.115
min18498.318-18498.246=0.071
max18499.215-18499.369=-0.153
mean8400.000
σ0.000
min8400.000
max8400.000
mean2849.000-2694.000=155.000
σ0.000
min2849.000-2694.000=155.000
max2849.000-2694.000=155.000
mean29.138-28.770=0.369
σ0.441-0.123=0.318
min28.745-28.617=0.128
max29.753-28.917=0.836