Compare commits

Home / Compare 02d3dd25 .. 8db8f6d6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.567=-0.002
σ0.044-0.044=-0.000
min70.542-70.540=0.002
max70.687-70.690=-0.002
mean413.000
σ0.000
min413.000
max413.000
mean0.157-0.161=-0.004
σ0.005-0.003=0.002
min0.150-0.159=-0.009
max0.163-0.168=-0.005
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=0.000
σ0.003-0.003=0.000
min21.282-21.283=-0.000
max21.293-21.291=0.002
mean413.000
σ0.000
min413.000
max413.000
mean0.065-0.065=0.000
σ0.002-0.002=-0.000
min0.063-0.063=-0.000
max0.071-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.173-1753.176=-0.002
σ0.365-0.361=0.004
min1752.601-1752.607=-0.006
max1753.758-1753.756=0.002
mean1670.050-1654.800=15.250
σ635.925-639.972=-4.047
min687.000-632.000=55.000
max2820.000-2853.000=-33.000
mean2.827-2.861=-0.034
σ0.133-0.117=0.016
min2.462-2.604=-0.142
max3.066-3.047=0.019

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.603-271.620=-0.017
σ0.013-0.007=0.006
min271.587-271.610=-0.023
max271.616-271.629=-0.013
mean2820.000-2853.000=-33.000
σ0.000
min2820.000-2853.000=-33.000
max2820.000-2853.000=-33.000
mean0.383-0.385=-0.002
σ0.008-0.006=0.002
min0.377-0.382=-0.005
max0.397-0.396=0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.050-1932.046=0.004
σ0.017-0.007=0.010
min1932.032-1932.036=-0.004
max1932.072-1932.053=0.018
mean2820.000-2853.000=-33.000
σ0.000
min2820.000-2853.000=-33.000
max2820.000-2853.000=-33.000
mean2.921-2.995=-0.075
σ0.157-0.041=0.116
min2.659-2.953=-0.294
max3.054-3.052=0.002
iters=5
new-facts=6402
prior-facts=1
mean4752.757-4752.712=0.046
σ0.907-0.903=0.004
min4752.280-4751.957=0.323
max4754.376-4754.282=0.094
mean2820.000-2853.000=-33.000
σ0.000
min2820.000-2853.000=-33.000
max2820.000-2853.000=-33.000
mean8.711-8.046=0.664
σ0.276-0.486=-0.210
min8.427-7.643=0.784
max9.101-8.628=0.473
iters=5
new-facts=6402
prior-facts=6402
mean4943.163-4943.235=-0.072
σ0.169-0.006=0.162
min4942.863-4943.225=-0.362
max4943.256-4943.241=0.014
mean3002.800-3080.200=-77.400
σ251.530-301.039=-49.510
min2820.000-2853.000=-33.000
max3396.000-3544.000=-148.000
mean8.369-8.605=-0.236
σ0.086-0.345=-0.259
min8.221-8.313=-0.092
max8.437-9.170=-0.734

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.095-1.127=-0.032
σ0.231-0.230=0.001
min0.928-0.928=0.000
max1.425-1.460=-0.035

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.293-472.291=0.001
σ575.924-575.924=-0.000
min184.321-184.317=0.004
max1336.178-1336.177=0.001
mean88.250
σ8.500
min84.000
max101.000
mean2820.000-2853.000=-33.000
σ0.000
min2820.000-2853.000=-33.000
max2820.000-2853.000=-33.000
mean0.454-0.448=0.007
σ0.300-0.302=-0.003
min0.300-0.290=0.011
max0.904-0.901=0.003
policies=20
mean1843.578-1843.574=0.004
σ0.367-0.378=-0.011
min1843.285-1843.294=-0.009
max1844.092-1844.123=-0.031
mean840.000
σ0.000
min840.000
max840.000
mean2820.000-2853.000=-33.000
σ0.000
min2820.000-2853.000=-33.000
max2820.000-2853.000=-33.000
mean2.976-2.942=0.034
σ0.126-0.012=0.114
min2.862-2.931=-0.069
max3.116-2.958=0.158
policies=200
mean18442.055-18442.198=-0.143
σ0.440-0.392=0.048
min18441.762-18441.870=-0.108
max18442.700-18442.764=-0.064
mean8400.000
σ0.000
min8400.000
max8400.000
mean2820.000-2853.000=-33.000
σ0.000
min2820.000-2853.000=-33.000
max2820.000-2853.000=-33.000
mean28.914-29.329=-0.416
σ0.193-0.320=-0.127
min28.715-29.049=-0.334
max29.152-29.788=-0.636