Compare commits

Home / Compare cb6bcc3b .. 0af19e97

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.728-70.732=-0.004
σ0.051-0.044=0.007
min70.701-70.708=-0.007
max70.869-70.852=0.017
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.161-0.158=0.003
σ0.004-0.003=0.001
min0.157-0.155=0.003
max0.168-0.164=0.005
cache=y
dps=1
iters=10
policies=100
mean21.446-21.446=0.000
σ0.003-0.002=0.001
min21.441-21.442=-0.001
max21.450-21.448=0.002
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.064-0.063=0.001
σ0.003-0.003=-0.001
min0.059-0.059=0.000
max0.067-0.067=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.285-1754.529=0.756
σ0.360-0.360=0.000
min1754.717-1753.960=0.757
max1755.850-1755.112=0.738
mean1639.400-1650.550=-11.150
σ611.308-639.738=-28.430
min624.000-616.000=8.000
max2469.000-2785.000=-316.000
mean2.819-2.826=-0.007
σ0.175-0.184=-0.009
min2.247-2.178=0.069
max3.056-3.100=-0.043

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean274.367-273.607=0.761
σ0.006-0.010=-0.004
min274.361-273.598=0.762
max274.375-273.623=0.752
mean2469.000-2785.000=-316.000
σ0.000
min2469.000-2785.000=-316.000
max2469.000-2785.000=-316.000
mean0.383-0.383=0.000
σ0.005-0.004=0.001
min0.379-0.380=-0.001
max0.391-0.390=0.001
iters=5
new-facts=1
prior-facts=6402
mean1934.755-1933.997=0.758
σ0.018-0.002=0.016
min1934.734-1933.993=0.741
max1934.779-1933.999=0.780
mean2469.000-2785.000=-316.000
σ0.000
min2469.000-2785.000=-316.000
max2469.000-2785.000=-316.000
mean3.007-3.054=-0.047
σ0.079-0.116=-0.037
min2.883-2.915=-0.031
max3.104-3.216=-0.112
iters=5
new-facts=6402
prior-facts=1
mean4755.518-4754.760=0.758
σ0.900-0.837=0.063
min4755.017-4754.306=0.711
max4757.122-4756.250=0.872
mean2469.000-2785.000=-316.000
σ0.000
min2469.000-2785.000=-316.000
max2469.000-2785.000=-316.000
mean8.640-8.464=0.176
σ0.310-0.521=-0.211
min8.325-7.617=0.708
max9.058-8.948=0.110
iters=5
new-facts=6402
prior-facts=6402
mean4945.987-4945.153=0.834
σ0.020-0.143=-0.122
min4945.966-4944.898=1.067
max4946.011-4945.232=0.779
mean2942.200-3034.800=-92.600
σ327.416-255.453=71.963
min2469.000-2785.000=-316.000
max3354.000-3398.000=-44.000
mean8.501-8.696=-0.195
σ0.119-0.300=-0.181
min8.397-8.419=-0.022
max8.633-9.118=-0.486

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.762-1.025=0.738
σ0.110-0.132=-0.022
min1.632-0.936=0.696
max1.894-1.237=0.657

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.830-472.851=-0.021
σ574.923-574.961=-0.038
min185.368-185.364=0.004
max1335.215-1335.292=-0.077
mean88.250
σ8.500
min84.000
max101.000
mean2469.000-2785.000=-316.000
σ0.000
min2469.000-2785.000=-316.000
max2469.000-2785.000=-316.000
mean0.552-0.497=0.055
σ0.527-0.421=0.106
min0.287-0.285=0.002
max1.343-1.129=0.214
policies=20
mean1853.983-1853.990=-0.007
σ0.376-0.385=-0.009
min1853.728-1853.720=0.008
max1854.539-1854.557=-0.018
mean840.000
σ0.000
min840.000
max840.000
mean2469.000-2785.000=-316.000
σ0.000
min2469.000-2785.000=-316.000
max2469.000-2785.000=-316.000
mean2.858-2.886=-0.028
σ0.006-0.011=-0.005
min2.851-2.875=-0.025
max2.865-2.901=-0.036
policies=200
mean18546.674-18546.611=0.063
σ0.452-0.439=0.012
min18546.388-18546.295=0.093
max18547.349-18547.260=0.089
mean8400.000
σ0.000
min8400.000
max8400.000
mean2469.000-2785.000=-316.000
σ0.000
min2469.000-2785.000=-316.000
max2469.000-2785.000=-316.000
mean28.818-28.885=-0.067
σ0.082-0.035=0.047
min28.747-28.837=-0.090
max28.918-28.921=-0.003