Compare commits

Home / Compare fbb4c963 .. 42a17c11

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.774-70.775=-0.001
σ0.048-0.046=0.002
min70.745-70.747=-0.002
max70.909-70.903=0.006
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.158-0.159=-0.001
σ0.004-0.003=0.001
min0.151-0.153=-0.002
max0.164-0.164=0.000
cache=y
dps=1
iters=10
policies=100
mean21.490-21.491=-0.000
σ0.002-0.002=0.000
min21.487-21.487=-0.000
max21.494-21.494=0.000
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.065-0.064=0.001
σ0.002-0.002=-0.000
min0.063-0.059=0.004
max0.070-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.526-1754.526=0.001
σ0.362-0.357=0.005
min1753.953-1753.955=-0.002
max1755.120-1755.080=0.039
mean1651.650-1641.300=10.350
σ624.603-628.442=-3.838
min622.000-623.000=-1.000
max2646.000-2857.000=-211.000
mean2.755-2.794=-0.039
σ0.240-0.184=0.056
min2.168-2.283=-0.115
max3.103-3.198=-0.096

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.607-273.609=-0.003
σ0.006-0.007=-0.001
min273.600-273.604=-0.004
max273.615-273.617=-0.002
mean2646.000-2857.000=-211.000
σ0.000
min2646.000-2857.000=-211.000
max2646.000-2857.000=-211.000
mean0.384-0.385=-0.001
σ0.006-0.004=0.002
min0.380-0.381=-0.001
max0.394-0.390=0.004
iters=5
new-facts=1
prior-facts=6402
mean1934.000-1933.992=0.007
σ0.005-0.010=-0.005
min1933.993-1933.978=0.015
max1934.007-1934.006=0.000
mean2646.000-2857.000=-211.000
σ0.000
min2646.000-2857.000=-211.000
max2646.000-2857.000=-211.000
mean2.915-3.039=-0.124
σ0.322-0.092=0.230
min2.356-2.957=-0.601
max3.170-3.178=-0.008
iters=5
new-facts=6402
prior-facts=1
mean4754.761-4754.745=0.016
σ0.835-0.836=-0.001
min4754.298-4754.268=0.031
max4756.247-4756.234=0.013
mean2646.000-2857.000=-211.000
σ0.000
min2646.000-2857.000=-211.000
max2646.000-2857.000=-211.000
mean8.439-8.546=-0.108
σ0.514-0.343=0.171
min7.608-8.129=-0.521
max8.914-9.028=-0.114
iters=5
new-facts=6402
prior-facts=6402
mean4945.153-4945.222=-0.069
σ0.145-0.016=0.128
min4944.897-4945.208=-0.311
max4945.247-4945.243=0.004
mean2995.000-3054.800=-59.800
σ266.206-215.918=50.287
min2646.000-2857.000=-211.000
max3325.000-3380.000=-55.000
mean8.533-8.573=-0.040
σ0.139-0.160=-0.020
min8.405-8.389=0.015
max8.719-8.771=-0.052

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.152-0.987=0.165
σ0.212-0.133=0.079
min0.931-0.919=0.011
max1.474-1.225=0.249

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.840-472.845=-0.005
σ574.946-574.929=0.017
min185.363-185.374=-0.012
max1335.260-1335.239=0.021
mean88.250
σ8.500
min84.000
max101.000
mean2646.000-2857.000=-211.000
σ0.000
min2646.000-2857.000=-211.000
max2646.000-2857.000=-211.000
mean0.559-0.487=0.072
σ0.543-0.374=0.170
min0.286-0.298=-0.012
max1.374-1.047=0.327
policies=20
mean1853.965-1854.010=-0.045
σ0.378-0.368=0.010
min1853.712-1853.732=-0.020
max1854.524-1854.544=-0.020
mean840.000
σ0.000
min840.000
max840.000
mean2646.000-2857.000=-211.000
σ0.000
min2646.000-2857.000=-211.000
max2646.000-2857.000=-211.000
mean2.870-2.965=-0.096
σ0.013-0.020=-0.007
min2.857-2.951=-0.093
max2.887-2.993=-0.106
policies=200
mean18546.537-18546.721=-0.184
σ0.615-0.493=0.122
min18546.155-18546.425=-0.270
max18547.454-18547.455=-0.001
mean8400.000
σ0.000
min8400.000
max8400.000
mean2646.000-2857.000=-211.000
σ0.000
min2646.000-2857.000=-211.000
max2646.000-2857.000=-211.000
mean28.796-29.181=-0.385
σ0.068-0.444=-0.376
min28.725-28.885=-0.161
max28.887-29.828=-0.941