Compare commits

Home / Compare b258ea50 .. 3d19031a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.730-70.688=0.042
σ0.045-0.047=-0.002
min70.703-70.663=0.040
max70.856-70.821=0.036
mean415.800-415.000=0.800
σ0.422-0.000=0.422
min415.000
max416.000-415.000=1.000
mean0.159-0.168=-0.009
σ0.003-0.012=-0.009
min0.155-0.153=0.002
max0.163-0.185=-0.021
cache=y
dps=1
iters=10
policies=100
mean21.446-21.420=0.025
σ0.002-0.003=-0.001
min21.443-21.415=0.028
max21.449-21.424=0.024
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.065-0.065=-0.001
σ0.002-0.002=-0.000
min0.064-0.064=-0.000
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.527-1754.458=0.069
σ0.362-0.360=0.002
min1753.963-1753.885=0.078
max1755.112-1755.047=0.065
mean1650.900-1674.600=-23.700
σ636.963-650.793=-13.830
min614.000-625.000=-11.000
max2775.000-2872.000=-97.000
mean2.854-2.804=0.050
σ0.195-0.180=0.015
min2.515-2.155=0.361
max3.347-3.012=0.335

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.607-273.506=0.102
σ0.007-0.005=0.002
min273.596-273.500=0.096
max273.614-273.512=0.103
mean2775.000-2872.000=-97.000
σ0.000
min2775.000-2872.000=-97.000
max2775.000-2872.000=-97.000
mean0.389-0.385=0.004
σ0.010-0.005=0.005
min0.382-0.382=-0.000
max0.403-0.394=0.009
iters=5
new-facts=1
prior-facts=6402
mean1934.007-1933.910=0.097
σ0.006-0.017=-0.011
min1933.999-1933.893=0.106
max1934.014-1933.933=0.081
mean2775.000-2872.000=-97.000
σ0.000
min2775.000-2872.000=-97.000
max2775.000-2872.000=-97.000
mean2.995-2.838=0.157
σ0.369-0.311=0.058
min2.379-2.494=-0.116
max3.299-3.127=0.172
iters=5
new-facts=6402
prior-facts=1
mean4754.672-4754.735=-0.063
σ0.937-0.804=0.133
min4753.723-4754.298=-0.574
max4756.247-4756.171=0.076
mean2775.000-2872.000=-97.000
σ0.000
min2775.000-2872.000=-97.000
max2775.000-2872.000=-97.000
mean8.492-7.979=0.513
σ0.466-0.348=0.118
min7.758-7.700=0.058
max8.930-8.586=0.345
iters=5
new-facts=6402
prior-facts=6402
mean4945.228-4944.909=0.320
σ0.016-0.327=-0.311
min4945.208-4944.386=0.822
max4945.250-4945.140=0.109
mean3081.000-3036.200=44.800
σ274.881-247.853=27.028
min2775.000-2872.000=-97.000
max3357.000-3430.000=-73.000
mean9.114-8.551=0.563
σ0.583-0.332=0.251
min8.397-8.329=0.068
max9.731-9.139=0.592

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.006-1.069=-0.063
σ0.154-0.172=-0.018
min0.931-0.930=0.001
max1.282-1.354=-0.072

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.853-472.573=0.280
σ574.953-574.926=0.027
min185.374-185.104=0.270
max1335.283-1334.962=0.321
mean88.250
σ8.500
min84.000
max101.000
mean2775.000-2872.000=-97.000
σ0.000
min2775.000-2872.000=-97.000
max2775.000-2872.000=-97.000
mean0.491-0.448=0.042
σ0.394-0.299=0.096
min0.291-0.292=-0.001
max1.082-0.896=0.186
policies=20
mean1853.992-1851.299=2.692
σ0.372-0.367=0.005
min1853.732-1851.031=2.701
max1854.541-1851.832=2.709
mean840.000
σ0.000
min840.000
max840.000
mean2775.000-2872.000=-97.000
σ0.000
min2775.000-2872.000=-97.000
max2775.000-2872.000=-97.000
mean2.879-2.946=-0.068
σ0.015-0.007=0.008
min2.865-2.937=-0.072
max2.894-2.954=-0.060
policies=200
mean18546.582-18519.502=27.081
σ0.426-0.472=-0.046
min18546.245-18519.210=27.035
max18547.200-18520.207=26.994
mean8400.000
σ0.000
min8400.000
max8400.000
mean2775.000-2872.000=-97.000
σ0.000
min2775.000-2872.000=-97.000
max2775.000-2872.000=-97.000
mean28.872-29.225=-0.353
σ0.077-0.396=-0.319
min28.780-28.967=-0.187
max28.952-29.816=-0.864