Compare commits

Home / Compare 3b9e0c38 .. 8542cc34

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.745-54.007=-0.262
σ0.368-0.366=0.002
min53.602-53.872=-0.270
max54.791-55.048=-0.257
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.136-0.137=-0.001
σ0.005-0.004=0.000
min0.129-0.130=-0.001
max0.143-0.145=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.053-43.214=-0.161
σ0.006-0.006=0.001
min43.046-43.203=-0.157
max43.069-43.222=-0.153
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.120-0.123=-0.003
σ0.004-0.004=0.000
min0.114-0.118=-0.004
max0.127-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1014.524-992.362=22.163
σ1.219-1.255=-0.036
min1013.976-991.783=22.193
max1019.638-997.645=21.992
mean1054.350-1072.550=-18.200
σ302.178-315.601=-13.423
min561.000-606.000=-45.000
max1601.000-1636.000=-35.000
mean1.654-1.505=0.148
σ0.089-0.054=0.034
min1.543-1.420=0.123
max1.876-1.635=0.241

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.817
σ0.213
min299.676
max300.400
mean2034.000
σ0.000
min2034.000
max2034.000
mean0.570
σ0.027
min0.535
max0.604

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean296.635-287.356=9.279
σ0.016-0.013=0.003
min296.618-287.334=9.284
max296.658-287.368=9.290
mean1601.000-1636.000=-35.000
σ0.000
min1601.000-1636.000=-35.000
max1601.000-1636.000=-35.000
mean0.387-0.371=0.016
σ0.005-0.004=0.002
min0.382-0.369=0.013
max0.395-0.377=0.018
iters=5
new-facts=1
prior-facts=6402
mean1318.885-1287.324=31.561
σ0.089-0.141=-0.052
min1318.841-1287.257=31.583
max1319.044-1287.577=31.467
mean1601.000-1636.000=-35.000
σ0.000
min1601.000-1636.000=-35.000
max1601.000-1636.000=-35.000
mean1.948-1.851=0.097
σ0.107-0.031=0.076
min1.842-1.816=0.026
max2.062-1.901=0.161
iters=5
new-facts=6402
prior-facts=1
mean1557.276-1809.615=-252.340
σ6.832-7.016=-0.184
min1554.016-1806.254=-252.238
max1569.493-1822.152=-252.658
mean1601.000-1636.000=-35.000
σ0.000
min1601.000-1636.000=-35.000
max1601.000-1636.000=-35.000
mean2.378-4.002=-1.624
σ0.216-0.214=0.003
min2.126-3.800=-1.674
max2.668-4.343=-1.675
iters=5
new-facts=6402
prior-facts=6402
mean1886.723-2072.159=-185.436
σ0.021-0.009=0.012
min1886.703-2072.151=-185.448
max1886.750-2072.172=-185.423
mean1766.800-1861.200=-94.400
σ187.915-199.754=-11.839
min1601.000-1636.000=-35.000
max2034.000-2090.000=-56.000
mean2.917-4.918=-2.002
σ0.095-0.097=-0.002
min2.769-4.853=-2.084
max3.020-5.089=-2.069

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.301-1.205=0.096
σ0.370-0.330=0.040
min0.915-0.912=0.003
max1.852-1.761=0.091

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean441.303-437.411=3.891
σ573.456-572.404=1.051
min154.574-151.200=3.373
max1301.486-1296.018=5.468
mean96.250-90.250=6.000
σ8.500
min92.000-86.000=6.000
max109.000-103.000=6.000
mean1601.000-1636.000=-35.000
σ0.000
min1601.000-1636.000=-35.000
max1601.000-1636.000=-35.000
mean0.558-0.530=0.028
σ0.580-0.546=0.034
min0.264-0.256=0.008
max1.427-1.348=0.079
policies=20
mean1545.964-1512.308=33.656
σ0.323-0.252=0.071
min1545.757-1512.150=33.607
max1546.446-1512.684=33.762
mean920.000-860.000=60.000
σ0.000
min920.000-860.000=60.000
max920.000-860.000=60.000
mean1601.000-1636.000=-35.000
σ0.000
min1601.000-1636.000=-35.000
max1601.000-1636.000=-35.000
mean2.603-2.534=0.069
σ0.019-0.013=0.006
min2.590-2.514=0.076
max2.631-2.541=0.090
policies=200
mean15467.583-15130.697=336.886
σ0.060-0.212=-0.152
min15467.502-15130.450=337.052
max15467.645-15130.967=336.678
mean9200.000-8600.000=600.000
σ0.000
min9200.000-8600.000=600.000
max9200.000-8600.000=600.000
mean1601.000-1636.000=-35.000
σ0.000
min1601.000-1636.000=-35.000
max1601.000-1636.000=-35.000
mean26.314-25.581=0.733
σ0.109-0.095=0.014
min26.185-25.474=0.711
max26.415-25.685=0.730