Compare commits

Home / Compare 35d85bbc .. c52cddb4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.699-70.782=-0.084
σ0.045-0.047=-0.001
min70.665-70.753=-0.088
max70.824-70.913=-0.089
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.160-0.161=-0.000
σ0.003-0.006=-0.003
min0.155-0.149=0.006
max0.165-0.169=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.409-21.492=-0.084
σ0.003-0.002=0.002
min21.403-21.489=-0.086
max21.413-21.494=-0.081
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.065-0.064=0.001
σ0.003-0.003=-0.001
min0.063-0.059=0.004
max0.072-0.069=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.898-1754.092=0.806
σ0.362-0.358=0.004
min1754.331-1753.535=0.796
max1755.484-1754.663=0.821
mean1666.650-1663.000=3.650
σ644.656-622.006=22.650
min676.000-643.000=33.000
max2713.000-2502.000=211.000
mean2.831-2.805=0.027
σ0.182-0.209=-0.027
min2.155-2.308=-0.153
max3.041-3.128=-0.087

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.759-271.601=1.158
σ0.008-0.007=0.001
min272.749-271.591=1.159
max272.766-271.609=1.157
mean2713.000-2502.000=211.000
σ0.000
min2713.000-2502.000=211.000
max2713.000-2502.000=211.000
mean0.386-0.385=0.001
σ0.006-0.006=-0.000
min0.383-0.381=0.002
max0.397-0.395=0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.136-1931.994=1.142
σ0.014-0.012=0.002
min1933.116-1931.974=1.142
max1933.150-1932.004=1.145
mean2713.000-2502.000=211.000
σ0.000
min2713.000-2502.000=211.000
max2713.000-2502.000=211.000
mean3.009-2.521=0.488
σ0.044-0.056=-0.012
min2.947-2.473=0.474
max3.071-2.601=0.470
iters=5
new-facts=6402
prior-facts=1
mean4753.839-4752.706=1.133
σ0.931-0.897=0.034
min4753.114-4752.231=0.883
max4755.465-4754.308=1.157
mean2713.000-2502.000=211.000
σ0.000
min2713.000-2502.000=211.000
max2713.000-2502.000=211.000
mean8.285-8.799=-0.514
σ0.592-0.211=0.381
min7.614-8.635=-1.020
max8.948-9.149=-0.201
iters=5
new-facts=6402
prior-facts=6402
mean4944.362-4943.140=1.222
σ0.016-0.161=-0.145
min4944.344-4942.853=1.491
max4944.383-4943.223=1.160
mean3039.000-3009.200=29.800
σ286.279-301.821=-15.543
min2713.000-2599.000=114.000
max3424.000-3386.000=38.000
mean8.501-8.491=0.011
σ0.114-0.145=-0.031
min8.326-8.316=0.009
max8.601-8.649=-0.048

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.021-1.649=-0.628
σ0.163-0.329=-0.166
min0.907-1.216=-0.308
max1.263-1.928=-0.665

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.642-468.630=0.013
σ574.894-574.926=-0.032
min181.188-181.164=0.023
max1330.984-1331.018=-0.035
mean88.250
σ8.500
min84.000
max101.000
mean2713.000-2502.000=211.000
σ0.000
min2713.000-2502.000=211.000
max2713.000-2502.000=211.000
mean0.556-0.556=0.000
σ0.534-0.535=-0.000
min0.287-0.286=0.001
max1.358-1.358=-0.000
policies=20
mean1812.197-1811.934=0.263
σ0.383-0.399=-0.016
min1811.941-1811.664=0.278
max1812.763-1812.521=0.242
mean840.000
σ0.000
min840.000
max840.000
mean2713.000-2502.000=211.000
σ0.000
min2713.000-2502.000=211.000
max2713.000-2502.000=211.000
mean2.842-2.874=-0.032
σ0.018-0.024=-0.006
min2.817-2.852=-0.035
max2.859-2.896=-0.037
policies=200
mean18128.907-18126.711=2.196
σ0.577-0.521=0.056
min18128.499-18126.326=2.173
max18129.761-18127.480=2.281
mean8400.000
σ0.000
min8400.000
max8400.000
mean2713.000-2502.000=211.000
σ0.000
min2713.000-2502.000=211.000
max2713.000-2502.000=211.000
mean28.573-28.692=-0.119
σ0.073-0.071=0.002
min28.484-28.610=-0.126
max28.661-28.763=-0.102