Compare commits

Home / Compare a5397bf1 .. 9ebb7e77

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.780-70.565=0.215
σ0.050-0.045=0.005
min70.751-70.542=0.209
max70.921-70.690=0.230
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.155-0.160=-0.005
σ0.004-0.003=0.001
min0.150-0.157=-0.007
max0.160-0.165=-0.005
cache=y
dps=1
iters=10
policies=100
mean21.493-21.289=0.204
σ0.003-0.002=0.000
min21.490-21.285=0.205
max21.497-21.292=0.205
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.062-0.066=-0.004
σ0.003-0.003=0.001
min0.059-0.063=-0.004
max0.069-0.073=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.880-1753.569=-1.689
σ0.361-0.361=-0.000
min1751.316-1752.995=-1.679
max1752.462-1754.155=-1.693
mean1654.900-1645.900=9.000
σ627.399-633.570=-6.171
min680.000-628.000=52.000
max2663.000-2856.000=-193.000
mean2.830-2.811=0.019
σ0.183-0.115=0.068
min2.402-2.412=-0.010
max3.067-2.972=0.095

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.385-272.007=-2.621
σ0.006-0.020=-0.014
min269.378-271.990=-2.612
max269.393-272.036=-2.643
mean2663.000-2856.000=-193.000
σ0.000
min2663.000-2856.000=-193.000
max2663.000-2856.000=-193.000
mean0.380-0.395=-0.015
σ0.006-0.002=0.003
min0.377-0.392=-0.015
max0.390-0.398=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1929.750-1932.448=-2.698
σ0.017-0.018=-0.002
min1929.729-1932.431=-2.702
max1929.772-1932.478=-2.706
mean2663.000-2856.000=-193.000
σ0.000
min2663.000-2856.000=-193.000
max2663.000-2856.000=-193.000
mean2.940-3.105=-0.165
σ0.303-0.194=0.108
min2.406-2.936=-0.530
max3.135-3.434=-0.299
iters=5
new-facts=6402
prior-facts=1
mean4750.398-4753.053=-2.655
σ0.961-0.607=0.354
min4749.465-4752.671=-3.206
max4752.028-4754.122=-2.095
mean2663.000-2856.000=-193.000
σ0.000
min2663.000-2856.000=-193.000
max2663.000-2856.000=-193.000
mean8.544-8.450=0.094
σ0.295-0.665=-0.370
min8.316-7.716=0.600
max9.013-9.114=-0.101
iters=5
new-facts=6402
prior-facts=6402
mean4940.992-4943.562=-2.570
σ0.020-0.158=-0.138
min4940.964-4943.282=-2.318
max4941.014-4943.657=-2.642
mean2980.600-3074.000=-93.400
σ254.502-270.991=-16.489
min2663.000-2856.000=-193.000
max3332.000-3484.000=-152.000
mean8.629-8.670=-0.041
σ0.388-0.093=0.295
min8.400-8.603=-0.204
max9.319-8.823=0.496

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.077-1.083=-0.006
σ0.182-0.257=-0.074
min0.942-0.925=0.017
max1.296-1.527=-0.231

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.700-473.086=-10.386
σ574.939-575.919=-0.980
min175.221-185.119=-9.897
max1325.108-1336.964=-11.856
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2663.000-2856.000=-193.000
σ0.000
min2663.000-2856.000=-193.000
max2663.000-2856.000=-193.000
mean0.572-0.450=0.122
σ0.597-0.308=0.289
min0.258-0.292=-0.034
max1.467-0.913=0.554
policies=20
mean1752.488-1851.452=-98.963
σ0.376-0.367=0.009
min1752.251-1851.181=-98.930
max1753.049-1851.988=-98.939
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2663.000-2856.000=-193.000
σ0.000
min2663.000-2856.000=-193.000
max2663.000-2856.000=-193.000
mean2.752-2.939=-0.187
σ0.013-0.006=0.007
min2.735-2.931=-0.196
max2.767-2.946=-0.179
policies=200
mean17532.202-18521.074=-988.871
σ0.423-0.437=-0.014
min17531.856-18520.721=-988.864
max17532.810-18521.700=-988.890
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2663.000-2856.000=-193.000
σ0.000
min2663.000-2856.000=-193.000
max2663.000-2856.000=-193.000
mean27.787-29.052=-1.265
σ0.173-0.435=-0.262
min27.621-28.801=-1.181
max28.020-29.703=-1.684