Compare commits

Home / Compare 3d19031a .. b880769f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.732-70.730=0.001
σ0.049-0.045=0.004
min70.698-70.703=-0.004
max70.868-70.856=0.012
mean414.000-415.800=-1.800
σ0.000-0.422=-0.422
min414.000-415.000=-1.000
max414.000-416.000=-2.000
mean0.162-0.159=0.003
σ0.004-0.003=0.001
min0.157-0.155=0.002
max0.168-0.163=0.004
cache=y
dps=1
iters=10
policies=100
mean21.446-21.446=-0.000
σ0.002-0.002=0.001
min21.442-21.443=-0.001
max21.449-21.449=-0.000
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.066-0.065=0.001
σ0.003-0.002=0.001
min0.063-0.064=-0.000
max0.072-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.527-1754.527=-0.001
σ0.361-0.362=-0.001
min1753.952-1753.963=-0.011
max1755.096-1755.112=-0.016
mean1658.350-1650.900=7.450
σ638.335-636.963=1.372
min639.000-614.000=25.000
max2836.000-2775.000=61.000
mean2.741-2.854=-0.113
σ0.191-0.195=-0.004
min2.296-2.515=-0.220
max2.915-3.347=-0.432

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.610-273.607=0.002
σ0.002-0.007=-0.005
min273.608-273.596=0.012
max273.612-273.614=-0.002
mean2836.000-2775.000=61.000
σ0.000
min2836.000-2775.000=61.000
max2836.000-2775.000=61.000
mean0.383-0.389=-0.006
σ0.002-0.010=-0.008
min0.380-0.382=-0.001
max0.385-0.403=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1934.007-1934.007=0.000
σ0.014-0.006=0.008
min1934.000-1933.999=0.001
max1934.032-1934.014=0.017
mean2836.000-2775.000=61.000
σ0.000
min2836.000-2775.000=61.000
max2836.000-2775.000=61.000
mean3.057-2.995=0.063
σ0.184-0.369=-0.186
min2.843-2.379=0.464
max3.312-3.299=0.014
iters=5
new-facts=6402
prior-facts=1
mean4754.779-4754.672=0.107
σ0.827-0.937=-0.110
min4754.209-4753.723=0.486
max4756.234-4756.247=-0.013
mean2836.000-2775.000=61.000
σ0.000
min2836.000-2775.000=61.000
max2836.000-2775.000=61.000
mean8.544-8.492=0.052
σ0.691-0.466=0.225
min7.620-7.758=-0.138
max9.494-8.930=0.564
iters=5
new-facts=6402
prior-facts=6402
mean4945.156-4945.228=-0.072
σ0.144-0.016=0.129
min4944.900-4945.208=-0.308
max4945.249-4945.250=-0.000
mean3073.400-3081.000=-7.600
σ240.070-274.881=-34.810
min2836.000-2775.000=61.000
max3316.000-3357.000=-41.000
mean8.787-9.114=-0.327
σ0.194-0.583=-0.388
min8.512-8.397=0.115
max8.980-9.731=-0.751

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.019-1.006=0.013
σ0.140-0.154=-0.015
min0.920-0.931=-0.011
max1.245-1.282=-0.037

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.841-472.853=-0.012
σ574.937-574.953=-0.017
min185.369-185.374=-0.005
max1335.246-1335.283=-0.036
mean88.250
σ8.500
min84.000
max101.000
mean2836.000-2775.000=61.000
σ0.000
min2836.000-2775.000=61.000
max2836.000-2775.000=61.000
mean0.449-0.491=-0.042
σ0.301-0.394=-0.094
min0.294-0.291=0.003
max0.900-1.082=-0.183
policies=20
mean1853.994-1853.992=0.002
σ0.364-0.372=-0.008
min1853.721-1853.732=-0.010
max1854.521-1854.541=-0.020
mean840.000
σ0.000
min840.000
max840.000
mean2836.000-2775.000=61.000
σ0.000
min2836.000-2775.000=61.000
max2836.000-2775.000=61.000
mean2.956-2.879=0.077
σ0.009-0.015=-0.006
min2.947-2.865=0.082
max2.964-2.894=0.070
policies=200
mean18546.642-18546.582=0.060
σ0.430-0.426=0.004
min18546.363-18546.245=0.119
max18547.272-18547.200=0.072
mean8400.000
σ0.000
min8400.000
max8400.000
mean2836.000-2775.000=61.000
σ0.000
min2836.000-2775.000=61.000
max2836.000-2775.000=61.000
mean29.308-28.872=0.435
σ0.462-0.077=0.384
min28.854-28.780=0.074
max29.795-28.952=0.843