Compare commits

Home / Compare c2d3d044 .. 543a0058

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.381-70.376=0.005
σ0.046-0.057=-0.011
min70.356-70.340=0.015
max70.508-70.534=-0.026
mean417.900-415.000=2.900
σ0.316-0.000=0.316
min417.000-415.000=2.000
max418.000-415.000=3.000
mean0.159-0.162=-0.003
σ0.003-0.002=0.001
min0.154-0.158=-0.004
max0.166-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.001
σ0.004-0.001=0.002
min21.139-21.140=-0.001
max21.149-21.144=0.005
mean418.800-415.000=3.800
σ0.422-0.000=0.422
min418.000-415.000=3.000
max419.000-415.000=4.000
mean0.065-0.065=-0.000
σ0.003-0.002=0.001
min0.063-0.064=-0.000
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.386-1752.200=0.187
σ0.360-0.359=0.001
min1751.818-1751.628=0.190
max1752.967-1752.779=0.188
mean1668.650-1653.400=15.250
σ623.681-614.705=8.976
min638.000-644.000=-6.000
max2518.000-2486.000=32.000
mean2.812-2.800=0.012
σ0.088-0.197=-0.110
min2.551-2.171=0.380
max2.928-3.101=-0.174

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.128-269.936=0.192
σ0.005-0.007=-0.002
min270.119-269.928=0.191
max270.133-269.945=0.187
mean2518.000-2486.000=32.000
σ0.000
min2518.000-2486.000=32.000
max2518.000-2486.000=32.000
mean0.380-0.379=0.001
σ0.005-0.009=-0.003
min0.373-0.370=0.003
max0.388-0.393=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1930.597-1930.390=0.207
σ0.011-0.017=-0.006
min1930.583-1930.371=0.212
max1930.610-1930.405=0.205
mean2518.000-2486.000=32.000
σ0.000
min2518.000-2486.000=32.000
max2518.000-2486.000=32.000
mean2.522-2.605=-0.083
σ0.093-0.148=-0.055
min2.443-2.466=-0.024
max2.665-2.829=-0.164
iters=5
new-facts=6402
prior-facts=1
mean4751.102-4750.925=0.177
σ0.853-0.785=0.068
min4750.659-4750.535=0.124
max4752.626-4752.328=0.298
mean2518.000-2486.000=32.000
σ0.000
min2518.000-2486.000=32.000
max2518.000-2486.000=32.000
mean8.389-8.171=0.218
σ0.577-0.347=0.230
min7.621-7.842=-0.220
max9.025-8.656=0.368
iters=5
new-facts=6402
prior-facts=6402
mean4941.532-4941.258=0.274
σ0.089-0.130=-0.041
min4941.462-4941.058=0.404
max4941.630-4941.422=0.208
mean3027.200-2964.800=62.400
σ261.937-434.269=-172.331
min2635.000-2486.000=149.000
max3334.000-3551.000=-217.000
mean8.527-8.476=0.051
σ0.105-0.206=-0.101
min8.395-8.304=0.091
max8.630-8.770=-0.140

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.696-1.679=0.018
σ0.201-0.134=0.067
min1.384-1.502=-0.118
max1.870-1.859=0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.354-465.905=0.449
σ575.920-575.762=0.158
min178.391-178.023=0.368
max1330.234-1329.548=0.686
mean84.000-81.750=2.250
σ8.000-7.500=0.500
min80.000-78.000=2.000
max96.000-93.000=3.000
mean2518.000-2486.000=32.000
σ0.000
min2518.000-2486.000=32.000
max2518.000-2486.000=32.000
mean0.567-0.561=0.006
σ0.564-0.545=0.019
min0.279-0.284=-0.005
max1.413-1.379=0.034
policies=20
mean1784.207-1780.450=3.758
σ0.368-0.354=0.014
min1783.977-1780.215=3.762
max1784.755-1780.976=3.779
mean800.000-780.000=20.000
σ0.000
min800.000-780.000=20.000
max800.000-780.000=20.000
mean2518.000-2486.000=32.000
σ0.000
min2518.000-2486.000=32.000
max2518.000-2486.000=32.000
mean2.793-2.764=0.029
σ0.020-0.009=0.012
min2.772-2.754=0.018
max2.814-2.774=0.040
policies=200
mean17848.912-17811.498=37.413
σ0.482-0.496=-0.014
min17848.639-17811.196=37.443
max17849.633-17812.240=37.393
mean8000.000-7800.000=200.000
σ0.000
min8000.000-7800.000=200.000
max8000.000-7800.000=200.000
mean2518.000-2486.000=32.000
σ0.000
min2518.000-2486.000=32.000
max2518.000-2486.000=32.000
mean27.955-27.926=0.029
σ0.081-0.065=0.016
min27.855-27.863=-0.009
max28.045-28.017=0.028