Compare commits

Home / Compare cb2b5ed5 .. cc2ba89c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.379-70.379=-0.000
σ0.043-0.046=-0.003
min70.356-70.347=0.009
max70.499-70.506=-0.007
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.158-0.159=-0.000
σ0.005-0.003=0.002
min0.151-0.155=-0.004
max0.167-0.165=0.002
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=-0.000
σ0.003-0.002=0.001
min21.140-21.141=-0.001
max21.150-21.150=0.000
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.065-0.062=0.004
σ0.002-0.004=-0.002
min0.063-0.058=0.005
max0.071-0.070=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.386-1752.388=-0.002
σ0.361-0.362=-0.001
min1751.821-1751.816=0.004
max1752.953-1752.970=-0.017
mean1629.300-1649.400=-20.100
σ593.717-641.603=-47.885
min624.000-617.000=7.000
max2423.000-2774.000=-351.000
mean2.805-2.840=-0.035
σ0.166-0.160=0.006
min2.441-2.368=0.072
max3.039-3.196=-0.157

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.132-270.128=0.004
σ0.003-0.005=-0.002
min270.127-270.123=0.004
max270.135-270.137=-0.002
mean2423.000-2774.000=-351.000
σ0.000
min2423.000-2774.000=-351.000
max2423.000-2774.000=-351.000
mean0.380-0.374=0.006
σ0.007-0.005=0.002
min0.372-0.371=0.001
max0.391-0.383=0.009
iters=5
new-facts=1
prior-facts=6402
mean1930.592-1930.587=0.005
σ0.016-0.018=-0.002
min1930.564-1930.558=0.006
max1930.602-1930.601=0.000
mean2423.000-2774.000=-351.000
σ0.000
min2423.000-2774.000=-351.000
max2423.000-2774.000=-351.000
mean2.545-2.511=0.034
σ0.097-0.132=-0.035
min2.447-2.308=0.139
max2.682-2.641=0.040
iters=5
new-facts=6402
prior-facts=1
mean4751.087-4751.128=-0.041
σ0.855-0.788=0.068
min4750.654-4750.686=-0.032
max4752.615-4752.532=0.083
mean2423.000-2774.000=-351.000
σ0.000
min2423.000-2774.000=-351.000
max2423.000-2774.000=-351.000
mean8.407-8.145=0.262
σ0.601-0.322=0.280
min7.712-7.720=-0.008
max9.048-8.547=0.501
iters=5
new-facts=6402
prior-facts=6402
mean4941.453-4941.526=-0.073
σ0.202-0.086=0.116
min4941.118-4941.450=-0.332
max4941.616-4941.625=-0.009
mean2958.600-3052.200=-93.600
σ453.411-339.321=114.090
min2423.000-2774.000=-351.000
max3566.000-3563.000=3.000
mean8.386-8.469=-0.083
σ0.141-0.156=-0.016
min8.273-8.308=-0.035
max8.609-8.703=-0.094

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.857-1.075=0.782
σ0.135-0.177=-0.042
min1.629-0.932=0.697
max1.984-1.367=0.617

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.362-466.372=-0.011
σ575.934-575.941=-0.007
min178.392-178.394=-0.001
max1330.263-1330.284=-0.021
mean84.000
σ8.000
min80.000
max96.000
mean2423.000-2774.000=-351.000
σ0.000
min2423.000-2774.000=-351.000
max2423.000-2774.000=-351.000
mean0.559-0.442=0.118
σ0.564-0.308=0.256
min0.277-0.284=-0.007
max1.406-0.904=0.502
policies=20
mean1784.215-1784.246=-0.031
σ0.342-0.339=0.004
min1783.995-1783.987=0.008
max1784.724-1784.740=-0.015
mean800.000
σ0.000
min800.000
max800.000
mean2423.000-2774.000=-351.000
σ0.000
min2423.000-2774.000=-351.000
max2423.000-2774.000=-351.000
mean2.772-2.890=-0.119
σ0.007-0.094=-0.087
min2.763-2.776=-0.014
max2.781-2.970=-0.190
policies=200
mean17848.780-17848.882=-0.102
σ0.571-0.490=0.081
min17848.396-17848.594=-0.198
max17849.615-17849.616=-0.001
mean8000.000
σ0.000
min8000.000
max8000.000
mean2423.000-2774.000=-351.000
σ0.000
min2423.000-2774.000=-351.000
max2423.000-2774.000=-351.000
mean27.940-28.003=-0.063
σ0.088-0.110=-0.021
min27.809-27.892=-0.083
max27.997-28.154=-0.157