Compare commits

Home / Compare f18d22fb .. 27a0bb2b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.973=-0.001
σ0.104-0.107=-0.002
min35.926-35.922=0.004
max36.269-36.276=-0.007
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.075-0.078=-0.003
σ0.005-0.004=0.001
min0.070-0.075=-0.005
max0.085-0.085=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.208-26.208=-0.000
σ0.004-0.002=0.002
min26.201-26.204=-0.003
max26.213-26.211=0.001
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.061-0.061=-0.000
σ0.003-0.003=0.001
min0.059-0.059=0.000
max0.070-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.365-1758.362=0.003
σ0.370-0.372=-0.002
min1757.787-1757.786=0.001
max1758.963-1758.961=0.003
mean1660.250-1655.150=5.100
σ624.261-620.424=3.837
min688.000-685.000=3.000
max2768.000-2746.000=22.000
mean2.390-2.368=0.022
σ0.109-0.114=-0.005
min2.276-2.178=0.098
max2.608-2.634=-0.026

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.511-279.512=-0.001
σ0.009-0.007=0.001
min279.499-279.503=-0.004
max279.519-279.517=0.002
mean2768.000-2746.000=22.000
σ0.000
min2768.000-2746.000=22.000
max2768.000-2746.000=22.000
mean0.411-0.409=0.002
σ0.007-0.002=0.005
min0.405-0.405=-0.000
max0.421-0.410=0.011
iters=5
new-facts=1
prior-facts=6402
mean2178.425-2178.418=0.007
σ0.037-0.034=0.003
min2178.359-2178.359=-0.000
max2178.449-2178.443=0.007
mean2768.000-2746.000=22.000
σ0.000
min2768.000-2746.000=22.000
max2768.000-2746.000=22.000
mean3.389-3.432=-0.043
σ0.117-0.172=-0.055
min3.268-3.271=-0.003
max3.530-3.620=-0.089
iters=5
new-facts=6402
prior-facts=1
mean5056.357-5056.392=-0.034
σ0.973-1.004=-0.031
min5055.766-5055.790=-0.024
max5058.083-5058.177=-0.094
mean2768.000-2746.000=22.000
σ0.000
min2768.000-2746.000=22.000
max2768.000-2746.000=22.000
mean9.034-8.715=0.320
σ0.490-0.657=-0.167
min8.168-8.163=0.004
max9.359-9.736=-0.377
iters=5
new-facts=6402
prior-facts=6402
mean5193.674-5193.689=-0.014
σ0.125-0.212=-0.087
min5193.505-5193.338=0.167
max5193.857-5193.874=-0.018
mean3276.200-3285.800=-9.600
σ460.996-404.146=56.850
min2768.000-2746.000=22.000
max3914.000-3673.000=241.000
mean8.976-8.832=0.143
σ0.099-0.095=0.004
min8.861-8.705=0.155
max9.094-8.970=0.124

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.956-1.001=-0.045
σ0.014-0.072=-0.058
min0.947-0.937=0.009
max0.979-1.080=-0.100

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.474-465.476=-0.002
σ572.659-572.661=-0.003
min179.143-179.137=0.006
max1324.461-1324.468=-0.006
mean79.500
σ7.000
min76.000
max90.000
mean2768.000-2746.000=22.000
σ0.000
min2768.000-2746.000=22.000
max2768.000-2746.000=22.000
mean0.484-0.474=0.010
σ0.403-0.379=0.025
min0.280-0.282=-0.002
max1.089-1.042=0.047
policies=20
mean1791.705-1791.671=0.034
σ0.330-0.340=-0.010
min1791.511-1791.474=0.037
max1792.197-1792.178=0.019
mean760.000
σ0.000
min760.000
max760.000
mean2768.000-2746.000=22.000
σ0.000
min2768.000-2746.000=22.000
max2768.000-2746.000=22.000
mean2.804-2.818=-0.014
σ0.008-0.006=0.002
min2.797-2.811=-0.014
max2.814-2.824=-0.010
policies=200
mean17923.387-17923.168=0.219
σ0.564-0.510=0.054
min17923.065-17922.880=0.185
max17924.230-17923.933=0.297
mean7600.000
σ0.000
min7600.000
max7600.000
mean2768.000-2746.000=22.000
σ0.000
min2768.000-2746.000=22.000
max2768.000-2746.000=22.000
mean28.250-28.237=0.013
σ0.112-0.094=0.018
min28.141-28.152=-0.012
max28.367-28.368=-0.001