Compare commits

Home / Compare 0a49d580 .. c085543d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.729-70.563=0.167
σ0.046-0.049=-0.003
min70.701-70.534=0.167
max70.858-70.701=0.157
mean417.000-413.400=3.600
σ0.000-0.516=-0.516
min417.000-413.000=4.000
max417.000-414.000=3.000
mean0.156-0.159=-0.003
σ0.005-0.003=0.002
min0.150-0.155=-0.005
max0.162-0.166=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.449-21.287=0.162
σ0.009-0.004=0.006
min21.442-21.281=0.161
max21.475-21.293=0.182
mean417.800-414.000=3.800
σ0.422-0.000=0.422
min417.000-414.000=3.000
max418.000-414.000=4.000
mean0.066-0.062=0.003
σ0.004-0.003=0.001
min0.063-0.059=0.004
max0.075-0.070=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.528-1753.373=1.155
σ0.363-0.361=0.002
min1753.954-1752.802=1.152
max1755.092-1753.951=1.141
mean1660.200-1660.650=-0.450
σ626.124-636.773=-10.649
min628.000-686.000=-58.000
max2837.000-2768.000=69.000
mean2.763-2.761=0.002
σ0.182-0.184=-0.002
min2.352-2.128=0.224
max2.973-2.952=0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.609-271.753=1.856
σ0.007-0.007=0.000
min273.599-271.742=1.858
max273.617-271.759=1.858
mean2837.000-2768.000=69.000
σ0.000
min2837.000-2768.000=69.000
max2837.000-2768.000=69.000
mean0.389-0.379=0.010
σ0.009-0.004=0.006
min0.380-0.375=0.005
max0.401-0.385=0.016
iters=5
new-facts=1
prior-facts=6402
mean1933.995-1932.181=1.814
σ0.006-0.009=-0.003
min1933.987-1932.173=1.814
max1934.003-1932.193=1.810
mean2837.000-2768.000=69.000
σ0.000
min2837.000-2768.000=69.000
max2837.000-2768.000=69.000
mean2.992-3.045=-0.053
σ0.099-0.228=-0.130
min2.848-2.738=0.110
max3.084-3.361=-0.277
iters=5
new-facts=6402
prior-facts=1
mean4754.780-4752.907=1.873
σ0.832-0.841=-0.009
min4754.284-4752.430=1.854
max4756.261-4754.400=1.860
mean2837.000-2768.000=69.000
σ0.000
min2837.000-2768.000=69.000
max2837.000-2768.000=69.000
mean8.388-8.463=-0.075
σ0.540-0.506=0.034
min7.629-7.655=-0.026
max9.113-8.906=0.207
iters=5
new-facts=6402
prior-facts=6402
mean4945.224-4943.310=1.914
σ0.024-0.147=-0.123
min4945.192-4943.049=2.143
max4945.254-4943.394=1.860
mean3083.000-3052.200=30.800
σ247.010-250.361=-3.351
min2837.000-2768.000=69.000
max3331.000-3403.000=-72.000
mean8.781-8.643=0.138
σ0.396-0.167=0.229
min8.418-8.487=-0.069
max9.453-8.872=0.581

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.044-1.077=-0.033
σ0.132-0.113=0.019
min0.924-0.933=-0.009
max1.248-1.250=-0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.844-472.860=-0.016
σ574.927-575.926=-0.999
min185.370-184.888=0.482
max1335.235-1336.749=-1.515
mean88.250
σ8.500
min84.000
max101.000
mean2837.000-2768.000=69.000
σ0.000
min2837.000-2768.000=69.000
max2837.000-2768.000=69.000
mean0.449-0.483=-0.034
σ0.299-0.371=-0.072
min0.297-0.292=0.005
max0.897-1.039=-0.142
policies=20
mean1853.987-1849.181=4.805
σ0.372-0.336=0.036
min1853.722-1848.912=4.810
max1854.529-1849.669=4.860
mean840.000
σ0.000
min840.000
max840.000
mean2837.000-2768.000=69.000
σ0.000
min2837.000-2768.000=69.000
max2837.000-2768.000=69.000
mean2.949-2.923=0.027
σ0.011-0.081=-0.070
min2.940-2.861=0.079
max2.961-3.042=-0.081
policies=200
mean18546.684-18498.680=48.004
σ0.477-0.544=-0.067
min18546.352-18498.259=48.093
max18547.384-18499.475=47.909
mean8400.000
σ0.000
min8400.000
max8400.000
mean2837.000-2768.000=69.000
σ0.000
min2837.000-2768.000=69.000
max2837.000-2768.000=69.000
mean29.229-28.888=0.341
σ0.481-0.044=0.437
min28.739-28.853=-0.114
max29.781-28.951=0.831