Compare commits

Home / Compare 18d52d9f .. f1bfc1b2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.823-53.823=0.000
σ0.367-0.366=0.001
min53.676-53.679=-0.002
max54.866-54.865=0.002
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.138-0.137=0.000
σ0.004-0.004=-0.000
min0.131-0.131=0.001
max0.143-0.143=0.000
cache=y
dps=1
iters=10
policies=100
mean43.208-43.209=-0.002
σ0.006-0.006=0.000
min43.198-43.199=-0.001
max43.217-43.218=-0.001
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.120-0.122=-0.003
σ0.003-0.003=0.000
min0.115-0.119=-0.004
max0.124-0.127=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.178-1016.179=-0.000
σ1.160-1.172=-0.011
min1015.603-1015.612=-0.009
max1021.031-1021.086=-0.055
mean1054.050-1049.800=4.250
σ312.077-298.110=13.967
min562.000-578.000=-16.000
max1520.000-1449.000=71.000
mean1.552-1.543=0.009
σ0.066-0.068=-0.002
min1.481-1.478=0.003
max1.699-1.725=-0.026

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.288-301.454=-0.167
σ0.218-0.215=0.003
min301.073-301.251=-0.179
max301.853-302.017=-0.164
mean2042.000-1994.000=48.000
σ0.000
min2042.000-1994.000=48.000
max2042.000-1994.000=48.000
mean0.557-0.562=-0.006
σ0.027-0.032=-0.005
min0.511-0.500=0.012
max0.577-0.582=-0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.701-300.704=-0.003
σ0.021-0.019=0.002
min300.671-300.681=-0.011
max300.728-300.730=-0.002
mean1520.000-1449.000=71.000
σ0.000
min1520.000-1449.000=71.000
max1520.000-1449.000=71.000
mean0.395-0.397=-0.002
σ0.008-0.005=0.003
min0.387-0.391=-0.004
max0.406-0.401=0.005
iters=5
new-facts=1
prior-facts=6402
mean1322.854-1322.855=-0.001
σ0.090-0.102=-0.013
min1322.808-1322.790=0.018
max1323.014-1323.037=-0.022
mean1520.000-1449.000=71.000
σ0.000
min1520.000-1449.000=71.000
max1520.000-1449.000=71.000
mean1.925-1.873=0.052
σ0.116-0.062=0.054
min1.822-1.822=0.001
max2.097-1.973=0.124
iters=5
new-facts=6402
prior-facts=1
mean1561.328-1561.297=0.031
σ6.872-6.884=-0.012
min1558.045-1557.975=0.070
max1573.617-1573.606=0.011
mean1520.000-1449.000=71.000
σ0.000
min1520.000-1449.000=71.000
max1520.000-1449.000=71.000
mean2.361-2.262=0.099
σ0.327-0.232=0.095
min2.048-2.115=-0.067
max2.718-2.663=0.055
iters=5
new-facts=6402
prior-facts=6402
mean1890.798-1890.794=0.004
σ0.020-0.019=0.001
min1890.784-1890.775=0.009
max1890.825-1890.823=0.002
mean1740.600-1743.400=-2.800
σ213.574-168.928=44.645
min1520.000-1548.000=-28.000
max2042.000-1994.000=48.000
mean2.908-2.921=-0.013
σ0.050-0.067=-0.017
min2.866-2.870=-0.004
max2.986-3.031=-0.045

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.565-1.648=-0.082
σ0.313-0.109=0.204
min1.221-1.512=-0.291
max1.859-1.785=0.074

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.312-443.310=0.002
σ573.946-573.947=-0.001
min156.336-156.333=0.003
max1304.231-1304.231=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1520.000-1449.000=71.000
σ0.000
min1520.000-1449.000=71.000
max1520.000-1449.000=71.000
mean0.543-0.534=0.009
σ0.559-0.552=0.006
min0.262-0.255=0.007
max1.381-1.362=0.018
policies=20
mean1563.625-1563.620=0.005
σ0.339-0.355=-0.016
min1563.419-1563.381=0.038
max1564.132-1564.148=-0.015
mean920.000
σ0.000
min920.000
max920.000
mean1520.000-1449.000=71.000
σ0.000
min1520.000-1449.000=71.000
max1520.000-1449.000=71.000
mean2.624-2.635=-0.011
σ0.015-0.039=-0.024
min2.609-2.607=0.002
max2.645-2.692=-0.047
policies=200
mean15644.063-15644.157=-0.094
σ0.075-0.059=0.016
min15643.983-15644.099=-0.116
max15644.146-15644.238=-0.092
mean9200.000
σ0.000
min9200.000
max9200.000
mean1520.000-1449.000=71.000
σ0.000
min1520.000-1449.000=71.000
max1520.000-1449.000=71.000
mean26.531-26.507=0.024
σ0.220-0.174=0.046
min26.312-26.377=-0.065
max26.792-26.763=0.029