Compare commits

Home / Compare 3f824f33 .. 648d2de3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.915=-0.001
σ0.366-0.369=-0.003
min53.784-53.786=-0.002
max54.956-54.965=-0.009
mean415.000
σ0.000
min415.000
max415.000
mean0.139-0.139=0.000
σ0.004-0.004=0.000
min0.134-0.135=-0.001
max0.146-0.146=0.000
cache=y
dps=1
iters=10
policies=100
mean43.141-43.140=0.001
σ0.007-0.005=0.001
min43.128-43.130=-0.002
max43.151-43.149=0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.121-0.120=0.000
σ0.004-0.003=0.001
min0.116-0.118=-0.002
max0.126-0.127=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.812-991.812=-0.000
σ1.264-1.224=0.040
min991.254-991.229=0.025
max997.133-996.953=0.180
mean1063.400-1068.550=-5.150
σ322.216-314.107=8.109
min568.000-616.000=-48.000
max1636.000-1652.000=-16.000
mean1.552-1.504=0.048
σ0.087-0.064=0.023
min1.457-1.364=0.092
max1.766-1.656=0.110

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.414-285.412=0.002
σ0.010-0.011=-0.001
min285.397-285.395=0.002
max285.422-285.423=-0.001
mean1636.000-1652.000=-16.000
σ0.000
min1636.000-1652.000=-16.000
max1636.000-1652.000=-16.000
mean0.384-0.377=0.007
σ0.009-0.007=0.002
min0.376-0.373=0.004
max0.396-0.389=0.006
iters=5
new-facts=1
prior-facts=6402
mean1285.378-1285.373=0.004
σ0.140-0.129=0.010
min1285.307-1285.311=-0.004
max1285.627-1285.604=0.023
mean1636.000-1652.000=-16.000
σ0.000
min1636.000-1652.000=-16.000
max1636.000-1652.000=-16.000
mean1.948-2.034=-0.087
σ0.123-0.255=-0.132
min1.831-1.826=0.005
max2.146-2.399=-0.254
iters=5
new-facts=6402
prior-facts=1
mean1807.715-1807.718=-0.003
σ7.025-7.008=0.017
min1804.312-1804.346=-0.034
max1820.265-1820.238=0.027
mean1636.000-1652.000=-16.000
σ0.000
min1636.000-1652.000=-16.000
max1636.000-1652.000=-16.000
mean4.168-4.178=-0.010
σ0.247-0.194=0.053
min3.816-3.877=-0.060
max4.420-4.413=0.008
iters=5
new-facts=6402
prior-facts=6402
mean2070.198-2070.195=0.003
σ0.006-0.010=-0.004
min2070.194-2070.182=0.012
max2070.208-2070.209=-0.001
mean1835.800-1834.400=1.400
σ174.150-165.175=8.975
min1636.000-1652.000=-16.000
max2071.000-2068.000=3.000
mean4.521-4.586=-0.065
σ0.034-0.194=-0.160
min4.482-4.470=0.012
max4.559-4.929=-0.370

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.240-1.182=0.058
σ0.272-0.293=-0.021
min1.057-0.911=0.146
max1.677-1.675=0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.786-436.781=0.005
σ572.360-572.364=-0.004
min150.600-150.596=0.004
max1295.326-1295.327=-0.000
mean90.250
σ8.500
min86.000
max103.000
mean1636.000-1652.000=-16.000
σ0.000
min1636.000-1652.000=-16.000
max1636.000-1652.000=-16.000
mean0.530-0.529=0.001
σ0.559-0.554=0.005
min0.248-0.249=-0.001
max1.368-1.360=0.008
policies=20
mean1506.274-1506.258=0.016
σ0.252-0.243=0.009
min1506.111-1506.109=0.002
max1506.650-1506.621=0.029
mean860.000
σ0.000
min860.000
max860.000
mean1636.000-1652.000=-16.000
σ0.000
min1636.000-1652.000=-16.000
max1636.000-1652.000=-16.000
mean2.528-2.525=0.003
σ0.018-0.022=-0.004
min2.508-2.503=0.005
max2.548-2.547=0.001
policies=200
mean15070.368-15070.357=0.012
σ0.058-0.076=-0.018
min15070.314-15070.262=0.052
max15070.428-15070.423=0.005
mean8600.000
σ0.000
min8600.000
max8600.000
mean1636.000-1652.000=-16.000
σ0.000
min1636.000-1652.000=-16.000
max1636.000-1652.000=-16.000
mean25.551-25.481=0.070
σ0.113-0.099=0.014
min25.432-25.377=0.055
max25.683-25.594=0.089