Compare commits

Home / Compare 538331c6 .. c2adcb45

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.914=0.001
σ0.366-0.366=0.000
min53.782-53.787=-0.005
max54.957-54.955=0.002
mean414.800-416.000=-1.200
σ0.422-0.000=0.422
min414.000-416.000=-2.000
max415.000-416.000=-1.000
mean0.138-0.139=-0.000
σ0.004-0.004=0.000
min0.134-0.135=-0.001
max0.144-0.146=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.141-43.141=0.000
σ0.005-0.007=-0.002
min43.134-43.129=0.006
max43.149-43.151=-0.002
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.120-0.121=-0.001
σ0.005-0.003=0.001
min0.114-0.117=-0.003
max0.128-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.077-992.081=-0.004
σ1.258-1.232=0.026
min991.496-991.493=0.003
max997.370-997.252=0.118
mean1069.100-1062.700=6.400
σ323.406-312.070=11.336
min573.000-605.000=-32.000
max1638.000-1598.000=40.000
mean1.530-1.539=-0.008
σ0.069-0.096=-0.027
min1.464-1.409=0.055
max1.750-1.816=-0.066

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.676-285.665=0.011
σ0.015-0.021=-0.006
min285.651-285.632=0.018
max285.689-285.685=0.004
mean1638.000-1598.000=40.000
σ0.000
min1638.000-1598.000=40.000
max1638.000-1598.000=40.000
mean0.382-0.375=0.006
σ0.011-0.001=0.010
min0.374-0.374=0.001
max0.402-0.376=0.025
iters=5
new-facts=1
prior-facts=6402
mean1285.641-1285.633=0.008
σ0.135-0.123=0.012
min1285.573-1285.575=-0.002
max1285.882-1285.853=0.029
mean1638.000-1598.000=40.000
σ0.000
min1638.000-1598.000=40.000
max1638.000-1598.000=40.000
mean1.988-1.882=0.106
σ0.094-0.059=0.035
min1.844-1.808=0.037
max2.072-1.956=0.115
iters=5
new-facts=6402
prior-facts=1
mean1807.973-1807.994=-0.021
σ6.988-6.998=-0.010
min1804.560-1804.649=-0.090
max1820.454-1820.499=-0.045
mean1638.000-1598.000=40.000
σ0.000
min1638.000-1598.000=40.000
max1638.000-1598.000=40.000
mean4.103-4.269=-0.166
σ0.327-0.171=0.156
min3.843-4.078=-0.235
max4.632-4.481=0.151
iters=5
new-facts=6402
prior-facts=6402
mean2070.468-2070.467=0.001
σ0.019-0.011=0.008
min2070.447-2070.459=-0.011
max2070.499-2070.485=0.013
mean1858.000-1851.800=6.200
σ196.641-209.992=-13.352
min1638.000-1598.000=40.000
max2094.000-2087.000=7.000
mean4.555-4.541=0.014
σ0.115-0.107=0.008
min4.443-4.416=0.027
max4.749-4.687=0.062

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.206-1.318=-0.111
σ0.319-0.303=0.016
min0.911-0.985=-0.074
max1.740-1.677=0.063

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.386-437.378=0.007
σ572.364-572.364=-0.000
min151.195-151.194=0.000
max1295.931-1295.924=0.007
mean90.250
σ8.500
min86.000
max103.000
mean1638.000-1598.000=40.000
σ0.000
min1638.000-1598.000=40.000
max1638.000-1598.000=40.000
mean0.518-0.520=-0.002
σ0.531-0.533=-0.002
min0.251-0.250=0.002
max1.315-1.320=-0.005
policies=20
mean1512.213-1512.173=0.040
σ0.253-0.200=0.053
min1512.053-1512.026=0.027
max1512.591-1512.468=0.123
mean860.000
σ0.000
min860.000
max860.000
mean1638.000-1598.000=40.000
σ0.000
min1638.000-1598.000=40.000
max1638.000-1598.000=40.000
mean2.540-2.519=0.021
σ0.027-0.023=0.004
min2.503-2.494=0.009
max2.567-2.539=0.028
policies=200
mean15129.711-15129.511=0.200
σ0.064-0.414=-0.351
min15129.665-15128.898=0.766
max15129.804-15129.788=0.016
mean8600.000
σ0.000
min8600.000
max8600.000
mean1638.000-1598.000=40.000
σ0.000
min1638.000-1598.000=40.000
max1638.000-1598.000=40.000
mean25.726-25.592=0.134
σ0.167-0.116=0.051
min25.605-25.474=0.131
max25.971-25.740=0.230