Compare commits

Home / Compare 91729bc4 .. 66eba39c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.044-73.046=-0.001
σ0.045-0.049=-0.004
min73.023-73.023=-0.001
max73.171-73.183=-0.012
mean415.800-414.000=1.800
σ0.422-0.000=0.422
min415.000-414.000=1.000
max416.000-414.000=2.000
mean0.163-0.161=0.002
σ0.004-0.005=-0.001
min0.158-0.155=0.003
max0.169-0.168=0.002
cache=y
dps=1
iters=10
policies=100
mean23.741-23.742=-0.001
σ0.004-0.003=0.001
min23.736-23.735=0.001
max23.749-23.747=0.002
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.066-0.066=0.000
σ0.002-0.002=0.000
min0.065-0.064=0.001
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.787-1758.788=-0.001
σ0.361-0.362=-0.001
min1758.216-1758.212=0.004
max1759.372-1759.370=0.002
mean1622.650-1642.350=-19.700
σ591.322-626.390=-35.068
min622.000-616.000=6.000
max2410.000-2772.000=-362.000
mean2.866-2.846=0.020
σ0.191-0.167=0.023
min2.488-2.423=0.065
max3.270-3.030=0.240

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.016-324.009=0.007
σ0.052-0.058=-0.006
min323.923-323.906=0.017
max324.045-324.043=0.002
mean2410.000-2772.000=-362.000
σ0.000
min2410.000-2772.000=-362.000
max2410.000-2772.000=-362.000
mean0.431-0.427=0.004
σ0.004-0.004=-0.001
min0.426-0.424=0.002
max0.435-0.435=0.000
iters=5
new-facts=1
prior-facts=6402
mean1984.582-1984.577=0.006
σ0.028-0.022=0.007
min1984.549-1984.551=-0.002
max1984.604-1984.603=0.002
mean2410.000-2772.000=-362.000
σ0.000
min2410.000-2772.000=-362.000
max2410.000-2772.000=-362.000
mean2.644-2.636=0.007
σ0.175-0.139=0.035
min2.488-2.481=0.006
max2.934-2.838=0.096
iters=5
new-facts=6402
prior-facts=1
mean4808.259-4808.235=0.024
σ7.795-7.733=0.063
min4804.662-4804.730=-0.068
max4822.203-4822.068=0.135
mean2410.000-2772.000=-362.000
σ0.000
min2410.000-2772.000=-362.000
max2410.000-2772.000=-362.000
mean8.784-8.741=0.044
σ0.332-0.273=0.059
min8.234-8.310=-0.076
max9.039-8.970=0.070
iters=5
new-facts=6402
prior-facts=6402
mean4995.807-4995.818=-0.011
σ0.023-0.054=-0.032
min4995.778-4995.766=0.012
max4995.830-4995.910=-0.079
mean2963.800-2994.800=-31.000
σ272.478-255.509=16.969
min2598.000-2772.000=-174.000
max3326.000-3398.000=-72.000
mean8.575-8.834=-0.259
σ0.090-0.748=-0.658
min8.473-8.468=0.005
max8.677-10.171=-1.494

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.697-1.147=0.550
σ0.125-0.221=-0.096
min1.574-0.898=0.676
max1.872-1.450=0.422

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.327-468.357=-0.030
σ574.233-574.246=-0.012
min181.208-181.226=-0.018
max1329.677-1329.725=-0.049
mean88.250
σ8.500
min84.000
max101.000
mean2410.000-2772.000=-362.000
σ0.000
min2410.000-2772.000=-362.000
max2410.000-2772.000=-362.000
mean0.549-0.446=0.103
σ0.529-0.306=0.224
min0.282-0.292=-0.010
max1.342-0.904=0.438
policies=20
mean1812.425-1812.592=-0.166
σ0.407-0.398=0.008
min1812.153-1812.328=-0.175
max1813.027-1813.178=-0.152
mean840.000
σ0.000
min840.000
max840.000
mean2410.000-2772.000=-362.000
σ0.000
min2410.000-2772.000=-362.000
max2410.000-2772.000=-362.000
mean2.832-2.873=-0.041
σ0.017-0.023=-0.006
min2.813-2.839=-0.026
max2.847-2.891=-0.044
policies=200
mean18131.709-18131.623=0.086
σ0.480-0.560=-0.080
min18131.366-18131.141=0.224
max18132.417-18132.433=-0.016
mean8400.000
σ0.000
min8400.000
max8400.000
mean2410.000-2772.000=-362.000
σ0.000
min2410.000-2772.000=-362.000
max2410.000-2772.000=-362.000
mean28.442-28.396=0.046
σ0.082-0.240=-0.158
min28.331-28.256=0.075
max28.521-28.754=-0.233