Compare commits

Home / Compare bbe2c6e9 .. ca32ca0f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.045-73.046=-0.001
σ0.046-0.048=-0.001
min73.011-73.022=-0.011
max73.173-73.181=-0.007
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.161-0.162=-0.001
σ0.003-0.004=-0.001
min0.155-0.158=-0.003
max0.166-0.168=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.741-23.740=0.000
σ0.004-0.003=0.000
min23.735-23.736=-0.001
max23.746-23.744=0.002
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.066-0.066=-0.000
σ0.003-0.002=0.001
min0.064-0.065=-0.000
max0.075-0.072=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.786-1758.787=-0.001
σ0.362-0.361=0.001
min1758.217-1758.211=0.006
max1759.387-1759.376=0.012
mean1659.950-1655.600=4.350
σ625.608-627.734=-2.126
min619.000-620.000=-1.000
max2844.000-2515.000=329.000
mean2.812-2.775=0.037
σ0.229-0.169=0.060
min2.268-2.327=-0.059
max3.114-2.973=0.141

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.017-324.012=0.005
σ0.042-0.052=-0.010
min323.943-323.920=0.023
max324.043-324.039=0.004
mean2844.000-2515.000=329.000
σ0.000
min2844.000-2515.000=329.000
max2844.000-2515.000=329.000
mean0.430-0.429=0.001
σ0.003-0.005=-0.002
min0.425-0.425=0.000
max0.433-0.437=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1984.581-1984.591=-0.011
σ0.018-0.017=0.001
min1984.563-1984.572=-0.009
max1984.602-1984.610=-0.008
mean2844.000-2515.000=329.000
σ0.000
min2844.000-2515.000=329.000
max2844.000-2515.000=329.000
mean2.589-2.662=-0.073
σ0.050-0.096=-0.046
min2.521-2.570=-0.048
max2.653-2.812=-0.159
iters=5
new-facts=6402
prior-facts=1
mean4808.224-4808.234=-0.010
σ7.787-7.771=0.016
min4804.699-4804.670=0.030
max4822.154-4822.135=0.018
mean2844.000-2515.000=329.000
σ0.000
min2844.000-2515.000=329.000
max2844.000-2515.000=329.000
mean8.832-8.854=-0.022
σ0.106-0.182=-0.077
min8.738-8.641=0.097
max9.009-9.092=-0.083
iters=5
new-facts=6402
prior-facts=6402
mean4995.800-4995.806=-0.006
σ0.023-0.020=0.003
min4995.779-4995.786=-0.007
max4995.830-4995.827=0.002
mean3011.200-2973.400=37.800
σ242.289-407.210=-164.920
min2844.000-2515.000=329.000
max3401.000-3488.000=-87.000
mean8.610-8.629=-0.019
σ0.155-0.195=-0.040
min8.458-8.467=-0.010
max8.855-8.924=-0.069

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.989-1.595=-0.606
σ0.133-0.271=-0.139
min0.892-1.232=-0.339
max1.198-1.876=-0.678

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.355-468.328=0.026
σ574.227-574.230=-0.004
min181.228-181.207=0.022
max1329.695-1329.674=0.021
mean88.250
σ8.500
min84.000
max101.000
mean2844.000-2515.000=329.000
σ0.000
min2844.000-2515.000=329.000
max2844.000-2515.000=329.000
mean0.442-0.547=-0.106
σ0.299-0.526=-0.227
min0.289-0.282=0.007
max0.890-1.336=-0.446
policies=20
mean1812.640-1812.428=0.212
σ0.396-0.394=0.003
min1812.363-1812.172=0.191
max1813.223-1813.012=0.211
mean840.000
σ0.000
min840.000
max840.000
mean2844.000-2515.000=329.000
σ0.000
min2844.000-2515.000=329.000
max2844.000-2515.000=329.000
mean2.883-2.798=0.085
σ0.003-0.021=-0.017
min2.879-2.771=0.108
max2.887-2.821=0.066
policies=200
mean18132.289-18131.639=0.650
σ0.642-0.453=0.188
min18131.496-18131.348=0.148
max18133.041-18132.316=0.725
mean8400.000
σ0.000
min8400.000
max8400.000
mean2844.000-2515.000=329.000
σ0.000
min2844.000-2515.000=329.000
max2844.000-2515.000=329.000
mean28.721-28.239=0.482
σ0.308-0.100=0.208
min28.333-28.172=0.161
max29.064-28.387=0.677