Compare commits

Home / Compare 30fb682a .. 5a6374ca

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.046-73.044=0.002
σ0.046-0.045=0.001
min73.012-73.023=-0.010
max73.173-73.171=0.002
mean413.000-415.800=-2.800
σ0.000-0.422=-0.422
min413.000-415.000=-2.000
max413.000-416.000=-3.000
mean0.162-0.163=-0.001
σ0.004-0.004=-0.000
min0.158-0.158=-0.000
max0.169-0.169=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.739-23.741=-0.001
σ0.001-0.004=-0.003
min23.737-23.736=0.000
max23.741-23.749=-0.009
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.066-0.066=-0.000
σ0.003-0.002=0.001
min0.062-0.065=-0.003
max0.074-0.073=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.789-1758.787=0.002
σ0.362-0.361=0.001
min1758.216-1758.216=-0.001
max1759.382-1759.372=0.010
mean1650.550-1622.650=27.900
σ627.412-591.322=36.090
min617.000-622.000=-5.000
max2856.000-2410.000=446.000
mean2.822-2.866=-0.044
σ0.193-0.191=0.002
min2.243-2.488=-0.245
max3.048-3.270=-0.222

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.014-324.016=-0.002
σ0.055-0.052=0.003
min323.918-323.923=-0.005
max324.049-324.045=0.004
mean2856.000-2410.000=446.000
σ0.000
min2856.000-2410.000=446.000
max2856.000-2410.000=446.000
mean0.433-0.431=0.002
σ0.007-0.004=0.003
min0.426-0.426=-0.000
max0.443-0.435=0.008
iters=5
new-facts=1
prior-facts=6402
mean1984.585-1984.582=0.003
σ0.018-0.028=-0.010
min1984.557-1984.549=0.008
max1984.604-1984.604=-0.001
mean2856.000-2410.000=446.000
σ0.000
min2856.000-2410.000=446.000
max2856.000-2410.000=446.000
mean2.579-2.644=-0.065
σ0.100-0.175=-0.075
min2.439-2.488=-0.049
max2.709-2.934=-0.225
iters=5
new-facts=6402
prior-facts=1
mean4808.130-4808.259=-0.130
σ7.900-7.795=0.105
min4804.097-4804.662=-0.565
max4822.251-4822.203=0.048
mean2856.000-2410.000=446.000
σ0.000
min2856.000-2410.000=446.000
max2856.000-2410.000=446.000
mean8.899-8.784=0.115
σ0.492-0.332=0.160
min8.240-8.234=0.006
max9.488-9.039=0.448
iters=5
new-facts=6402
prior-facts=6402
mean4995.804-4995.807=-0.004
σ0.021-0.023=-0.001
min4995.778-4995.778=0.000
max4995.825-4995.830=-0.006
mean3026.800-2963.800=63.000
σ180.757-272.478=-91.721
min2856.000-2598.000=258.000
max3290.000-3326.000=-36.000
mean8.668-8.575=0.093
σ0.214-0.090=0.125
min8.409-8.473=-0.063
max8.929-8.677=0.252

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.006-1.697=-0.691
σ0.136-0.125=0.011
min0.916-1.574=-0.658
max1.227-1.872=-0.645

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.350-468.327=0.023
σ574.233-574.233=-0.001
min181.228-181.208=0.020
max1329.698-1329.677=0.022
mean88.250
σ8.500
min84.000
max101.000
mean2856.000-2410.000=446.000
σ0.000
min2856.000-2410.000=446.000
max2856.000-2410.000=446.000
mean0.440-0.549=-0.109
σ0.301-0.529=-0.228
min0.289-0.282=0.006
max0.892-1.342=-0.451
policies=20
mean1812.642-1812.425=0.216
σ0.396-0.407=-0.011
min1812.366-1812.153=0.213
max1813.224-1813.027=0.197
mean840.000
σ0.000
min840.000
max840.000
mean2856.000-2410.000=446.000
σ0.000
min2856.000-2410.000=446.000
max2856.000-2410.000=446.000
mean2.893-2.832=0.061
σ0.021-0.017=0.004
min2.875-2.813=0.062
max2.920-2.847=0.073
policies=200
mean18132.363-18131.709=0.654
σ0.701-0.480=0.221
min18131.404-18131.366=0.038
max18133.090-18132.417=0.674
mean8400.000
σ0.000
min8400.000
max8400.000
mean2856.000-2410.000=446.000
σ0.000
min2856.000-2410.000=446.000
max2856.000-2410.000=446.000
mean28.746-28.442=0.304
σ0.447-0.082=0.365
min28.305-28.331=-0.026
max29.175-28.521=0.655