Compare commits

Home / Compare 4db07bde .. b85f751e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.245-73.045=-37.801
σ0.055-0.048=0.007
min35.217-73.021=-37.803
max35.401-73.180=-37.779
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.082-0.157=-0.075
σ0.005-0.005=-0.000
min0.076-0.151=-0.075
max0.089-0.164=-0.075
cache=y
dps=1
iters=10
policies=100
mean23.770-23.741=0.028
σ0.004-0.002=0.002
min23.764-23.738=0.026
max23.778-23.744=0.034
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.066-0.066=0.000
σ0.005-0.003=0.002
min0.061-0.064=-0.003
max0.074-0.073=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.362-1758.788=-2.425
σ0.365-0.360=0.005
min1755.787-1758.212=-2.425
max1756.954-1759.371=-2.416
mean1651.800-1658.400=-6.600
σ638.585-621.403=17.182
min630.000-624.000=6.000
max2830.000-2497.000=333.000
mean2.337-2.841=-0.504
σ0.078-0.106=-0.028
min2.254-2.545=-0.292
max2.530-2.983=-0.453

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.589-324.015=0.575
σ0.041-0.055=-0.014
min324.517-323.916=0.601
max324.615-324.042=0.573
mean2830.000-2497.000=333.000
σ0.000
min2830.000-2497.000=333.000
max2830.000-2497.000=333.000
mean0.423-0.427=-0.004
σ0.001-0.006=-0.005
min0.422-0.421=0.000
max0.425-0.437=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1985.144-1984.586=0.558
σ0.005-0.021=-0.016
min1985.138-1984.558=0.580
max1985.150-1984.611=0.540
mean2830.000-2497.000=333.000
σ0.000
min2830.000-2497.000=333.000
max2830.000-2497.000=333.000
mean2.592-2.598=-0.005
σ0.050-0.064=-0.014
min2.540-2.551=-0.011
max2.646-2.701=-0.055
iters=5
new-facts=6402
prior-facts=1
mean4808.740-4808.240=0.499
σ7.676-7.805=-0.129
min4805.235-4804.701=0.534
max4822.470-4822.202=0.268
mean2830.000-2497.000=333.000
σ0.000
min2830.000-2497.000=333.000
max2830.000-2497.000=333.000
mean8.873-8.931=-0.059
σ0.228-0.293=-0.065
min8.504-8.604=-0.100
max9.098-9.393=-0.294
iters=5
new-facts=6402
prior-facts=6402
mean4996.273-4995.738=0.535
σ0.177-0.175=0.002
min4995.956-4995.426=0.531
max4996.365-4995.828=0.537
mean3048.600-2993.000=55.600
σ187.848-274.557=-86.709
min2830.000-2619.000=211.000
max3312.000-3316.000=-4.000
mean8.642-8.707=-0.065
σ0.209-0.255=-0.046
min8.400-8.424=-0.024
max8.834-9.120=-0.286

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.928-1.637=-0.709
σ0.011-0.235=-0.224
min0.921-1.227=-0.306
max0.947-1.823=-0.876

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.968-468.326=-5.358
σ574.247-574.232=0.016
min175.837-181.209=-5.372
max1324.338-1329.673=-5.335
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2830.000-2497.000=333.000
σ0.000
min2830.000-2497.000=333.000
max2830.000-2497.000=333.000
mean0.432-0.554=-0.122
σ0.299-0.534=-0.235
min0.280-0.285=-0.005
max0.881-1.355=-0.474
policies=20
mean1758.720-1812.433=-53.713
σ0.338-0.388=-0.049
min1758.503-1812.168=-53.665
max1759.224-1813.005=-53.782
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2830.000-2497.000=333.000
σ0.000
min2830.000-2497.000=333.000
max2830.000-2497.000=333.000
mean2.789-2.821=-0.032
σ0.013-0.012=0.001
min2.769-2.809=-0.041
max2.798-2.837=-0.039
policies=200
mean17593.304-18131.707=-538.403
σ0.702-0.523=0.179
min17592.334-18131.420=-539.086
max17593.850-18132.491=-538.642
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2830.000-2497.000=333.000
σ0.000
min2830.000-2497.000=333.000
max2830.000-2497.000=333.000
mean27.975-28.370=-0.396
σ0.454-0.057=0.397
min27.575-28.301=-0.726
max28.491-28.432=0.060