Compare commits

Home / Compare 26c9d4e2 .. e46fe42f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-70.701=-35.084
σ0.054-0.047=0.007
min35.586-70.672=-35.086
max35.769-70.831=-35.062
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.080-0.159=-0.079
σ0.004-0.010=-0.006
min0.076-0.136=-0.059
max0.088-0.177=-0.089
cache=y
dps=1
iters=10
policies=100
mean24.046-21.408=2.638
σ0.004-0.003=0.001
min24.038-21.404=2.634
max24.051-21.412=2.639
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.066-0.064=0.002
σ0.004-0.004=-0.000
min0.061-0.060=0.001
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1754.930=1.561
σ0.365-0.361=0.004
min1755.916-1754.363=1.554
max1757.079-1755.515=1.564
mean1647.050-1645.450=1.600
σ639.374-632.353=7.021
min625.000-623.000=2.000
max2822.000-2772.000=50.000
mean2.328-2.810=-0.481
σ0.075-0.224=-0.149
min2.221-2.284=-0.063
max2.549-3.267=-0.718

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.766-272.791=51.975
σ0.053-0.006=0.047
min324.671-272.784=51.887
max324.794-272.795=51.998
mean2822.000-2772.000=50.000
σ0.000
min2822.000-2772.000=50.000
max2822.000-2772.000=50.000
mean0.431-0.379=0.052
σ0.010-0.001=0.008
min0.423-0.377=0.046
max0.442-0.380=0.062
iters=5
new-facts=1
prior-facts=6402
mean1985.317-1933.215=52.102
σ0.022-0.013=0.009
min1985.297-1933.193=52.104
max1985.343-1933.225=52.118
mean2822.000-2772.000=50.000
σ0.000
min2822.000-2772.000=50.000
max2822.000-2772.000=50.000
mean2.636-3.030=-0.394
σ0.134-0.028=0.106
min2.518-2.997=-0.479
max2.812-3.066=-0.254
iters=5
new-facts=6402
prior-facts=1
mean4809.120-4756.926=52.194
σ7.705-7.598=0.107
min4805.573-4753.445=52.129
max4822.903-4770.518=52.385
mean2822.000-2772.000=50.000
σ0.000
min2822.000-2772.000=50.000
max2822.000-2772.000=50.000
mean8.833-8.716=0.117
σ0.473-0.323=0.150
min7.993-8.306=-0.313
max9.127-9.176=-0.049
iters=5
new-facts=6402
prior-facts=6402
mean4996.626-4944.385=52.241
σ0.024-0.160=-0.136
min4996.593-4944.100=52.493
max4996.653-4944.476=52.177
mean3054.400-2987.800=66.600
σ303.324-211.143=92.181
min2822.000-2772.000=50.000
max3520.000-3298.000=222.000
mean8.512-8.602=-0.091
σ0.122-0.193=-0.071
min8.410-8.437=-0.027
max8.723-8.913=-0.191

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.978-0.980=-0.001
σ0.068-0.137=-0.070
min0.921-0.911=0.010
max1.058-1.225=-0.168

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.210-468.323=-5.113
σ574.773-574.231=0.542
min175.814-181.203=-5.390
max1325.369-1329.669=-4.300
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2822.000-2772.000=50.000
σ0.000
min2822.000-2772.000=50.000
max2822.000-2772.000=50.000
mean0.434-0.444=-0.010
σ0.301-0.299=0.003
min0.280-0.291=-0.011
max0.886-0.892=-0.006
policies=20
mean1758.505-1812.375=-53.870
σ0.353-0.389=-0.036
min1758.269-1812.108=-53.839
max1759.030-1812.949=-53.919
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2822.000-2772.000=50.000
σ0.000
min2822.000-2772.000=50.000
max2822.000-2772.000=50.000
mean2.780-2.863=-0.083
σ0.006-0.010=-0.004
min2.771-2.852=-0.082
max2.783-2.876=-0.092
policies=200
mean17592.135-18129.113=-536.978
σ0.487-0.477=0.010
min17591.828-18128.783=-536.955
max17592.861-18129.809=-536.948
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2822.000-2772.000=50.000
σ0.000
min2822.000-2772.000=50.000
max2822.000-2772.000=50.000
mean27.803-28.438=-0.635
σ0.378-0.149=0.230
min27.465-28.268=-0.803
max28.224-28.567=-0.343