Compare commits

Home / Compare 7c5b12f7 .. e0b66d36

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-36.692=-1.075
σ0.054-0.593=-0.539
min35.586-35.929=-0.343
max35.769-37.212=-1.443
mean414.000-4136.000=-3722.000
σ0.000
min414.000-4136.000=-3722.000
max414.000-4136.000=-3722.000
mean0.080-0.076=0.004
σ0.004-0.001=0.003
min0.076-0.075=0.002
max0.088-0.077=0.011
cache=y
dps=1
iters=10
policies=100
mean24.046-26.712=-2.666
σ0.004-0.644=-0.641
min24.038-26.209=-2.171
max24.051-27.464=-3.413
mean414.000-4136.000=-3722.000
σ0.000
min414.000-4136.000=-3722.000
max414.000-4136.000=-3722.000
mean0.066-0.060=0.005
σ0.004-0.001=0.003
min0.061-0.059=0.002
max0.071-0.061=0.010

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.366=0.125
σ0.365-0.373=-0.008
min1755.916-1755.794=0.122
max1757.079-1756.966=0.113
mean1647.050-1649.800=-2.750
σ639.374-625.248=14.126
min625.000-613.000=12.000
max2822.000-2651.000=171.000
mean2.328-2.339=-0.011
σ0.075-0.241=-0.166
min2.221-2.136=0.085
max2.549-3.050=-0.501

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.766-278.699=46.067
σ0.053-0.012=0.042
min324.671-278.687=45.984
max324.794-278.715=46.078
mean2822.000-2651.000=171.000
σ0.000
min2822.000-2651.000=171.000
max2822.000-2651.000=171.000
mean0.431-0.416=0.015
σ0.010-0.002=0.007
min0.423-0.413=0.010
max0.442-0.419=0.023
iters=5
new-facts=1
prior-facts=6402
mean1985.317-2268.864=-283.547
σ0.022-0.006=0.015
min1985.297-2268.853=-283.557
max1985.343-2268.869=-283.526
mean2822.000-2651.000=171.000
σ0.000
min2822.000-2651.000=171.000
max2822.000-2651.000=171.000
mean2.636-3.054=-0.418
σ0.134-0.151=-0.017
min2.518-2.868=-0.350
max2.812-3.214=-0.402
iters=5
new-facts=6402
prior-facts=1
mean4809.120-4952.357=-143.237
σ7.705-0.789=6.917
min4805.573-4951.949=-146.375
max4822.903-4953.767=-130.864
mean2822.000-2651.000=171.000
σ0.000
min2822.000-2651.000=171.000
max2822.000-2651.000=171.000
mean8.833-7.896=0.937
σ0.473-0.193=0.281
min7.993-7.714=0.279
max9.127-8.163=0.964
iters=5
new-facts=6402
prior-facts=6402
mean4996.626-5166.999=-170.372
σ0.024-0.165=-0.141
min4996.593-5166.706=-170.112
max4996.653-5167.096=-170.442
mean3054.400-3422.600=-368.200
σ303.324-478.771=-175.447
min2822.000-2877.000=-55.000
max3520.000-4136.000=-616.000
mean8.512-9.350=-0.838
σ0.122-0.480=-0.358
min8.410-8.517=-0.107
max8.723-9.725=-1.002

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.978-1.027=-0.049
σ0.068-0.131=-0.063
min0.921-0.936=-0.016
max1.058-1.241=-0.183

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.210-460.259=2.951
σ574.773-572.607=2.165
min175.814-173.954=1.860
max1325.369-1319.170=6.199
mean86.250-79.500=6.750
σ8.500-7.000=1.500
min82.000-76.000=6.000
max99.000-90.000=9.000
mean2822.000-435.000=2387.000
σ0.000
min2822.000-435.000=2387.000
max2822.000-435.000=2387.000
mean0.434-0.559=-0.125
σ0.301-0.570=-0.269
min0.280-0.267=0.013
max0.886-1.414=-0.529
policies=20
mean1758.505-1740.048=18.458
σ0.353-0.335=0.018
min1758.269-1739.810=18.459
max1759.030-1740.541=18.489
mean820.000-760.000=60.000
σ0.000
min820.000-760.000=60.000
max820.000-760.000=60.000
mean2822.000-446.250=2375.750
σ0.000-10.308=-10.308
min2822.000-435.000=2387.000
max2822.000-455.000=2367.000
mean2.780-2.673=0.107
σ0.006-0.015=-0.009
min2.771-2.661=0.109
max2.783-2.693=0.091
policies=200
mean17592.135-17409.790=182.345
σ0.487-0.081=0.406
min17591.828-17409.686=182.142
max17592.861-17409.879=182.982
mean8200.000-7600.000=600.000
σ0.000
min8200.000-7600.000=600.000
max8200.000-7600.000=600.000
mean2822.000-492.750=2329.250
σ0.000-2.754=-2.754
min2822.000-490.000=2332.000
max2822.000-496.000=2326.000
mean27.803-26.869=0.933
σ0.378-0.097=0.281
min27.465-26.776=0.688
max28.224-27.005=1.219