Compare commits

Home / Compare d6f9e53e .. 51bfdb7d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-70.389=0.001
σ0.046-0.047=-0.001
min70.362-70.362=-0.000
max70.518-70.521=-0.003
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.159-0.160=-0.001
σ0.005-0.004=0.001
min0.154-0.156=-0.002
max0.171-0.167=0.004
cache=y
dps=1
iters=10
policies=100
mean21.144-21.145=-0.001
σ0.002-0.003=-0.001
min21.140-21.141=-0.001
max21.149-21.151=-0.003
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.064-0.064=-0.000
σ0.002-0.003=-0.001
min0.062-0.059=0.003
max0.070-0.071=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.395-1752.394=0.001
σ0.363-0.360=0.003
min1751.833-1751.824=0.009
max1752.981-1752.976=0.005
mean1660.950-1655.900=5.050
σ636.659-617.018=19.641
min627.000-636.000=-9.000
max2772.000-2495.000=277.000
mean2.850-2.830=0.021
σ0.171-0.119=0.052
min2.275-2.567=-0.292
max3.129-2.989=0.141

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.142-270.145=-0.003
σ0.007-0.007=0.000
min270.131-270.134=-0.003
max270.151-270.152=-0.000
mean2772.000-2495.000=277.000
σ0.000
min2772.000-2495.000=277.000
max2772.000-2495.000=277.000
mean0.378-0.379=-0.001
σ0.002-0.002=0.001
min0.374-0.377=-0.003
max0.380-0.381=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1930.600-1930.609=-0.009
σ0.020-0.012=0.008
min1930.573-1930.597=-0.024
max1930.624-1930.625=-0.001
mean2772.000-2495.000=277.000
σ0.000
min2772.000-2495.000=277.000
max2772.000-2495.000=277.000
mean2.561-2.521=0.040
σ0.152-0.074=0.078
min2.461-2.458=0.003
max2.829-2.612=0.217
iters=5
new-facts=6402
prior-facts=1
mean4751.316-4751.311=0.005
σ0.926-0.928=-0.002
min4750.804-4750.789=0.015
max4752.962-4752.958=0.004
mean2772.000-2495.000=277.000
σ0.000
min2772.000-2495.000=277.000
max2772.000-2495.000=277.000
mean8.517-8.593=-0.076
σ0.556-0.464=0.092
min7.579-7.965=-0.387
max8.979-9.026=-0.047
iters=5
new-facts=6402
prior-facts=6402
mean4941.705-4941.563=0.142
σ0.166-0.186=-0.020
min4941.410-4941.411=-0.001
max4941.797-4941.773=0.024
mean3008.200-3013.800=-5.600
σ219.449-259.093=-39.644
min2772.000-2629.000=143.000
max3305.000-3321.000=-16.000
mean8.448-8.545=-0.097
σ0.138-0.134=0.004
min8.329-8.430=-0.101
max8.677-8.777=-0.100

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.029-1.666=-0.637
σ0.133-0.148=-0.015
min0.935-1.444=-0.509
max1.241-1.795=-0.554

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.377-466.367=0.010
σ575.927-575.927=0.000
min178.406-178.400=0.007
max1330.267-1330.257=0.010
mean84.000
σ8.000
min80.000
max96.000
mean2772.000-2495.000=277.000
σ0.000
min2772.000-2495.000=277.000
max2772.000-2495.000=277.000
mean0.440-0.556=-0.116
σ0.305-0.542=-0.236
min0.285-0.283=0.002
max0.898-1.368=-0.471
policies=20
mean1784.316-1784.298=0.018
σ0.292-0.351=-0.059
min1784.126-1784.070=0.057
max1784.747-1784.820=-0.073
mean800.000
σ0.000
min800.000
max800.000
mean2772.000-2495.000=277.000
σ0.000
min2772.000-2495.000=277.000
max2772.000-2495.000=277.000
mean2.836-2.784=0.051
σ0.089-0.022=0.067
min2.757-2.767=-0.010
max2.958-2.814=0.144
policies=200
mean17849.418-17849.891=-0.474
σ1.047-0.530=0.517
min17848.092-17849.555=-1.463
max17850.652-17850.683=-0.031
mean8000.000
σ0.000
min8000.000
max8000.000
mean2772.000-2495.000=277.000
σ0.000
min2772.000-2495.000=277.000
max2772.000-2495.000=277.000
mean27.895-27.886=0.009
σ0.097-0.138=-0.041
min27.818-27.766=0.052
max28.025-28.026=-0.001