Compare commits

Home / Compare 0c10c188 .. d844af69

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.781=0.000
σ0.055-0.052=0.003
min70.747-70.748=-0.000
max70.935-70.926=0.009
mean415.000
σ0.000
min415.000
max415.000
mean0.160-0.162=-0.002
σ0.003-0.003=-0.000
min0.155-0.159=-0.005
max0.165-0.169=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.494-21.493=0.001
σ0.002-0.002=0.000
min21.491-21.490=0.001
max21.498-21.496=0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.065-0.066=-0.001
σ0.003-0.003=0.000
min0.063-0.063=-0.000
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.122-1751.119=0.003
σ0.361-0.360=0.001
min1750.551-1750.545=0.006
max1751.703-1751.706=-0.002
mean1641.800-1663.000=-21.200
σ630.041-639.675=-9.634
min622.000
max2768.000-2865.000=-97.000
mean2.819-2.784=0.035
σ0.141-0.151=-0.011
min2.440-2.447=-0.007
max3.050-3.012=0.038

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean268.618-268.621=-0.002
σ0.005-0.007=-0.001
min268.611-268.612=-0.001
max268.624-268.630=-0.006
mean2768.000-2865.000=-97.000
σ0.000
min2768.000-2865.000=-97.000
max2768.000-2865.000=-97.000
mean0.376-0.379=-0.002
σ0.004-0.003=0.001
min0.374-0.376=-0.002
max0.384-0.384=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1929.012-1929.004=0.008
σ0.020-0.019=0.002
min1928.985-1928.973=0.012
max1929.033-1929.018=0.015
mean2768.000-2865.000=-97.000
σ0.000
min2768.000-2865.000=-97.000
max2768.000-2865.000=-97.000
mean2.560-2.521=0.039
σ0.148-0.077=0.071
min2.415-2.479=-0.064
max2.758-2.658=0.099
iters=5
new-facts=6402
prior-facts=1
mean4749.759-4749.742=0.016
σ0.807-0.854=-0.047
min4749.277-4749.236=0.041
max4751.195-4751.262=-0.066
mean2768.000-2865.000=-97.000
σ0.000
min2768.000-2865.000=-97.000
max2768.000-2865.000=-97.000
mean8.326-8.539=-0.213
σ0.477-0.487=-0.009
min7.699-7.849=-0.149
max8.928-9.191=-0.263
iters=5
new-facts=6402
prior-facts=6402
mean4940.229-4940.157=0.073
σ0.017-0.149=-0.131
min4940.208-4939.892=0.316
max4940.245-4940.243=0.002
mean2982.200-3042.400=-60.200
σ247.429-261.595=-14.166
min2768.000-2865.000=-97.000
max3373.000-3469.000=-96.000
mean8.382-8.497=-0.115
σ0.064-0.204=-0.140
min8.301-8.333=-0.032
max8.460-8.853=-0.393

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.022-1.037=-0.015
σ0.139-0.150=-0.011
min0.930-0.941=-0.011
max1.252-1.288=-0.036

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.699-462.697=0.003
σ574.923-574.925=-0.002
min175.222-175.224=-0.003
max1325.083-1325.084=-0.000
mean86.250
σ8.500
min82.000
max99.000
mean2768.000-2865.000=-97.000
σ0.000
min2768.000-2865.000=-97.000
max2768.000-2865.000=-97.000
mean0.439-0.440=-0.001
σ0.305-0.307=-0.002
min0.285-0.282=0.003
max0.896-0.900=-0.004
policies=20
mean1752.543-1752.520=0.023
σ0.373-0.379=-0.006
min1752.311-1752.252=0.060
max1753.101-1753.081=0.020
mean820.000
σ0.000
min820.000
max820.000
mean2768.000-2865.000=-97.000
σ0.000
min2768.000-2865.000=-97.000
max2768.000-2865.000=-97.000
mean2.808-2.825=-0.017
σ0.089-0.018=0.071
min2.722-2.806=-0.084
max2.928-2.847=0.081
policies=200
mean17532.186-17532.292=-0.106
σ0.437-0.511=-0.074
min17531.839-17531.991=-0.152
max17532.820-17533.055=-0.235
mean8200.000
σ0.000
min8200.000
max8200.000
mean2768.000-2865.000=-97.000
σ0.000
min2768.000-2865.000=-97.000
max2768.000-2865.000=-97.000
mean27.577-28.222=-0.644
σ0.102-0.465=-0.363
min27.500-27.691=-0.190
max27.725-28.624=-0.898