Compare commits

Home / Compare 5287e2c5 .. 99388c51

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.046-73.045=0.001
σ0.049-0.048=0.001
min73.019-73.021=-0.001
max73.182-73.180=0.003
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.162-0.157=0.005
σ0.011-0.005=0.006
min0.149-0.151=-0.002
max0.180-0.164=0.016
cache=y
dps=1
iters=10
policies=100
mean23.740-23.741=-0.002
σ0.004-0.002=0.001
min23.735-23.738=-0.003
max23.748-23.744=0.004
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.066-0.066=-0.000
σ0.002-0.003=-0.000
min0.064-0.064=0.000
max0.071-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.789-1758.788=0.001
σ0.361-0.360=0.001
min1758.219-1758.212=0.007
max1759.370-1759.371=-0.001
mean1628.900-1658.400=-29.500
σ598.993-621.403=-22.410
min650.000-624.000=26.000
max2431.000-2497.000=-66.000
mean2.831-2.841=-0.010
σ0.137-0.106=0.031
min2.552-2.545=0.006
max3.202-2.983=0.219

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean323.988-324.015=-0.026
σ0.043-0.055=-0.012
min323.912-323.916=-0.005
max324.010-324.042=-0.032
mean2431.000-2497.000=-66.000
σ0.000
min2431.000-2497.000=-66.000
max2431.000-2497.000=-66.000
mean0.431-0.427=0.004
σ0.008-0.006=0.002
min0.427-0.421=0.005
max0.445-0.437=0.008
iters=5
new-facts=1
prior-facts=6402
mean1984.594-1984.586=0.008
σ0.018-0.021=-0.003
min1984.568-1984.558=0.010
max1984.610-1984.611=-0.001
mean2431.000-2497.000=-66.000
σ0.000
min2431.000-2497.000=-66.000
max2431.000-2497.000=-66.000
mean2.628-2.598=0.030
σ0.131-0.064=0.067
min2.501-2.551=-0.049
max2.840-2.701=0.139
iters=5
new-facts=6402
prior-facts=1
mean4808.061-4808.240=-0.179
σ7.603-7.805=-0.202
min4804.066-4804.701=-0.634
max4821.646-4822.202=-0.556
mean2431.000-2497.000=-66.000
σ0.000
min2431.000-2497.000=-66.000
max2431.000-2497.000=-66.000
mean8.484-8.931=-0.447
σ0.733-0.293=0.439
min7.720-8.604=-0.884
max9.277-9.393=-0.116
iters=5
new-facts=6402
prior-facts=6402
mean4995.731-4995.738=-0.007
σ0.153-0.175=-0.022
min4995.459-4995.426=0.034
max4995.829-4995.828=0.001
mean2949.800-2993.000=-43.200
σ460.752-274.557=186.195
min2431.000-2619.000=-188.000
max3573.000-3316.000=257.000
mean8.515-8.707=-0.192
σ0.108-0.255=-0.146
min8.419-8.424=-0.005
max8.672-9.120=-0.448

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.695-1.637=0.058
σ0.140-0.235=-0.095
min1.511-1.227=0.284
max1.864-1.823=0.041

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.327-468.326=0.001
σ574.229-574.232=-0.003
min181.207-181.209=-0.002
max1329.670-1329.673=-0.003
mean88.250
σ8.500
min84.000
max101.000
mean2431.000-2497.000=-66.000
σ0.000
min2431.000-2497.000=-66.000
max2431.000-2497.000=-66.000
mean0.581-0.554=0.027
σ0.594-0.534=0.060
min0.280-0.285=-0.005
max1.471-1.355=0.116
policies=20
mean1812.436-1812.433=0.003
σ0.390-0.388=0.002
min1812.181-1812.168=0.013
max1813.014-1813.005=0.008
mean840.000
σ0.000
min840.000
max840.000
mean2431.000-2497.000=-66.000
σ0.000
min2431.000-2497.000=-66.000
max2431.000-2497.000=-66.000
mean2.815-2.821=-0.006
σ0.005-0.012=-0.007
min2.807-2.809=-0.002
max2.819-2.837=-0.017
policies=200
mean18131.516-18131.707=-0.191
σ0.645-0.523=0.122
min18131.087-18131.420=-0.333
max18132.469-18132.491=-0.023
mean8400.000
σ0.000
min8400.000
max8400.000
mean2431.000-2497.000=-66.000
σ0.000
min2431.000-2497.000=-66.000
max2431.000-2497.000=-66.000
mean28.331-28.370=-0.039
σ0.076-0.057=0.019
min28.238-28.301=-0.063
max28.393-28.432=-0.039