Compare commits

Home / Compare d44e59bd .. 8d00602e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.979=0.001
σ0.048-0.047=0.000
min33.955-33.953=0.002
max34.111-34.108=0.003
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.082-0.084=-0.002
σ0.005-0.003=0.002
min0.077-0.081=-0.005
max0.092-0.090=0.002
cache=y
dps=1
iters=10
policies=100
mean23.318-23.317=0.001
σ0.002-0.002=0.000
min23.314-23.313=0.001
max23.321-23.322=-0.001
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.065-0.066=-0.001
σ0.003-0.003=-0.000
min0.064-0.064=-0.000
max0.073-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.428-1719.428=38.000
σ0.364-169.711=-169.347
min1756.854-998.406=758.448
max1758.016-1757.954=0.063
mean1648.300-1624.700=23.600
σ612.222-604.328=7.894
min677.000-671.000=6.000
max2630.000-2611.000=19.000
mean2.367-2.306=0.061
σ0.093-0.240=-0.146
min2.255-1.379=0.877
max2.595-2.670=-0.075

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.575-326.507=0.068
σ0.043-0.048=-0.005
min326.503-326.421=0.082
max326.616-326.534=0.082
mean2630.000-2611.000=19.000
σ0.000
min2630.000-2611.000=19.000
max2630.000-2611.000=19.000
mean0.424-0.425=-0.000
σ0.007-0.005=0.002
min0.420-0.421=-0.000
max0.436-0.433=0.003
iters=5
new-facts=1
prior-facts=6402
mean1988.727-1988.674=0.054
σ0.018-0.012=0.006
min1988.707-1988.654=0.053
max1988.749-1988.684=0.065
mean2630.000-2611.000=19.000
σ0.000
min2630.000-2611.000=19.000
max2630.000-2611.000=19.000
mean2.803-2.756=0.047
σ0.283-0.182=0.101
min2.632-2.626=0.006
max3.305-3.078=0.227
iters=5
new-facts=6402
prior-facts=1
mean4813.458-4813.439=0.019
σ7.778-7.820=-0.042
min4809.613-4809.600=0.013
max4827.367-4827.423=-0.056
mean2630.000-2611.000=19.000
σ0.000
min2630.000-2611.000=19.000
max2630.000-2611.000=19.000
mean8.985-8.507=0.478
σ0.192-0.690=-0.498
min8.674-7.824=0.851
max9.173-9.581=-0.408
iters=5
new-facts=6402
prior-facts=6402
mean5001.146-5000.856=0.290
σ0.034-0.305=-0.271
min5001.112-5000.392=0.720
max5001.200-5001.073=0.127
mean2989.800-2949.600=40.200
σ275.427-354.817=-79.389
min2630.000-2611.000=19.000
max3317.000-3418.000=-101.000
mean9.752-9.529=0.223
σ0.388-0.403=-0.015
min9.113-8.821=0.292
max10.125-9.779=0.347

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.118-1.136=-0.018
σ0.304-0.272=0.032
min0.913-0.917=-0.004
max1.652-1.572=0.080

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.571-464.505=0.066
σ574.780-574.778=0.002
min177.172-177.108=0.064
max1326.741-1326.672=0.069
mean88.250
σ8.500
min84.000
max101.000
mean2630.000-2611.000=19.000
σ0.000
min2630.000-2611.000=19.000
max2630.000-2611.000=19.000
mean0.556-0.526=0.031
σ0.568-0.507=0.062
min0.270-0.271=-0.001
max1.409-1.286=0.123
policies=20
mean1772.012-1771.384=0.628
σ0.353-0.356=-0.003
min1771.785-1771.149=0.636
max1772.538-1771.912=0.625
mean840.000
σ0.000
min840.000
max840.000
mean2630.000-2611.000=19.000
σ0.000
min2630.000-2611.000=19.000
max2630.000-2611.000=19.000
mean2.728-2.722=0.007
σ0.018-0.014=0.004
min2.704-2.705=-0.001
max2.747-2.737=0.010
policies=200
mean17727.390-17721.134=6.256
σ0.544-0.471=0.073
min17727.085-17720.880=6.206
max17728.205-17721.840=6.365
mean8400.000
σ0.000
min8400.000
max8400.000
mean2630.000-2611.000=19.000
σ0.000
min2630.000-2611.000=19.000
max2630.000-2611.000=19.000
mean27.481-27.530=-0.049
σ0.093-0.071=0.022
min27.390-27.435=-0.045
max27.577-27.599=-0.023