Compare commits

Home / Compare c596b64d .. 1006c3e2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.044-73.048=-0.003
σ0.046-0.049=-0.003
min73.021-73.019=0.003
max73.174-73.186=-0.013
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.158-0.160=-0.002
σ0.005-0.007=-0.002
min0.149-0.151=-0.002
max0.168-0.173=-0.005
cache=y
dps=1
iters=10
policies=100
mean23.741-23.739=0.002
σ0.003-0.005=-0.002
min23.737-23.731=0.006
max23.746-23.745=0.001
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.065-0.058=0.007
σ0.003-0.014=-0.011
min0.062-0.035=0.027
max0.073-0.075=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.786-1758.787=-0.001
σ0.361-0.360=0.000
min1758.219-1758.218=0.000
max1759.363-1759.369=-0.006
mean1658.800-1657.350=1.450
σ632.542-624.891=7.651
min619.000-628.000=-9.000
max2892.000-2505.000=387.000
mean2.876-2.819=0.057
σ0.107-0.118=-0.011
min2.606-2.564=0.042
max3.096-2.990=0.106

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.017-324.012=0.005
σ0.052-0.059=-0.007
min323.923-323.906=0.017
max324.043-324.040=0.003
mean2892.000-2505.000=387.000
σ0.000
min2892.000-2505.000=387.000
max2892.000-2505.000=387.000
mean0.428-0.427=0.001
σ0.001-0.004=-0.002
min0.427-0.424=0.003
max0.430-0.433=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1984.591-1984.587=0.005
σ0.017-0.021=-0.004
min1984.566-1984.559=0.007
max1984.606-1984.607=-0.001
mean2892.000-2505.000=387.000
σ0.000
min2892.000-2505.000=387.000
max2892.000-2505.000=387.000
mean2.608-2.572=0.037
σ0.047-0.033=0.014
min2.560-2.544=0.016
max2.686-2.626=0.060
iters=5
new-facts=6402
prior-facts=1
mean4808.200-4808.231=-0.031
σ7.796-7.822=-0.027
min4804.169-4804.668=-0.499
max4822.133-4822.224=-0.091
mean2892.000-2505.000=387.000
σ0.000
min2892.000-2505.000=387.000
max2892.000-2505.000=387.000
mean8.421-8.984=-0.564
σ0.444-0.113=0.331
min7.948-8.806=-0.858
max8.963-9.098=-0.135
iters=5
new-facts=6402
prior-facts=6402
mean4995.805-4995.805=0.000
σ0.034-0.021=0.013
min4995.776-4995.778=-0.002
max4995.851-4995.824=0.027
mean3099.000-3012.400=86.600
σ301.163-288.563=12.599
min2892.000-2611.000=281.000
max3574.000-3333.000=241.000
mean8.692-8.644=0.048
σ0.426-0.189=0.237
min8.421-8.477=-0.056
max9.441-8.950=0.490

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.068-1.532=-0.464
σ0.114-0.193=-0.079
min0.924-1.234=-0.311
max1.242-1.760=-0.517

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.352-468.326=0.026
σ574.233-574.234=-0.001
min181.228-181.204=0.024
max1329.702-1329.676=0.025
mean88.250
σ8.500
min84.000
max101.000
mean2892.000-2505.000=387.000
σ0.000
min2892.000-2505.000=387.000
max2892.000-2505.000=387.000
mean0.446-0.566=-0.120
σ0.305-0.564=-0.260
min0.291-0.283=0.008
max0.903-1.413=-0.510
policies=20
mean1812.599-1812.400=0.200
σ0.396-0.393=0.004
min1812.307-1812.133=0.174
max1813.178-1812.980=0.199
mean840.000
σ0.000
min840.000
max840.000
mean2892.000-2505.000=387.000
σ0.000
min2892.000-2505.000=387.000
max2892.000-2505.000=387.000
mean2.897-2.826=0.071
σ0.014-0.015=-0.001
min2.885-2.813=0.072
max2.917-2.848=0.070
policies=200
mean18132.406-18131.541=0.865
σ0.664-0.518=0.146
min18131.495-18131.154=0.341
max18132.980-18132.290=0.690
mean8400.000
σ0.000
min8400.000
max8400.000
mean2892.000-2505.000=387.000
σ0.000
min2892.000-2505.000=387.000
max2892.000-2505.000=387.000
mean28.807-28.453=0.354
σ0.365-0.115=0.250
min28.408-28.343=0.065
max29.132-28.576=0.556