Compare commits

Home / Compare 8a376aa7 .. 988d69eb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.047-73.047=-0.001
σ0.047-0.048=-0.001
min73.017-73.023=-0.005
max73.180-73.183=-0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.157-0.162=-0.004
σ0.005-0.003=0.002
min0.150-0.158=-0.009
max0.166-0.167=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.740-23.740=0.001
σ0.002-0.004=-0.001
min23.736-23.735=0.001
max23.745-23.746=-0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.065=0.000
σ0.001-0.003=-0.003
min0.064-0.061=0.003
max0.066-0.071=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.787-1758.790=-0.003
σ0.361-0.363=-0.003
min1758.211-1758.218=-0.007
max1759.372-1759.388=-0.017
mean1647.300-1623.200=24.100
σ614.240-591.828=22.413
min624.000-632.000=-8.000
max2486.000-2411.000=75.000
mean2.741-2.846=-0.105
σ0.227-0.175=0.051
min2.153-2.176=-0.023
max2.965-3.004=-0.038

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.012-324.011=0.000
σ0.059-0.054=0.005
min323.906-323.916=-0.009
max324.043-324.042=0.000
mean2486.000-2411.000=75.000
σ0.000
min2486.000-2411.000=75.000
max2486.000-2411.000=75.000
mean0.430-0.429=0.001
σ0.006-0.005=0.001
min0.427-0.426=0.001
max0.440-0.437=0.003
iters=5
new-facts=1
prior-facts=6402
mean1984.595-1984.584=0.012
σ0.013-0.025=-0.013
min1984.575-1984.546=0.029
max1984.606-1984.605=0.001
mean2486.000-2411.000=75.000
σ0.000
min2486.000-2411.000=75.000
max2486.000-2411.000=75.000
mean2.583-2.597=-0.014
σ0.067-0.079=-0.012
min2.486-2.499=-0.014
max2.647-2.712=-0.065
iters=5
new-facts=6402
prior-facts=1
mean4808.247-4808.248=-0.001
σ7.743-7.788=-0.045
min4804.708-4804.683=0.024
max4822.099-4822.180=-0.081
mean2486.000-2411.000=75.000
σ0.000
min2486.000-2411.000=75.000
max2486.000-2411.000=75.000
mean8.799-8.857=-0.058
σ0.273-0.223=0.050
min8.419-8.485=-0.066
max9.038-9.078=-0.041
iters=5
new-facts=6402
prior-facts=6402
mean4995.731-4995.670=0.061
σ0.159-0.328=-0.169
min4995.450-4995.085=0.365
max4995.824-4995.833=-0.009
mean2985.400-2968.800=16.600
σ416.899-249.094=167.805
min2486.000-2651.000=-165.000
max3494.000-3305.000=189.000
mean8.576-8.755=-0.179
σ0.171-0.315=-0.143
min8.393-8.571=-0.178
max8.811-9.310=-0.499

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.705-1.550=0.155
σ0.167-0.128=0.039
min1.423-1.450=-0.026
max1.854-1.740=0.114

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.328-468.330=-0.002
σ574.232-574.234=-0.002
min181.207-181.206=0.001
max1329.676-1329.681=-0.005
mean88.250
σ8.500
min84.000
max101.000
mean2486.000-2411.000=75.000
σ0.000
min2486.000-2411.000=75.000
max2486.000-2411.000=75.000
mean0.579-0.558=0.021
σ0.583-0.545=0.037
min0.287-0.283=0.004
max1.453-1.376=0.077
policies=20
mean1812.429-1812.431=-0.002
σ0.389-0.388=0.002
min1812.177-1812.162=0.015
max1813.006-1813.003=0.003
mean840.000
σ0.000
min840.000
max840.000
mean2486.000-2411.000=75.000
σ0.000
min2486.000-2411.000=75.000
max2486.000-2411.000=75.000
mean2.803-2.814=-0.012
σ0.015-0.013=0.002
min2.781-2.804=-0.023
max2.817-2.831=-0.015
policies=200
mean18131.696-18131.551=0.145
σ0.452-0.401=0.050
min18131.429-18131.190=0.238
max18132.369-18132.126=0.244
mean8400.000
σ0.000
min8400.000
max8400.000
mean2486.000-2411.000=75.000
σ0.000
min2486.000-2411.000=75.000
max2486.000-2411.000=75.000
mean28.338-28.403=-0.064
σ0.123-0.071=0.052
min28.221-28.318=-0.097
max28.447-28.478=-0.031