Compare commits

Home / Compare c524f56d .. e49997e2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.047-73.047=0.000
σ0.049-0.047=0.001
min73.020-73.017=0.003
max73.184-73.180=0.004
mean414.000
σ0.000
min414.000
max414.000
mean0.161-0.157=0.003
σ0.005-0.005=-0.000
min0.157-0.150=0.007
max0.169-0.166=0.002
cache=y
dps=1
iters=10
policies=100
mean23.741-23.740=0.000
σ0.002-0.002=-0.001
min23.738-23.736=0.002
max23.744-23.745=-0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.065=0.000
σ0.003-0.001=0.002
min0.060-0.064=-0.004
max0.071-0.066=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.786-1758.787=-0.001
σ0.363-0.361=0.002
min1758.215-1758.211=0.004
max1759.366-1759.372=-0.006
mean1627.100-1647.300=-20.200
σ599.410-614.240=-14.830
min648.000-624.000=24.000
max2430.000-2486.000=-56.000
mean2.833-2.741=0.092
σ0.193-0.227=-0.034
min2.384-2.153=0.231
max3.187-2.965=0.222

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.031-324.012=0.019
σ0.022-0.059=-0.037
min323.995-323.906=0.088
max324.048-324.043=0.005
mean2430.000-2486.000=-56.000
σ0.000
min2430.000-2486.000=-56.000
max2430.000-2486.000=-56.000
mean0.426-0.430=-0.004
σ0.002-0.006=-0.004
min0.424-0.427=-0.002
max0.429-0.440=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1984.591-1984.595=-0.005
σ0.012-0.013=-0.000
min1984.576-1984.575=0.001
max1984.605-1984.606=-0.001
mean2430.000-2486.000=-56.000
σ0.000
min2430.000-2486.000=-56.000
max2430.000-2486.000=-56.000
mean2.628-2.583=0.045
σ0.114-0.067=0.047
min2.481-2.486=-0.005
max2.792-2.647=0.145
iters=5
new-facts=6402
prior-facts=1
mean4808.235-4808.247=-0.012
σ7.741-7.743=-0.003
min4804.669-4804.708=-0.039
max4822.081-4822.099=-0.018
mean2430.000-2486.000=-56.000
σ0.000
min2430.000-2486.000=-56.000
max2430.000-2486.000=-56.000
mean8.778-8.799=-0.021
σ0.246-0.273=-0.028
min8.460-8.419=0.040
max9.067-9.038=0.029
iters=5
new-facts=6402
prior-facts=6402
mean4995.804-4995.731=0.073
σ0.037-0.159=-0.121
min4995.754-4995.450=0.303
max4995.846-4995.824=0.022
mean2922.600-2985.400=-62.800
σ394.236-416.899=-22.663
min2430.000-2486.000=-56.000
max3437.000-3494.000=-57.000
mean8.576-8.576=0.000
σ0.148-0.171=-0.023
min8.461-8.393=0.068
max8.809-8.811=-0.002

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.670-1.705=-0.036
σ0.103-0.167=-0.064
min1.498-1.423=0.074
max1.757-1.854=-0.097

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.327-468.328=-0.002
σ574.231-574.232=-0.001
min181.206-181.207=-0.001
max1329.672-1329.676=-0.003
mean88.250
σ8.500
min84.000
max101.000
mean2430.000-2486.000=-56.000
σ0.000
min2430.000-2486.000=-56.000
max2430.000-2486.000=-56.000
mean0.558-0.579=-0.021
σ0.546-0.583=-0.036
min0.283-0.287=-0.004
max1.377-1.453=-0.076
policies=20
mean1812.432-1812.429=0.003
σ0.386-0.389=-0.004
min1812.166-1812.177=-0.010
max1813.001-1813.006=-0.005
mean840.000
σ0.000
min840.000
max840.000
mean2430.000-2486.000=-56.000
σ0.000
min2430.000-2486.000=-56.000
max2430.000-2486.000=-56.000
mean2.821-2.803=0.018
σ0.030-0.015=0.014
min2.801-2.781=0.021
max2.865-2.817=0.048
policies=200
mean18131.693-18131.696=-0.003
σ0.448-0.452=-0.003
min18131.380-18131.429=-0.049
max18132.358-18132.369=-0.011
mean8400.000
σ0.000
min8400.000
max8400.000
mean2430.000-2486.000=-56.000
σ0.000
min2430.000-2486.000=-56.000
max2430.000-2486.000=-56.000
mean28.357-28.338=0.018
σ0.068-0.123=-0.055
min28.269-28.221=0.048
max28.425-28.447=-0.022