Compare commits

Home / Compare f83a9fb8 .. 8e1977a3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.046-73.046=0.000
σ0.046-0.049=-0.003
min73.021-73.022=-0.001
max73.176-73.186=-0.009
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.161-0.162=-0.001
σ0.003-0.003=-0.000
min0.158-0.156=0.001
max0.167-0.168=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.740-23.739=0.001
σ0.004-0.003=0.001
min23.736-23.736=0.001
max23.748-23.744=0.004
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.065-0.060=0.005
σ0.003-0.001=0.002
min0.061-0.059=0.002
max0.073-0.061=0.012

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.787-1758.788=-0.001
σ0.362-0.360=0.002
min1758.212-1758.215=-0.003
max1759.385-1759.369=0.016
mean1660.850-1659.050=1.800
σ623.111-624.226=-1.115
min678.000-625.000=53.000
max2710.000-2514.000=196.000
mean2.760-2.827=-0.067
σ0.187-0.130=0.058
min2.326-2.414=-0.088
max3.004-3.008=-0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.011-324.025=-0.014
σ0.052-0.036=0.017
min323.917-323.962=-0.045
max324.040-324.047=-0.007
mean2710.000-2514.000=196.000
σ0.000
min2710.000-2514.000=196.000
max2710.000-2514.000=196.000
mean0.427-0.428=-0.001
σ0.002-0.002=-0.001
min0.426-0.425=0.000
max0.429-0.431=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1984.589-1984.582=0.007
σ0.018-0.017=0.001
min1984.557-1984.558=-0.001
max1984.603-1984.600=0.003
mean2710.000-2514.000=196.000
σ0.000
min2710.000-2514.000=196.000
max2710.000-2514.000=196.000
mean2.652-2.596=0.056
σ0.141-0.053=0.088
min2.544-2.550=-0.005
max2.895-2.681=0.213
iters=5
new-facts=6402
prior-facts=1
mean4808.152-4808.235=-0.083
σ7.784-7.777=0.007
min4804.234-4804.693=-0.459
max4822.068-4822.146=-0.078
mean2710.000-2514.000=196.000
σ0.000
min2710.000-2514.000=196.000
max2710.000-2514.000=196.000
mean8.524-8.802=-0.278
σ0.302-0.139=0.163
min8.136-8.648=-0.512
max8.874-8.956=-0.082
iters=5
new-facts=6402
prior-facts=6402
mean4995.808-4995.799=0.009
σ0.017-0.021=-0.005
min4995.789-4995.770=0.018
max4995.832-4995.820=0.012
mean3009.200-2987.800=21.400
σ254.332-275.539=-21.207
min2710.000-2603.000=107.000
max3330.000-3290.000=40.000
mean8.821-8.698=0.123
σ0.367-0.169=0.198
min8.481-8.467=0.014
max9.434-8.878=0.555

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.010-1.679=-0.669
σ0.134-0.204=-0.070
min0.921-1.353=-0.432
max1.228-1.846=-0.618

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.335-468.325=0.010
σ574.243-574.232=0.011
min181.212-181.203=0.009
max1329.700-1329.673=0.027
mean88.250
σ8.500
min84.000
max101.000
mean2710.000-2514.000=196.000
σ0.000
min2710.000-2514.000=196.000
max2710.000-2514.000=196.000
mean0.571-0.566=0.005
σ0.575-0.566=0.009
min0.282-0.280=0.002
max1.434-1.416=0.018
policies=20
mean1812.429-1812.401=0.028
σ0.395-0.387=0.007
min1812.167-1812.145=0.022
max1813.014-1812.974=0.040
mean840.000
σ0.000
min840.000
max840.000
mean2710.000-2514.000=196.000
σ0.000
min2710.000-2514.000=196.000
max2710.000-2514.000=196.000
mean2.819-2.813=0.005
σ0.023-0.019=0.004
min2.794-2.800=-0.006
max2.842-2.840=0.002
policies=200
mean18131.662-18131.561=0.101
σ0.515-0.505=0.010
min18131.325-18131.133=0.192
max18132.430-18132.290=0.140
mean8400.000
σ0.000
min8400.000
max8400.000
mean2710.000-2514.000=196.000
σ0.000
min2710.000-2514.000=196.000
max2710.000-2514.000=196.000
mean28.459-28.345=0.115
σ0.376-0.097=0.279
min28.220-28.277=-0.057
max29.017-28.484=0.533