Compare commits

Home / Compare 4b92d31d .. d9b7cb19

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.702-70.701=0.001
σ0.045-0.048=-0.003
min70.672-70.663=0.010
max70.827-70.831=-0.004
mean411.800-415.000=-3.200
σ0.422-0.000=0.422
min411.000-415.000=-4.000
max412.000-415.000=-3.000
mean0.160-0.158=0.002
σ0.005-0.003=0.002
min0.155-0.152=0.002
max0.173-0.166=0.008
cache=y
dps=1
iters=10
policies=100
mean21.409-21.407=0.002
σ0.001-0.002=-0.000
min21.406-21.405=0.002
max21.412-21.410=0.002
mean412.000-415.500=-3.500
σ0.000-0.527=-0.527
min412.000-415.000=-3.000
max412.000-416.000=-4.000
mean0.065-0.062=0.003
σ0.003-0.004=-0.001
min0.064-0.058=0.005
max0.073-0.069=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.898-1754.897=0.000
σ0.362-0.361=0.001
min1754.328-1754.338=-0.011
max1755.496-1755.488=0.008
mean1645.700-1631.700=14.000
σ633.557-607.970=25.587
min619.000-633.000=-14.000
max2771.000-2447.000=324.000
mean2.853-2.817=0.037
σ0.146-0.134=0.011
min2.536-2.439=0.097
max3.184-2.991=0.193

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.760-272.756=0.004
σ0.008-0.007=0.001
min272.751-272.748=0.003
max272.769-272.767=0.002
mean2771.000-2447.000=324.000
σ0.000
min2771.000-2447.000=324.000
max2771.000-2447.000=324.000
mean0.385-0.392=-0.007
σ0.007-0.009=-0.002
min0.381-0.383=-0.002
max0.399-0.402=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1933.131-1933.132=-0.002
σ0.015-0.014=0.001
min1933.112-1933.117=-0.006
max1933.153-1933.148=0.005
mean2771.000-2447.000=324.000
σ0.000
min2771.000-2447.000=324.000
max2771.000-2447.000=324.000
mean3.063-2.991=0.072
σ0.045-0.145=-0.100
min3.019-2.765=0.254
max3.128-3.168=-0.039
iters=5
new-facts=6402
prior-facts=1
mean4753.837-4753.926=-0.089
σ0.976-1.012=-0.036
min4753.099-4753.331=-0.233
max4755.545-4755.731=-0.186
mean2771.000-2447.000=324.000
σ0.000
min2771.000-2447.000=324.000
max2771.000-2447.000=324.000
mean8.455-8.687=-0.233
σ0.592-0.733=-0.140
min7.745-7.850=-0.106
max9.097-9.872=-0.774
iters=5
new-facts=6402
prior-facts=6402
mean4944.361-4944.291=0.070
σ0.022-0.147=-0.126
min4944.336-4944.030=0.306
max4944.385-4944.385=0.000
mean3015.800-2919.600=96.200
σ284.334-384.168=-99.834
min2771.000-2447.000=324.000
max3423.000-3440.000=-17.000
mean8.451-8.398=0.053
σ0.093-0.021=0.072
min8.378-8.383=-0.004
max8.613-8.435=0.177

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.111-1.821=-0.711
σ0.129-0.126=0.003
min0.995-1.634=-0.639
max1.309-1.984=-0.675

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean469.028-468.999=0.029
σ575.628-575.613=0.016
min181.205-181.187=0.018
max1332.470-1332.418=0.052
mean88.250
σ8.500
min84.000
max101.000
mean2771.000-2447.000=324.000
σ0.000
min2771.000-2447.000=324.000
max2771.000-2447.000=324.000
mean0.453-0.555=-0.102
σ0.318-0.524=-0.205
min0.293-0.288=0.005
max0.931-1.341=-0.410
policies=20
mean1812.290-1812.206=0.084
σ0.360-0.386=-0.026
min1812.072-1811.942=0.130
max1812.827-1812.774=0.053
mean840.000
σ0.000
min840.000
max840.000
mean2771.000-2447.000=324.000
σ0.000
min2771.000-2447.000=324.000
max2771.000-2447.000=324.000
mean2.925-2.872=0.054
σ0.094-0.035=0.058
min2.832-2.848=-0.016
max3.052-2.924=0.128
policies=200
mean18129.201-18129.224=-0.023
σ0.454-0.457=-0.003
min18128.930-18128.943=-0.012
max18129.877-18129.907=-0.030
mean8400.000
σ0.000
min8400.000
max8400.000
mean2771.000-2447.000=324.000
σ0.000
min2771.000-2447.000=324.000
max2771.000-2447.000=324.000
mean28.595-28.740=-0.145
σ0.075-0.160=-0.085
min28.511-28.620=-0.109
max28.693-28.974=-0.281