Compare commits

Home / Compare 123d5224 .. e9bef6d3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-70.374=-0.000
σ0.060-0.057=0.003
min70.334-70.336=-0.002
max70.541-70.531=0.010
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.154-0.159=-0.004
σ0.006-0.003=0.002
min0.146-0.155=-0.008
max0.161-0.163=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.143-21.142=0.000
σ0.003-0.002=0.001
min21.139-21.140=-0.001
max21.150-21.146=0.004
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.063-0.059=0.004
σ0.003-0.003=0.000
min0.059-0.058=0.001
max0.071-0.067=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.199-1752.199=0.000
σ0.364-0.361=0.004
min1751.639-1751.625=0.014
max1752.784-1752.769=0.015
mean1659.700-1656.100=3.600
σ626.152-647.608=-21.455
min658.000-646.000=12.000
max2511.000-2852.000=-341.000
mean2.809-2.837=-0.028
σ0.127-0.074=0.053
min2.372-2.695=-0.323
max2.990-3.003=-0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.933-269.934=-0.001
σ0.008-0.010=-0.002
min269.922-269.922=0.001
max269.942-269.945=-0.003
mean2511.000-2852.000=-341.000
σ0.000
min2511.000-2852.000=-341.000
max2511.000-2852.000=-341.000
mean0.370-0.373=-0.003
σ0.006-0.008=-0.002
min0.367-0.368=-0.001
max0.381-0.387=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1930.392-1930.380=0.012
σ0.022-0.020=0.002
min1930.354-1930.357=-0.003
max1930.409-1930.400=0.009
mean2511.000-2852.000=-341.000
σ0.000
min2511.000-2852.000=-341.000
max2511.000-2852.000=-341.000
mean2.507-2.567=-0.060
σ0.144-0.156=-0.012
min2.358-2.451=-0.093
max2.739-2.827=-0.088
iters=5
new-facts=6402
prior-facts=1
mean4750.750-4750.857=-0.107
σ0.868-0.822=0.046
min4750.066-4750.294=-0.228
max4752.266-4752.309=-0.043
mean2511.000-2852.000=-341.000
σ0.000
min2511.000-2852.000=-341.000
max2511.000-2852.000=-341.000
mean8.485-8.627=-0.143
σ0.151-0.277=-0.125
min8.272-8.372=-0.100
max8.683-9.076=-0.393
iters=5
new-facts=6402
prior-facts=6402
mean4941.330-4941.332=-0.002
σ0.093-0.084=0.008
min4941.252-4941.263=-0.011
max4941.434-4941.425=0.008
mean2995.800-3029.000=-33.200
σ287.341-199.111=88.230
min2608.000-2852.000=-244.000
max3333.000-3337.000=-4.000
mean8.548-8.457=0.091
σ0.153-0.092=0.061
min8.401-8.383=0.018
max8.769-8.595=0.174

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.652-1.053=0.599
σ0.161-0.131=0.029
min1.383-0.938=0.446
max1.765-1.259=0.506

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.908-465.912=-0.003
σ575.762-575.756=0.006
min178.024-178.027=-0.003
max1329.552-1329.546=0.006
mean81.750
σ7.500
min78.000
max93.000
mean2511.000-2852.000=-341.000
σ0.000
min2511.000-2852.000=-341.000
max2511.000-2852.000=-341.000
mean0.540-0.438=0.103
σ0.524-0.306=0.218
min0.276-0.265=0.012
max1.327-0.896=0.430
policies=20
mean1780.470-1780.494=-0.024
σ0.353-0.354=-0.001
min1780.235-1780.239=-0.004
max1780.994-1781.015=-0.021
mean780.000
σ0.000
min780.000
max780.000
mean2511.000-2852.000=-341.000
σ0.000
min2511.000-2852.000=-341.000
max2511.000-2852.000=-341.000
mean2.739-2.845=-0.107
σ0.009-0.018=-0.009
min2.725-2.827=-0.103
max2.745-2.871=-0.126
policies=200
mean17811.407-17811.259=0.149
σ0.606-0.528=0.077
min17811.036-17810.816=0.221
max17812.312-17812.013=0.299
mean7800.000
σ0.000
min7800.000
max7800.000
mean2511.000-2852.000=-341.000
σ0.000
min2511.000-2852.000=-341.000
max2511.000-2852.000=-341.000
mean27.736-28.315=-0.580
σ0.113-0.461=-0.348
min27.630-27.746=-0.116
max27.896-28.691=-0.795