Compare commits

Home / Compare c588025d .. 445b530e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.045-73.045=0.001
σ0.048-0.046=0.002
min73.016-73.019=-0.003
max73.179-73.175=0.004
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.160-0.161=-0.001
σ0.005-0.003=0.002
min0.152-0.158=-0.006
max0.168-0.166=0.002
cache=y
dps=1
iters=10
policies=100
mean23.739-23.741=-0.001
σ0.002-0.003=-0.001
min23.737-23.736=0.001
max23.744-23.746=-0.002
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.066-0.067=-0.000
σ0.002-0.003=-0.000
min0.064-0.065=-0.000
max0.073-0.074=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.788-1758.786=0.002
σ0.361-0.360=0.001
min1758.211-1758.214=-0.003
max1759.356-1759.357=-0.001
mean1627.550-1659.050=-31.500
σ599.499-631.191=-31.693
min649.000-617.000=32.000
max2431.000-2853.000=-422.000
mean2.835-2.812=0.024
σ0.134-0.155=-0.021
min2.577-2.376=0.201
max3.146-2.990=0.156

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.014-324.029=-0.015
σ0.061-0.028=0.033
min323.906-323.981=-0.075
max324.047-324.050=-0.003
mean2431.000-2853.000=-422.000
σ0.000
min2431.000-2853.000=-422.000
max2431.000-2853.000=-422.000
mean0.432-0.431=0.001
σ0.005-0.005=-0.000
min0.427-0.426=0.001
max0.439-0.437=0.002
iters=5
new-facts=1
prior-facts=6402
mean1984.589-1984.598=-0.010
σ0.020-0.006=0.014
min1984.555-1984.590=-0.035
max1984.606-1984.606=-0.000
mean2431.000-2853.000=-422.000
σ0.000
min2431.000-2853.000=-422.000
max2431.000-2853.000=-422.000
mean2.653-2.620=0.033
σ0.178-0.143=0.035
min2.488-2.462=0.025
max2.938-2.844=0.094
iters=5
new-facts=6402
prior-facts=1
mean4808.229-4808.108=0.121
σ7.837-7.556=0.281
min4804.680-4804.685=-0.005
max4822.248-4821.624=0.624
mean2431.000-2853.000=-422.000
σ0.000
min2431.000-2853.000=-422.000
max2431.000-2853.000=-422.000
mean8.904-8.979=-0.075
σ0.269-0.113=0.156
min8.644-8.841=-0.197
max9.216-9.144=0.072
iters=5
new-facts=6402
prior-facts=6402
mean4995.804-4995.736=0.067
σ0.022-0.147=-0.125
min4995.780-4995.474=0.306
max4995.832-4995.816=0.016
mean2966.400-3040.000=-73.600
σ256.778-196.019=60.759
min2639.000-2853.000=-214.000
max3310.000-3322.000=-12.000
mean8.578-8.716=-0.138
σ0.067-0.244=-0.177
min8.469-8.476=-0.006
max8.645-9.089=-0.444

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.754-0.986=0.768
σ0.191-0.141=0.050
min1.449-0.918=0.532
max1.974-1.238=0.736

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.321-468.346=-0.025
σ574.226-574.232=-0.007
min181.206-181.227=-0.021
max1329.660-1329.695=-0.035
mean88.250
σ8.500
min84.000
max101.000
mean2431.000-2853.000=-422.000
σ0.000
min2431.000-2853.000=-422.000
max2431.000-2853.000=-422.000
mean0.581-0.442=0.139
σ0.596-0.301=0.295
min0.280-0.288=-0.008
max1.476-0.894=0.581
policies=20
mean1812.435-1812.623=-0.188
σ0.389-0.399=-0.010
min1812.175-1812.341=-0.166
max1813.010-1813.208=-0.198
mean840.000
σ0.000
min840.000
max840.000
mean2431.000-2853.000=-422.000
σ0.000
min2431.000-2853.000=-422.000
max2431.000-2853.000=-422.000
mean2.823-2.901=-0.078
σ0.051-0.010=0.041
min2.788-2.891=-0.103
max2.899-2.915=-0.016
policies=200
mean18131.620-18132.558=-0.938
σ0.454-0.636=-0.182
min18131.268-18131.736=-0.469
max18132.282-18133.114=-0.832
mean8400.000
σ0.000
min8400.000
max8400.000
mean2431.000-2853.000=-422.000
σ0.000
min2431.000-2853.000=-422.000
max2431.000-2853.000=-422.000
mean28.396-28.840=-0.443
σ0.050-0.362=-0.312
min28.364-28.388=-0.024
max28.470-29.139=-0.669