Compare commits

Home / Compare 3b09de87 .. b9b2af76

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.734-70.731=0.004
σ0.055-0.053=0.002
min70.701-70.699=0.001
max70.888-70.879=0.009
mean413.900-418.000=-4.100
σ0.316-0.000=0.316
min413.000-418.000=-5.000
max414.000-418.000=-4.000
mean0.169-0.154=0.015
σ0.012-0.005=0.008
min0.151-0.150=0.002
max0.187-0.162=0.025
cache=y
dps=1
iters=10
policies=100
mean21.446-21.446=-0.000
σ0.002-0.002=-0.000
min21.441-21.443=-0.002
max21.448-21.450=-0.001
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.065-0.066=-0.001
σ0.003-0.003=0.001
min0.061-0.064=-0.003
max0.073-0.073=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.604-1755.601=0.003
σ0.361-0.359=0.002
min1755.027-1755.031=-0.004
max1756.185-1756.174=0.011
mean1650.450-1641.300=9.150
σ651.693-602.070=49.624
min628.000-653.000=-25.000
max2750.000-2447.000=303.000
mean2.853-2.785=0.069
σ0.160-0.207=-0.047
min2.471-2.230=0.241
max3.061-3.112=-0.052

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean274.690-274.688=0.002
σ0.004-0.011=-0.007
min274.686-274.675=0.010
max274.696-274.705=-0.009
mean2750.000-2447.000=303.000
σ0.000
min2750.000-2447.000=303.000
max2750.000-2447.000=303.000
mean0.385-0.393=-0.008
σ0.001-0.011=-0.010
min0.384-0.383=0.001
max0.387-0.407=-0.020
iters=5
new-facts=1
prior-facts=6402
mean1935.087-1935.090=-0.004
σ0.017-0.009=0.008
min1935.065-1935.076=-0.010
max1935.111-1935.098=0.012
mean2750.000-2447.000=303.000
σ0.000
min2750.000-2447.000=303.000
max2750.000-2447.000=303.000
mean3.098-2.901=0.198
σ0.337-0.167=0.170
min2.733-2.710=0.023
max3.607-3.122=0.485
iters=5
new-facts=6402
prior-facts=1
mean4755.835-4755.902=-0.067
σ0.860-0.838=0.022
min4755.374-4755.460=-0.086
max4757.371-4757.398=-0.027
mean2750.000-2447.000=303.000
σ0.000
min2750.000-2447.000=303.000
max2750.000-2447.000=303.000
mean8.526-8.269=0.258
σ0.303-0.276=0.027
min8.070-7.968=0.102
max8.912-8.570=0.342
iters=5
new-facts=6402
prior-facts=6402
mean4946.302-4946.299=0.004
σ0.019-0.025=-0.006
min4946.286-4946.267=0.019
max4946.328-4946.334=-0.005
mean3046.600-2966.400=80.200
σ217.245-448.337=-231.092
min2750.000-2473.000=277.000
max3321.000-3570.000=-249.000
mean8.573-8.593=-0.020
σ0.131-0.216=-0.085
min8.400-8.402=-0.003
max8.690-8.919=-0.230

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.050-1.800=-0.750
σ0.131-0.032=0.099
min0.935-1.758=-0.823
max1.254-1.845=-0.591

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean474.997-474.985=0.012
σ574.936-574.924=0.012
min187.520-187.517=0.003
max1337.400-1337.371=0.030
mean90.250
σ8.500
min86.000
max103.000
mean2750.000-2447.000=303.000
σ0.000
min2750.000-2447.000=303.000
max2750.000-2447.000=303.000
mean0.568-0.571=-0.003
σ0.546-0.556=-0.010
min0.292-0.291=0.001
max1.387-1.405=-0.019
policies=20
mean1875.533-1875.501=0.032
σ0.392-0.392=0.000
min1875.256-1875.224=0.032
max1876.108-1876.076=0.032
mean860.000
σ0.000
min860.000
max860.000
mean2750.000-2447.000=303.000
σ0.000
min2750.000-2447.000=303.000
max2750.000-2447.000=303.000
mean2.920-2.911=0.010
σ0.020-0.009=0.011
min2.900-2.902=-0.001
max2.948-2.923=0.025
policies=200
mean18762.195-18762.186=0.009
σ0.491-0.487=0.004
min18761.900-18761.835=0.065
max18762.928-18762.906=0.022
mean8600.000
σ0.000
min8600.000
max8600.000
mean2750.000-2447.000=303.000
σ0.000
min2750.000-2447.000=303.000
max2750.000-2447.000=303.000
mean29.388-29.333=0.055
σ0.039-0.164=-0.125
min29.337-29.182=0.155
max29.430-29.558=-0.128