Compare commits

Home / Compare 2964eee0 .. 742b4444

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.793-35.792=0.001
σ0.106-0.107=-0.001
min35.748-35.744=0.004
max36.093-36.095=-0.002
mean415.000-412.800=2.200
σ0.000-0.632=-0.632
min415.000-411.000=4.000
max415.000-413.000=2.000
mean0.076-0.076=0.001
σ0.004-0.003=0.001
min0.073-0.074=-0.001
max0.083-0.081=0.002
cache=y
dps=1
iters=10
policies=100
mean26.065-26.065=0.000
σ0.006-0.004=0.001
min26.059-26.058=0.001
max26.076-26.070=0.007
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.061-0.061=0.000
σ0.003-0.002=0.001
min0.059-0.060=-0.000
max0.069-0.066=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.889-1752.886=0.003
σ0.362-0.364=-0.001
min1752.322-1752.317=0.005
max1753.474-1753.481=-0.008
mean1655.650-1663.200=-7.550
σ643.318-622.655=20.664
min621.000-666.000=-45.000
max2785.000-2650.000=135.000
mean2.858-2.729=0.129
σ0.189-0.204=-0.015
min2.289-2.285=0.004
max3.193-3.041=0.152

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.192-277.194=-0.002
σ0.010-0.006=0.004
min277.180-277.188=-0.008
max277.202-277.201=0.001
mean2785.000-2650.000=135.000
σ0.000
min2785.000-2650.000=135.000
max2785.000-2650.000=135.000
mean0.396-0.404=-0.008
σ0.009-0.001=0.007
min0.391-0.403=-0.012
max0.411-0.406=0.005
iters=5
new-facts=1
prior-facts=6402
mean2169.700-2169.675=0.025
σ0.013-0.043=-0.030
min2169.691-2169.598=0.093
max2169.722-2169.702=0.020
mean2785.000-2650.000=135.000
σ0.000
min2785.000-2650.000=135.000
max2785.000-2650.000=135.000
mean3.044-2.999=0.045
σ0.169-0.166=0.002
min2.781-2.781=0.000
max3.183-3.158=0.024
iters=5
new-facts=6402
prior-facts=1
mean5049.492-5049.563=-0.071
σ1.036-1.010=0.026
min5048.709-5049.014=-0.305
max5051.309-5051.362=-0.052
mean2785.000-2650.000=135.000
σ0.000
min2785.000-2650.000=135.000
max2785.000-2650.000=135.000
mean8.960-9.032=-0.071
σ0.662-0.610=0.052
min8.180-8.135=0.045
max9.654-9.790=-0.136
iters=5
new-facts=6402
prior-facts=6402
mean5180.660-5180.595=0.065
σ0.084-0.120=-0.036
min5180.594-5180.417=0.177
max5180.755-5180.754=0.001
mean3243.000-3272.600=-29.600
σ354.680-435.636=-80.955
min2785.000-2669.000=116.000
max3711.000-3676.000=35.000
mean8.982-9.077=-0.095
σ0.414-0.419=-0.004
min8.705-8.813=-0.108
max9.706-9.820=-0.114

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.087-1.289=-0.202
σ0.114-0.376=-0.262
min0.947-0.947=0.001
max1.264-1.802=-0.538

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.860-464.857=0.003
σ572.658-572.654=0.004
min178.520-178.528=-0.007
max1323.847-1323.839=0.009
mean79.500
σ7.000
min76.000
max90.000
mean2785.000-2650.000=135.000
σ0.000
min2785.000-2650.000=135.000
max2785.000-2650.000=135.000
mean0.481-0.525=-0.043
σ0.295-0.482=-0.187
min0.280-0.280=0.000
max0.905-1.248=-0.343
policies=20
mean1785.476-1785.477=-0.002
σ0.321-0.341=-0.020
min1785.223-1785.254=-0.031
max1785.944-1785.984=-0.041
mean760.000
σ0.000
min760.000
max760.000
mean2785.000-2650.000=135.000
σ0.000
min2785.000-2650.000=135.000
max2785.000-2650.000=135.000
mean2.801-2.795=0.006
σ0.010-0.036=-0.026
min2.788-2.757=0.031
max2.810-2.844=-0.034
policies=200
mean17861.491-17861.542=-0.052
σ0.565-0.489=0.076
min17861.164-17861.293=-0.129
max17862.335-17862.276=0.060
mean7600.000
σ0.000
min7600.000
max7600.000
mean2785.000-2650.000=135.000
σ0.000
min2785.000-2650.000=135.000
max2785.000-2650.000=135.000
mean28.338-28.276=0.062
σ0.239-0.162=0.077
min28.127-28.084=0.043
max28.660-28.419=0.241