Compare commits

Home / Compare b23d1ea0 .. 9316a57e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.648-53.915=-0.267
σ0.368-0.368=0.000
min53.517-53.786=-0.269
max54.696-54.962=-0.266
mean414.000-414.400=-0.400
σ0.000-0.516=-0.516
min414.000
max414.000-415.000=-1.000
mean0.139-0.138=0.001
σ0.003-0.004=-0.001
min0.135-0.132=0.003
max0.144-0.145=-0.001
cache=y
dps=1
iters=10
policies=100
mean42.943-43.141=-0.198
σ0.006-0.005=0.001
min42.933-43.134=-0.201
max42.952-43.151=-0.199
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.120-0.120=0.000
σ0.002-0.004=-0.002
min0.119-0.113=0.006
max0.125-0.127=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.868-991.820=0.048
σ1.219-1.255=-0.036
min991.284-991.233=0.051
max996.952-997.093=-0.141
mean1066.100-1062.900=3.200
σ323.037-322.518=0.519
min576.000-566.000=10.000
max1633.000-1637.000=-4.000
mean1.519-1.542=-0.022
σ0.122-0.093=0.029
min1.327-1.405=-0.078
max1.903-1.734=0.169

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.438-285.411=0.027
σ0.009-0.013=-0.004
min285.425-285.392=0.033
max285.448-285.426=0.022
mean1633.000-1637.000=-4.000
σ0.000
min1633.000-1637.000=-4.000
max1633.000-1637.000=-4.000
mean0.376-0.376=0.000
σ0.006-0.007=-0.001
min0.373-0.372=0.000
max0.387-0.388=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1285.489-1285.369=0.120
σ0.081-0.127=-0.046
min1285.353-1285.308=0.045
max1285.548-1285.596=-0.048
mean1633.000-1637.000=-4.000
σ0.000
min1633.000-1637.000=-4.000
max1633.000-1637.000=-4.000
mean1.920-2.064=-0.144
σ0.159-0.205=-0.046
min1.803-1.859=-0.055
max2.192-2.334=-0.142
iters=5
new-facts=6402
prior-facts=1
mean1705.833-1807.750=-101.917
σ6.829-6.993=-0.164
min1702.652-1804.397=-101.745
max1718.046-1820.244=-102.198
mean1633.000-1637.000=-4.000
σ0.000
min1633.000-1637.000=-4.000
max1633.000-1637.000=-4.000
mean3.026-4.283=-1.257
σ0.169-0.175=-0.007
min2.827-4.097=-1.270
max3.230-4.515=-1.285
iters=5
new-facts=6402
prior-facts=6402
mean1968.444-2070.197=-101.753
σ0.022-0.006=0.016
min1968.427-2070.190=-101.764
max1968.475-2070.207=-101.732
mean1904.400-1858.800=45.600
σ225.186-198.345=26.841
min1633.000-1637.000=-4.000
max2183.000-2086.000=97.000
mean3.250-4.662=-1.411
σ0.102-0.134=-0.032
min3.166-4.472=-1.306
max3.367-4.834=-1.467

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.209-1.193=0.017
σ0.335-0.175=0.160
min0.916-1.031=-0.115
max1.775-1.466=0.308

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.780-436.786=-0.006
σ572.362-572.361=0.001
min150.590-150.600=-0.010
max1295.323-1295.327=-0.004
mean90.250
σ8.500
min86.000
max103.000
mean1633.000-1637.000=-4.000
σ0.000
min1633.000-1637.000=-4.000
max1633.000-1637.000=-4.000
mean0.529-0.533=-0.004
σ0.557-0.563=-0.006
min0.248-0.248=0.000
max1.365-1.377=-0.012
policies=20
mean1506.183-1506.268=-0.085
σ0.237-0.234=0.003
min1506.031-1506.116=-0.085
max1506.537-1506.616=-0.080
mean860.000
σ0.000
min860.000
max860.000
mean1633.000-1637.000=-4.000
σ0.000
min1633.000-1637.000=-4.000
max1633.000-1637.000=-4.000
mean2.518-2.510=0.008
σ0.019-0.015=0.004
min2.492-2.495=-0.003
max2.535-2.529=0.005
policies=200
mean15069.438-15070.398=-0.960
σ0.120-0.060=0.060
min15069.284-15070.312=-1.028
max15069.572-15070.447=-0.875
mean8600.000
σ0.000
min8600.000
max8600.000
mean1633.000-1637.000=-4.000
σ0.000
min1633.000-1637.000=-4.000
max1633.000-1637.000=-4.000
mean25.409-25.393=0.016
σ0.095-0.156=-0.061
min25.301-25.237=0.064
max25.519-25.558=-0.039