Compare commits

Home / Compare 5d5b554f .. c1623ac9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.734-70.729=0.006
σ0.045-0.046=-0.002
min70.711-70.699=0.012
max70.860-70.859=0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.175-0.156=0.019
σ0.009-0.006=0.003
min0.153-0.148=0.005
max0.187-0.164=0.023
cache=y
dps=1
iters=10
policies=100
mean21.445-21.446=-0.000
σ0.003-0.002=0.000
min21.441-21.443=-0.002
max21.451-21.451=0.000
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.065-0.065=0.001
σ0.002-0.002=0.001
min0.064-0.063=0.001
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.526-1754.527=-0.001
σ0.362-0.361=0.002
min1753.958-1753.954=0.003
max1755.130-1755.107=0.023
mean1658.250-1669.500=-11.250
σ633.777-653.109=-19.332
min641.000-639.000=2.000
max2849.000-2870.000=-21.000
mean2.760-2.853=-0.093
σ0.216-0.117=0.099
min2.293-2.615=-0.322
max3.045-3.118=-0.073

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.611-273.611=0.000
σ0.011-0.007=0.003
min273.600-273.599=0.001
max273.626-273.617=0.009
mean2849.000-2870.000=-21.000
σ0.000
min2849.000-2870.000=-21.000
max2849.000-2870.000=-21.000
mean0.391-0.388=0.003
σ0.008-0.006=0.002
min0.381-0.382=-0.002
max0.399-0.398=0.001
iters=5
new-facts=1
prior-facts=6402
mean1934.004-1934.003=0.001
σ0.015-0.010=0.006
min1933.994-1933.986=0.008
max1934.031-1934.009=0.021
mean2849.000-2870.000=-21.000
σ0.000
min2849.000-2870.000=-21.000
max2849.000-2870.000=-21.000
mean3.122-2.915=0.207
σ0.262-0.159=0.103
min2.945-2.644=0.300
max3.580-3.063=0.517
iters=5
new-facts=6402
prior-facts=1
mean4754.764-4754.802=-0.038
σ0.842-0.865=-0.022
min4754.295-4754.221=0.074
max4756.264-4756.323=-0.059
mean2849.000-2870.000=-21.000
σ0.000
min2849.000-2870.000=-21.000
max2849.000-2870.000=-21.000
mean8.542-8.461=0.081
σ0.308-0.668=-0.359
min8.124-7.733=0.390
max8.881-9.395=-0.514
iters=5
new-facts=6402
prior-facts=6402
mean4945.158-4765.059=180.099
σ0.165-402.666=-402.501
min4944.866-4044.748=900.118
max4945.256-4945.247=0.008
mean3067.000-3000.200=66.800
σ188.917-202.734=-13.818
min2849.000-2870.000=-21.000
max3331.000-3332.000=-1.000
mean8.553-8.322=0.231
σ0.179-0.582=-0.403
min8.413-7.325=1.088
max8.852-8.855=-0.003

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.045-1.020=0.025
σ0.240-0.135=0.105
min0.936-0.932=0.004
max1.475-1.241=0.234

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.851-472.846=0.004
σ574.941-574.927=0.014
min185.369-185.375=-0.006
max1335.262-1335.237=0.025
mean88.250
σ8.500
min84.000
max101.000
mean2849.000-2870.000=-21.000
σ0.000
min2849.000-2870.000=-21.000
max2849.000-2870.000=-21.000
mean0.489-0.488=0.001
σ0.377-0.375=0.002
min0.298-0.299=-0.001
max1.055-1.051=0.004
policies=20
mean1854.025-1854.024=0.000
σ0.366-0.366=0.001
min1853.738-1853.752=-0.014
max1854.556-1854.557=-0.001
mean840.000
σ0.000
min840.000
max840.000
mean2849.000-2870.000=-21.000
σ0.000
min2849.000-2870.000=-21.000
max2849.000-2870.000=-21.000
mean2.949-2.948=0.001
σ0.004-0.007=-0.003
min2.944-2.941=0.003
max2.953-2.957=-0.004
policies=200
mean18546.843-18546.750=0.092
σ0.460-0.472=-0.013
min18546.526-18546.442=0.083
max18547.521-18547.450=0.071
mean8400.000
σ0.000
min8400.000
max8400.000
mean2849.000-2870.000=-21.000
σ0.000
min2849.000-2870.000=-21.000
max2849.000-2870.000=-21.000
mean29.158-29.147=0.012
σ0.462-0.432=0.030
min28.704-28.793=-0.089
max29.761-29.751=0.010