Compare commits

Home / Compare 2ab5e071 .. 6ca489ce

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.045-73.048=-0.003
σ0.046-0.046=0.001
min73.021-73.026=-0.005
max73.175-73.177=-0.001
mean413.000-420.000=-7.000
σ0.000
min413.000-420.000=-7.000
max413.000-420.000=-7.000
mean0.159-0.168=-0.008
σ0.004-0.014=-0.009
min0.153-0.153=-0.000
max0.166-0.184=-0.018
cache=y
dps=1
iters=10
policies=100
mean23.741-23.739=0.001
σ0.003-0.003=-0.000
min23.735-23.735=0.001
max23.745-23.745=-0.000
mean413.000-420.500=-7.500
σ0.000-0.527=-0.527
min413.000-420.000=-7.000
max413.000-421.000=-8.000
mean0.066-0.066=-0.000
σ0.003-0.001=0.003
min0.060-0.065=-0.005
max0.073-0.067=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.788-1758.788=-0.000
σ0.362-0.361=0.001
min1758.218-1758.218=0.000
max1759.370-1759.371=-0.001
mean1619.650-1639.400=-19.750
σ594.528-611.098=-16.570
min629.000-655.000=-26.000
max2409.000-2447.000=-38.000
mean2.807-2.804=0.004
σ0.164-0.190=-0.026
min2.303-2.260=0.043
max3.016-3.194=-0.178

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.012-324.014=-0.002
σ0.054-0.053=0.001
min323.915-323.920=-0.005
max324.040-324.046=-0.006
mean2409.000-2447.000=-38.000
σ0.000
min2409.000-2447.000=-38.000
max2409.000-2447.000=-38.000
mean0.429-0.431=-0.003
σ0.004-0.009=-0.005
min0.425-0.426=-0.000
max0.436-0.448=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1984.582-1984.586=-0.004
σ0.020-0.025=-0.005
min1984.560-1984.551=0.009
max1984.601-1984.610=-0.009
mean2409.000-2447.000=-38.000
σ0.000
min2409.000-2447.000=-38.000
max2409.000-2447.000=-38.000
mean2.592-2.613=-0.021
σ0.049-0.062=-0.013
min2.560-2.565=-0.004
max2.675-2.718=-0.043
iters=5
new-facts=6402
prior-facts=1
mean4808.253-4808.243=0.010
σ7.847-7.821=0.025
min4804.687-4804.699=-0.011
max4822.290-4822.234=0.056
mean2409.000-2447.000=-38.000
σ0.000
min2409.000-2447.000=-38.000
max2409.000-2447.000=-38.000
mean8.942-9.007=-0.064
σ0.302-0.176=0.127
min8.542-8.770=-0.227
max9.326-9.190=0.136
iters=5
new-facts=6402
prior-facts=6402
mean4995.806-4995.807=-0.001
σ0.020-0.028=-0.008
min4995.780-4995.776=0.005
max4995.825-4995.832=-0.007
mean2968.800-2965.000=3.800
σ263.383-254.861=8.522
min2634.000-2640.000=-6.000
max3319.000-3307.000=12.000
mean8.521-8.543=-0.023
σ0.118-0.073=0.045
min8.315-8.471=-0.156
max8.602-8.634=-0.032

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.691-1.763=-0.071
σ0.147-0.092=0.055
min1.489-1.648=-0.159
max1.836-1.876=-0.040

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.327-468.325=0.002
σ574.231-574.225=0.007
min181.207-181.206=0.001
max1329.674-1329.663=0.011
mean88.250
σ8.500
min84.000
max101.000
mean2409.000-2447.000=-38.000
σ0.000
min2409.000-2447.000=-38.000
max2409.000-2447.000=-38.000
mean0.563-0.563=-0.001
σ0.555-0.555=-0.000
min0.282-0.284=-0.002
max1.395-1.396=-0.001
policies=20
mean1812.432-1812.437=-0.005
σ0.393-0.387=0.006
min1812.159-1812.174=-0.015
max1813.012-1813.007=0.004
mean840.000
σ0.000
min840.000
max840.000
mean2409.000-2447.000=-38.000
σ0.000
min2409.000-2447.000=-38.000
max2409.000-2447.000=-38.000
mean2.816-2.835=-0.019
σ0.016-0.031=-0.015
min2.800-2.807=-0.007
max2.837-2.880=-0.043
policies=200
mean18131.586-18131.648=-0.062
σ0.384-0.439=-0.055
min18131.272-18131.366=-0.094
max18132.146-18132.302=-0.157
mean8400.000
σ0.000
min8400.000
max8400.000
mean2409.000-2447.000=-38.000
σ0.000
min2409.000-2447.000=-38.000
max2409.000-2447.000=-38.000
mean28.387-28.521=-0.134
σ0.084-0.064=0.020
min28.279-28.437=-0.159
max28.466-28.590=-0.124