Compare commits

Home / Compare 68b36978 .. 2a3a9486

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.046-73.048=-0.002
σ0.049-0.046=0.003
min73.022-73.022=-0.000
max73.184-73.178=0.006
mean418.000-412.100=5.900
σ0.000-0.316=-0.316
min418.000-412.000=6.000
max418.000-413.000=5.000
mean0.161-0.168=-0.007
σ0.003-0.011=-0.009
min0.158-0.153=0.005
max0.166-0.183=-0.017
cache=y
dps=1
iters=10
policies=100
mean23.740-23.740=0.001
σ0.003-0.003=-0.000
min23.734-23.735=-0.001
max23.744-23.745=-0.001
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.064-0.065=-0.001
σ0.003-0.003=0.000
min0.059-0.061=-0.002
max0.068-0.071=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.786-1758.789=-0.003
σ0.363-0.363=0.001
min1758.217-1758.214=0.003
max1759.371-1759.388=-0.018
mean1659.800-1646.250=13.550
σ631.172-629.224=1.949
min622.000-616.000=6.000
max2892.000-2770.000=122.000
mean2.737-2.827=-0.090
σ0.212-0.163=0.048
min2.254-2.372=-0.118
max3.087-3.088=-0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.008-323.986=0.023
σ0.052-0.045=0.007
min323.915-323.905=0.010
max324.034-324.013=0.021
mean2892.000-2770.000=122.000
σ0.000
min2892.000-2770.000=122.000
max2892.000-2770.000=122.000
mean0.426-0.429=-0.002
σ0.001-0.006=-0.005
min0.425-0.425=0.000
max0.427-0.439=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1984.579-1984.585=-0.007
σ0.012-0.018=-0.007
min1984.568-1984.553=0.015
max1984.594-1984.600=-0.006
mean2892.000-2770.000=122.000
σ0.000
min2892.000-2770.000=122.000
max2892.000-2770.000=122.000
mean2.608-2.583=0.025
σ0.080-0.076=0.005
min2.539-2.471=0.067
max2.710-2.653=0.057
iters=5
new-facts=6402
prior-facts=1
mean4808.118-4808.238=-0.120
σ7.520-7.778=-0.258
min4804.738-4804.739=-0.002
max4821.570-4822.152=-0.582
mean2892.000-2770.000=122.000
σ0.000
min2892.000-2770.000=122.000
max2892.000-2770.000=122.000
mean8.761-9.006=-0.245
σ0.164-0.086=0.078
min8.612-8.918=-0.306
max8.952-9.137=-0.185
iters=5
new-facts=6402
prior-facts=6402
mean4995.805-4995.809=-0.003
σ0.016-0.019=-0.003
min4995.788-4995.788=-0.000
max4995.819-4995.835=-0.016
mean3020.800-2988.800=32.000
σ203.297-214.749=-11.452
min2892.000-2770.000=122.000
max3357.000-3305.000=52.000
mean8.604-8.670=-0.066
σ0.168-0.166=0.002
min8.462-8.495=-0.033
max8.881-8.910=-0.029

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.013-1.031=-0.018
σ0.143-0.133=0.010
min0.911-0.913=-0.002
max1.247-1.240=0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.349-468.354=-0.005
σ574.230-574.229=0.002
min181.225-181.231=-0.005
max1329.695-1329.697=-0.002
mean88.250
σ8.500
min84.000
max101.000
mean2892.000-2770.000=122.000
σ0.000
min2892.000-2770.000=122.000
max2892.000-2770.000=122.000
mean0.447-0.444=0.003
σ0.306-0.304=0.002
min0.290-0.289=0.001
max0.906-0.899=0.006
policies=20
mean1812.619-1812.634=-0.015
σ0.401-0.400=0.001
min1812.341-1812.360=-0.019
max1813.210-1813.224=-0.015
mean840.000
σ0.000
min840.000
max840.000
mean2892.000-2770.000=122.000
σ0.000
min2892.000-2770.000=122.000
max2892.000-2770.000=122.000
mean2.887-2.888=-0.001
σ0.017-0.025=-0.009
min2.862-2.866=-0.004
max2.898-2.923=-0.025
policies=200
mean18132.175-18131.541=0.634
σ0.888-0.344=0.545
min18131.008-18131.317=-0.309
max18132.919-18132.046=0.873
mean8400.000
σ0.000
min8400.000
max8400.000
mean2892.000-2770.000=122.000
σ0.000
min2892.000-2770.000=122.000
max2892.000-2770.000=122.000
mean28.831-28.386=0.445
σ0.341-0.128=0.212
min28.487-28.247=0.240
max29.135-28.530=0.605