Compare commits

Home / Compare a313a2c9 .. 138c4215

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.046-73.048=-0.002
σ0.047-0.046=0.000
min73.024-73.022=0.002
max73.177-73.178=-0.001
mean414.600-412.100=2.500
σ0.516-0.316=0.200
min414.000-412.000=2.000
max415.000-413.000=2.000
mean0.161-0.168=-0.007
σ0.005-0.011=-0.006
min0.157-0.153=0.004
max0.171-0.183=-0.012
cache=y
dps=1
iters=10
policies=100
mean23.740-23.740=0.000
σ0.004-0.003=0.000
min23.736-23.735=0.001
max23.747-23.745=0.002
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.067-0.065=0.001
σ0.003-0.003=0.001
min0.064-0.061=0.003
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.787-1758.789=-0.002
σ0.361-0.363=-0.002
min1758.212-1758.214=-0.002
max1759.371-1759.388=-0.017
mean1672.450-1646.250=26.200
σ638.713-629.224=9.490
min680.000-616.000=64.000
max2833.000-2770.000=63.000
mean2.808-2.827=-0.020
σ0.164-0.163=0.000
min2.401-2.372=0.029
max3.019-3.088=-0.069

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.011-323.986=0.026
σ0.058-0.045=0.013
min323.908-323.905=0.002
max324.047-324.013=0.033
mean2833.000-2770.000=63.000
σ0.000
min2833.000-2770.000=63.000
max2833.000-2770.000=63.000
mean0.428-0.429=-0.001
σ0.001-0.006=-0.005
min0.427-0.425=0.002
max0.429-0.439=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1984.592-1984.585=0.006
σ0.010-0.018=-0.009
min1984.575-1984.553=0.022
max1984.599-1984.600=-0.001
mean2833.000-2770.000=63.000
σ0.000
min2833.000-2770.000=63.000
max2833.000-2770.000=63.000
mean2.624-2.583=0.042
σ0.047-0.076=-0.028
min2.577-2.471=0.106
max2.680-2.653=0.027
iters=5
new-facts=6402
prior-facts=1
mean4808.265-4808.238=0.027
σ7.771-7.778=-0.007
min4804.708-4804.739=-0.031
max4822.165-4822.152=0.013
mean2833.000-2770.000=63.000
σ0.000
min2833.000-2770.000=63.000
max2833.000-2770.000=63.000
mean9.034-9.006=0.028
σ0.321-0.086=0.235
min8.636-8.918=-0.282
max9.417-9.137=0.280
iters=5
new-facts=6402
prior-facts=6402
mean4995.797-4995.809=-0.012
σ0.019-0.019=0.000
min4995.774-4995.788=-0.013
max4995.827-4995.835=-0.008
mean3043.000-2988.800=54.200
σ264.937-214.749=50.188
min2833.000-2770.000=63.000
max3446.000-3305.000=141.000
mean8.622-8.670=-0.048
σ0.086-0.166=-0.080
min8.507-8.495=0.012
max8.735-8.910=-0.175

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.041-1.031=0.010
σ0.127-0.133=-0.006
min0.929-0.913=0.016
max1.242-1.240=0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.355-468.354=0.000
σ574.224-574.229=-0.004
min181.234-181.231=0.004
max1329.691-1329.697=-0.006
mean88.250
σ8.500
min84.000
max101.000
mean2833.000-2770.000=63.000
σ0.000
min2833.000-2770.000=63.000
max2833.000-2770.000=63.000
mean0.445-0.444=0.001
σ0.302-0.304=-0.001
min0.290-0.289=0.001
max0.899-0.899=-0.001
policies=20
mean1812.633-1812.634=-0.001
σ0.392-0.400=-0.009
min1812.362-1812.360=0.002
max1813.209-1813.224=-0.015
mean840.000
σ0.000
min840.000
max840.000
mean2833.000-2770.000=63.000
σ0.000
min2833.000-2770.000=63.000
max2833.000-2770.000=63.000
mean2.889-2.888=0.001
σ0.006-0.025=-0.019
min2.883-2.866=0.017
max2.898-2.923=-0.026
policies=200
mean18131.804-18131.541=0.263
σ0.541-0.344=0.197
min18131.296-18131.317=-0.021
max18132.410-18132.046=0.364
mean8400.000
σ0.000
min8400.000
max8400.000
mean2833.000-2770.000=63.000
σ0.000
min2833.000-2770.000=63.000
max2833.000-2770.000=63.000
mean28.606-28.386=0.220
σ0.221-0.128=0.093
min28.401-28.247=0.154
max28.875-28.530=0.345