Compare commits

Home / Compare d05ac9d6 .. 596b7480

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.047-73.047=-0.001
σ0.050-0.046=0.004
min73.018-73.021=-0.003
max73.187-73.171=0.016
mean413.400-412.000=1.400
σ0.516-0.000=0.516
min413.000-412.000=1.000
max414.000-412.000=2.000
mean0.158-0.160=-0.001
σ0.005-0.005=0.000
min0.152-0.153=-0.000
max0.165-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.741-23.740=0.001
σ0.003-0.003=0.000
min23.737-23.736=0.001
max23.747-23.745=0.001
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.066-0.063=0.002
σ0.002-0.005=-0.003
min0.064-0.051=0.013
max0.071-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.789-1758.785=0.004
σ0.361-0.362=-0.001
min1758.223-1758.214=0.009
max1759.374-1759.366=0.009
mean1631.550-1654.500=-22.950
σ609.597-624.300=-14.703
min637.000-629.000=8.000
max2438.000-2512.000=-74.000
mean2.848-2.777=0.071
σ0.182-0.175=0.007
min2.250-2.328=-0.077
max3.195-3.021=0.174

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.013-324.015=-0.002
σ0.060-0.050=0.011
min323.905-323.926=-0.021
max324.043-324.041=0.002
mean2438.000-2512.000=-74.000
σ0.000
min2438.000-2512.000=-74.000
max2438.000-2512.000=-74.000
mean0.428-0.428=0.000
σ0.004-0.004=0.001
min0.424-0.425=-0.001
max0.435-0.434=0.001
iters=5
new-facts=1
prior-facts=6402
mean1984.585-1984.592=-0.008
σ0.021-0.012=0.008
min1984.552-1984.573=-0.021
max1984.601-1984.604=-0.003
mean2438.000-2512.000=-74.000
σ0.000
min2438.000-2512.000=-74.000
max2438.000-2512.000=-74.000
mean2.636-2.619=0.017
σ0.136-0.115=0.021
min2.560-2.493=0.066
max2.878-2.796=0.082
iters=5
new-facts=6402
prior-facts=1
mean4808.244-4808.226=0.018
σ7.778-7.777=0.001
min4804.726-4804.671=0.055
max4822.157-4822.137=0.020
mean2438.000-2512.000=-74.000
σ0.000
min2438.000-2512.000=-74.000
max2438.000-2512.000=-74.000
mean8.746-8.753=-0.008
σ0.142-0.176=-0.033
min8.519-8.595=-0.076
max8.886-9.026=-0.140
iters=5
new-facts=6402
prior-facts=6402
mean4995.658-4995.597=0.061
σ0.206-0.300=-0.094
min4995.421-4995.120=0.301
max4995.827-4995.816=0.011
mean2947.600-2996.400=-48.800
σ457.170-277.983=179.188
min2438.000-2608.000=-170.000
max3568.000-3297.000=271.000
mean8.511-8.792=-0.281
σ0.138-0.149=-0.011
min8.381-8.568=-0.186
max8.733-8.942=-0.209

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.715-1.627=0.088
σ0.064-0.237=-0.172
min1.614-1.235=0.379
max1.787-1.816=-0.029

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.326-468.329=-0.003
σ574.229-574.231=-0.002
min181.204-181.210=-0.006
max1329.669-1329.675=-0.006
mean88.250
σ8.500
min84.000
max101.000
mean2438.000-2512.000=-74.000
σ0.000
min2438.000-2512.000=-74.000
max2438.000-2512.000=-74.000
mean0.578-0.572=0.006
σ0.584-0.576=0.008
min0.280-0.283=-0.003
max1.453-1.436=0.018
policies=20
mean1812.419-1812.427=-0.008
σ0.384-0.394=-0.010
min1812.166-1812.149=0.016
max1812.988-1813.007=-0.019
mean840.000
σ0.000
min840.000
max840.000
mean2438.000-2512.000=-74.000
σ0.000
min2438.000-2512.000=-74.000
max2438.000-2512.000=-74.000
mean2.815-2.827=-0.013
σ0.005-0.029=-0.024
min2.808-2.796=0.012
max2.819-2.862=-0.043
policies=200
mean18131.552-18131.466=0.086
σ0.501-0.473=0.028
min18131.266-18131.151=0.116
max18132.299-18132.153=0.147
mean8400.000
σ0.000
min8400.000
max8400.000
mean2438.000-2512.000=-74.000
σ0.000
min2438.000-2512.000=-74.000
max2438.000-2512.000=-74.000
mean28.375-28.332=0.043
σ0.085-0.085=0.000
min28.278-28.228=0.050
max28.484-28.407=0.078