Compare commits

Home / Compare 1291fe0e .. e347845e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.046-73.044=0.002
σ0.048-0.047=0.001
min73.023-73.024=-0.001
max73.182-73.178=0.004
mean418.900-412.600=6.300
σ0.316-0.516=-0.200
min418.000-412.000=6.000
max419.000-413.000=6.000
mean0.160-0.161=-0.001
σ0.004-0.004=-0.000
min0.151-0.153=-0.002
max0.165-0.166=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.740-23.740=-0.000
σ0.003-0.002=0.001
min23.735-23.735=-0.000
max23.746-23.744=0.002
mean419.000-413.000=6.000
σ0.000
min419.000-413.000=6.000
max419.000-413.000=6.000
mean0.065-0.062=0.003
σ0.002-0.003=-0.001
min0.059-0.060=-0.000
max0.069-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.789-1758.788=0.002
σ0.361-0.359=0.002
min1758.214-1758.218=-0.004
max1759.371-1759.353=0.018
mean1633.650-1649.800=-16.150
σ598.867-619.758=-20.891
min638.000-648.000=-10.000
max2435.000-2493.000=-58.000
mean2.872-2.854=0.018
σ0.157-0.122=0.035
min2.507-2.626=-0.120
max3.290-3.229=0.061

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.014-324.012=0.002
σ0.055-0.060=-0.005
min323.917-323.905=0.012
max324.047-324.043=0.004
mean2435.000-2493.000=-58.000
σ0.000
min2435.000-2493.000=-58.000
max2435.000-2493.000=-58.000
mean0.427-0.433=-0.005
σ0.005-0.005=0.000
min0.425-0.429=-0.004
max0.437-0.441=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1984.588-1984.584=0.004
σ0.018-0.021=-0.002
min1984.571-1984.551=0.020
max1984.610-1984.600=0.010
mean2435.000-2493.000=-58.000
σ0.000
min2435.000-2493.000=-58.000
max2435.000-2493.000=-58.000
mean2.619-2.633=-0.014
σ0.146-0.101=0.045
min2.474-2.550=-0.076
max2.851-2.745=0.106
iters=5
new-facts=6402
prior-facts=1
mean4808.123-4808.267=-0.144
σ7.891-7.822=0.069
min4804.121-4804.679=-0.558
max4822.229-4822.258=-0.028
mean2435.000-2493.000=-58.000
σ0.000
min2435.000-2493.000=-58.000
max2435.000-2493.000=-58.000
mean8.923-9.039=-0.116
σ0.200-0.283=-0.082
min8.697-8.724=-0.027
max9.146-9.323=-0.177
iters=5
new-facts=6402
prior-facts=6402
mean4995.728-4995.667=0.062
σ0.148-0.310=-0.163
min4995.466-4995.113=0.354
max4995.823-4995.830=-0.007
mean3000.800-2962.200=38.600
σ295.688-269.984=25.704
min2611.000-2591.000=20.000
max3374.000-3291.000=83.000
mean8.571-8.617=-0.046
σ0.171-0.106=0.065
min8.405-8.452=-0.048
max8.861-8.728=0.133

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.761-1.596=0.165
σ0.078-0.165=-0.087
min1.676-1.356=0.320
max1.853-1.764=0.089

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.323-468.333=-0.009
σ574.229-574.234=-0.005
min181.208-181.212=-0.004
max1329.667-1329.683=-0.017
mean88.250
σ8.500
min84.000
max101.000
mean2435.000-2493.000=-58.000
σ0.000
min2435.000-2493.000=-58.000
max2435.000-2493.000=-58.000
mean0.555-0.541=0.014
σ0.545-0.533=0.011
min0.274-0.259=0.015
max1.371-1.341=0.031
policies=20
mean1812.422-1812.429=-0.007
σ0.381-0.393=-0.012
min1812.180-1812.177=0.003
max1812.987-1813.012=-0.025
mean840.000
σ0.000
min840.000
max840.000
mean2435.000-2493.000=-58.000
σ0.000
min2435.000-2493.000=-58.000
max2435.000-2493.000=-58.000
mean2.818-2.829=-0.011
σ0.021-0.035=-0.014
min2.796-2.791=0.005
max2.843-2.874=-0.031
policies=200
mean18131.555-18131.534=0.021
σ0.412-0.412=-0.000
min18131.227-18131.249=-0.022
max18132.144-18132.143=0.000
mean8400.000
σ0.000
min8400.000
max8400.000
mean2435.000-2493.000=-58.000
σ0.000
min2435.000-2493.000=-58.000
max2435.000-2493.000=-58.000
mean28.264-28.275=-0.011
σ0.082-0.084=-0.002
min28.165-28.179=-0.014
max28.356-28.366=-0.010