Compare commits

Home / Compare a1272027 .. fce9a488

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.647-53.647=-0.001
σ0.369-0.367=0.002
min53.518-53.512=0.006
max54.696-54.690=0.006
mean414.300-417.000=-2.700
σ0.483-0.000=0.483
min414.000-417.000=-3.000
max415.000-417.000=-2.000
mean0.138-0.140=-0.002
σ0.003-0.004=-0.001
min0.135-0.136=-0.000
max0.143-0.146=-0.003
cache=y
dps=1
iters=10
policies=100
mean42.941-42.943=-0.002
σ0.005-0.005=-0.001
min42.933-42.936=-0.003
max42.949-42.951=-0.002
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.120-0.122=-0.001
σ0.004-0.005=-0.001
min0.115-0.115=0.001
max0.126-0.129=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.857-991.813=0.044
σ1.214-1.229=-0.015
min991.266-991.225=0.041
max996.938-996.968=-0.030
mean1055.450-1075.450=-20.000
σ311.661-316.286=-4.624
min585.000-624.000=-39.000
max1524.000-1636.000=-112.000
mean1.520-1.496=0.024
σ0.073-0.073=-0.000
min1.458-1.400=0.058
max1.763-1.680=0.082

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.436-285.393=0.043
σ0.013-0.010=0.003
min285.415-285.382=0.033
max285.448-285.404=0.044
mean1524.000-1636.000=-112.000
σ0.000
min1524.000-1636.000=-112.000
max1524.000-1636.000=-112.000
mean0.378-0.383=-0.005
σ0.007-0.009=-0.002
min0.374-0.376=-0.002
max0.390-0.396=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1285.501-1285.352=0.149
σ0.087-0.133=-0.046
min1285.353-1285.287=0.066
max1285.568-1285.589=-0.021
mean1524.000-1636.000=-112.000
σ0.000
min1524.000-1636.000=-112.000
max1524.000-1636.000=-112.000
mean1.888-1.917=-0.029
σ0.066-0.132=-0.066
min1.801-1.781=0.020
max1.978-2.103=-0.125
iters=5
new-facts=6402
prior-facts=1
mean1705.829-1807.688=-101.860
σ6.858-7.019=-0.162
min1702.652-1804.323=-101.671
max1718.093-1820.229=-102.136
mean1524.000-1636.000=-112.000
σ0.000
min1524.000-1636.000=-112.000
max1524.000-1636.000=-112.000
mean2.963-4.145=-1.182
σ0.224-0.233=-0.009
min2.802-3.798=-0.996
max3.309-4.454=-1.145
iters=5
new-facts=6402
prior-facts=6402
mean1968.411-2070.177=-101.766
σ0.034-0.015=0.019
min1968.355-2070.161=-101.806
max1968.444-2070.200=-101.756
mean1787.200-1838.600=-51.400
σ196.233-171.774=24.459
min1530.000-1636.000=-106.000
max2030.000-2077.000=-47.000
mean3.216-4.484=-1.268
σ0.336-0.050=0.286
min3.014-4.430=-1.416
max3.814-4.560=-0.745

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.546-1.273=0.273
σ0.264-0.347=-0.083
min1.202-0.912=0.290
max1.782-1.814=-0.032

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.771-436.780=-0.009
σ572.353-572.354=-0.001
min150.589-150.595=-0.006
max1295.301-1295.311=-0.011
mean90.250
σ8.500
min86.000
max103.000
mean1524.000-1636.000=-112.000
σ0.000
min1524.000-1636.000=-112.000
max1524.000-1636.000=-112.000
mean0.528-0.530=-0.002
σ0.556-0.563=-0.007
min0.247-0.237=0.010
max1.363-1.375=-0.012
policies=20
mean1506.174-1506.184=-0.010
σ0.238-0.242=-0.004
min1506.010-1506.025=-0.015
max1506.526-1506.544=-0.018
mean860.000
σ0.000
min860.000
max860.000
mean1524.000-1636.000=-112.000
σ0.000
min1524.000-1636.000=-112.000
max1524.000-1636.000=-112.000
mean2.511-2.525=-0.014
σ0.025-0.018=0.007
min2.477-2.504=-0.027
max2.531-2.541=-0.010
policies=200
mean15069.415-15069.483=-0.069
σ0.101-0.050=0.051
min15069.322-15069.420=-0.099
max15069.553-15069.532=0.021
mean8600.000
σ0.000
min8600.000
max8600.000
mean1524.000-1636.000=-112.000
σ0.000
min1524.000-1636.000=-112.000
max1524.000-1636.000=-112.000
mean25.443-25.375=0.068
σ0.136-0.067=0.068
min25.317-25.282=0.035
max25.622-25.437=0.185