Compare commits

Home / Compare 4d51c4d4 .. d6df954b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.946-53.948=-0.002
σ0.367-0.368=-0.001
min53.799-53.805=-0.005
max54.991-54.995=-0.004
mean415.700-414.000=1.700
σ0.483-0.000=0.483
min415.000-414.000=1.000
max416.000-414.000=2.000
mean0.137-0.139=-0.002
σ0.005-0.005=-0.000
min0.131-0.132=-0.001
max0.144-0.148=-0.005
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.000
σ0.006-0.006=-0.001
min43.315-43.311=0.003
max43.332-43.332=-0.000
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.121-0.122=-0.001
σ0.003-0.004=-0.000
min0.116-0.117=-0.001
max0.126-0.129=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1010.696-1010.694=0.002
σ1.163-1.166=-0.003
min1010.129-1010.124=0.005
max1015.569-1015.578=-0.009
mean1050.850-1048.450=2.400
σ299.423-299.244=0.179
min571.000-570.000=1.000
max1458.000-1455.000=3.000
mean1.501-1.535=-0.034
σ0.079-0.096=-0.017
min1.394-1.443=-0.048
max1.715-1.751=-0.036

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean300.897-300.778=0.119
σ0.273-0.281=-0.008
min300.745-300.557=0.188
max301.657-301.545=0.113
mean1915.000-1890.000=25.000
σ0.000
min1915.000-1890.000=25.000
max1915.000-1890.000=25.000
mean0.587-0.572=0.015
σ0.021-0.043=-0.022
min0.555-0.504=0.050
max0.628-0.634=-0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean299.187-299.170=0.017
σ0.036-0.056=-0.020
min299.151-299.091=0.060
max299.230-299.228=0.002
mean1458.000-1455.000=3.000
σ0.000
min1458.000-1455.000=3.000
max1458.000-1455.000=3.000
mean0.388-0.387=0.001
σ0.007-0.007=0.001
min0.384-0.383=0.000
max0.401-0.399=0.001
iters=5
new-facts=1
prior-facts=6402
mean1309.618-1309.618=0.000
σ0.102-0.103=-0.001
min1309.490-1309.486=0.003
max1309.737-1309.737=0.001
mean1458.000-1455.000=3.000
σ0.000
min1458.000-1455.000=3.000
max1458.000-1455.000=3.000
mean1.901-1.840=0.061
σ0.093-0.040=0.052
min1.795-1.800=-0.005
max2.000-1.895=0.105
iters=5
new-facts=6402
prior-facts=1
mean1553.714-1553.691=0.023
σ6.849-6.870=-0.020
min1550.417-1550.361=0.056
max1565.962-1565.975=-0.013
mean1458.000-1455.000=3.000
σ0.000
min1458.000-1455.000=3.000
max1458.000-1455.000=3.000
mean2.325-2.213=0.112
σ0.264-0.202=0.062
min2.020-2.082=-0.062
max2.546-2.566=-0.020
iters=5
new-facts=6402
prior-facts=6402
mean1871.497-1871.485=0.012
σ0.049-0.041=0.008
min1871.428-1871.441=-0.013
max1871.543-1871.534=0.009
mean1727.400-1744.600=-17.200
σ200.166-170.352=29.814
min1458.000-1490.000=-32.000
max1915.000-1890.000=25.000
mean2.844-2.997=-0.152
σ0.139-0.247=-0.108
min2.615-2.822=-0.207
max2.985-3.428=-0.442

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.694-1.709=-0.016
σ0.129-0.132=-0.002
min1.497-1.589=-0.092
max1.847-1.861=-0.014

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.436-444.440=-0.004
σ575.129-575.129=0.001
min156.870-156.873=-0.004
max1307.130-1307.133=-0.003
mean96.250
σ8.500
min92.000
max109.000
mean1458.000-1455.000=3.000
σ0.000
min1458.000-1455.000=3.000
max1458.000-1455.000=3.000
mean0.526-0.532=-0.006
σ0.523-0.544=-0.021
min0.260-0.259=0.001
max1.311-1.348=-0.037
policies=20
mean1568.995-1569.012=-0.017
σ0.333-0.329=0.003
min1568.778-1568.800=-0.022
max1569.491-1569.503=-0.013
mean920.000
σ0.000
min920.000
max920.000
mean1458.000-1455.000=3.000
σ0.000
min1458.000-1455.000=3.000
max1458.000-1455.000=3.000
mean2.603-2.610=-0.006
σ0.008-0.023=-0.016
min2.597-2.585=0.012
max2.614-2.641=-0.027
policies=200
mean15698.024-15698.033=-0.009
σ0.135-0.022=0.114
min15697.904-15698.001=-0.097
max15698.176-15698.047=0.129
mean9200.000
σ0.000
min9200.000
max9200.000
mean1458.000-1455.000=3.000
σ0.000
min1458.000-1455.000=3.000
max1458.000-1455.000=3.000
mean26.362-26.477=-0.115
σ0.137-0.211=-0.073
min26.215-26.282=-0.068
max26.501-26.774=-0.274