Compare commits

Home / Compare 6d20d438 .. cc57aac7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean1448.766-1448.768=-0.002
σ0.409-0.410=-0.000
min1448.594-1448.588=0.006
max1449.920-1449.917=0.002
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean2.251-2.249=0.002
σ0.021-0.036=-0.015
min2.219-2.184=0.035
max2.275-2.297=-0.022
cache=y
dps=1
iters=10
policies=100
mean1437.939-1437.940=-0.001
σ0.012-0.011=0.001
min1437.924-1437.920=0.004
max1437.962-1437.957=0.006
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean2.238-2.236=0.003
σ0.020-0.027=-0.007
min2.200-2.190=0.010
max2.267-2.264=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1030.062-1030.056=0.006
σ1.109-1.117=-0.007
min1029.522-1029.544=-0.021
max1034.722-1034.745=-0.022
mean1064.700-1059.300=5.400
σ316.699-308.308=8.390
min613.000-634.000=-21.000
max1626.000-1506.000=120.000
mean1.542-1.539=0.003
σ0.062-0.080=-0.017
min1.489-1.466=0.022
max1.691-1.819=-0.129

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean394.177-394.160=0.017
σ0.087-0.078=0.009
min394.026-394.029=-0.003
max394.249-394.213=0.036
mean1626.000-1506.000=120.000
σ0.000
min1626.000-1506.000=120.000
max1626.000-1506.000=120.000
mean0.486-0.489=-0.003
σ0.008-0.006=0.002
min0.479-0.485=-0.006
max0.500-0.497=0.003
iters=5
new-facts=1
prior-facts=6402
mean1395.762-1395.765=-0.003
σ0.035-0.072=-0.037
min1395.733-1395.729=0.004
max1395.813-1395.894=-0.081
mean1626.000-1506.000=120.000
σ0.000
min1626.000-1506.000=120.000
max1626.000-1506.000=120.000
mean2.141-1.989=0.152
σ0.158-0.047=0.110
min1.910-1.909=0.001
max2.276-2.034=0.243
iters=5
new-facts=6402
prior-facts=1
mean1917.942-1917.935=0.008
σ7.131-7.141=-0.010
min1914.623-1914.605=0.018
max1930.692-1930.703=-0.011
mean1626.000-1506.000=120.000
σ0.000
min1626.000-1506.000=120.000
max1626.000-1506.000=120.000
mean4.501-4.292=0.209
σ0.222-0.226=-0.004
min4.301-4.013=0.288
max4.780-4.582=0.198
iters=5
new-facts=6402
prior-facts=6402
mean2180.564-2180.560=0.003
σ0.017-0.015=0.002
min2180.551-2180.551=0.001
max2180.593-2180.587=0.006
mean1825.400-1846.400=-21.000
σ184.115-212.582=-28.468
min1626.000-1583.000=43.000
max2085.000-2082.000=3.000
mean4.640-4.651=-0.010
σ0.045-0.056=-0.011
min4.590-4.594=-0.004
max4.710-4.729=-0.020

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.190-1.582=-0.392
σ0.292-0.365=-0.072
min0.950-0.940=0.010
max1.687-1.814=-0.127

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean457.266-457.252=0.014
σ573.363-573.346=0.018
min170.580-170.577=0.003
max1317.311-1317.271=0.040
mean98.250
σ8.500
min94.000
max111.000
mean1626.000-1506.000=120.000
σ0.000
min1626.000-1506.000=120.000
max1626.000-1506.000=120.000
mean0.551-0.549=0.002
σ0.541-0.515=0.026
min0.279-0.286=-0.007
max1.363-1.322=0.041
policies=20
mean1706.092-1706.069=0.023
σ0.409-0.413=-0.004
min1705.805-1705.775=0.030
max1706.694-1706.672=0.022
mean940.000
σ0.000
min940.000
max940.000
mean1626.000-1506.000=120.000
σ0.000
min1626.000-1506.000=120.000
max1626.000-1506.000=120.000
mean2.808-2.846=-0.038
σ0.018-0.016=0.002
min2.783-2.833=-0.050
max2.824-2.866=-0.042
policies=200
mean17068.575-17068.622=-0.047
σ0.101-0.166=-0.065
min17068.448-17068.441=0.007
max17068.676-17068.838=-0.162
mean9400.000
σ0.000
min9400.000
max9400.000
mean1626.000-1506.000=120.000
σ0.000
min1626.000-1506.000=120.000
max1626.000-1506.000=120.000
mean28.472-28.671=-0.200
σ0.053-0.161=-0.108
min28.415-28.457=-0.041
max28.523-28.847=-0.324