Compare commits

Home / Compare 928d9cef .. 93e8b410

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.648-53.647=0.000
σ0.368-0.366=0.002
min53.517-53.510=0.006
max54.696-54.690=0.006
mean414.000-413.300=0.700
σ0.000-0.483=-0.483
min414.000-413.000=1.000
max414.000
mean0.139-0.138=0.000
σ0.003-0.004=-0.001
min0.135-0.131=0.004
max0.144-0.146=-0.002
cache=y
dps=1
iters=10
policies=100
mean42.943-42.944=-0.001
σ0.006-0.007=-0.001
min42.933-42.934=-0.001
max42.952-42.957=-0.005
mean414.000
σ0.000
min414.000
max414.000
mean0.120-0.121=-0.000
σ0.002-0.003=-0.001
min0.119-0.118=0.001
max0.125-0.126=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.868-991.864=0.004
σ1.219-1.216=0.003
min991.284-991.271=0.012
max996.952-996.942=0.010
mean1066.100-1054.500=11.600
σ323.037-310.497=12.541
min576.000-583.000=-7.000
max1633.000-1526.000=107.000
mean1.519-1.522=-0.002
σ0.122-0.094=0.028
min1.327-1.388=-0.061
max1.903-1.787=0.115

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.438-285.433=0.005
σ0.009-0.009=-0.000
min285.425-285.422=0.003
max285.448-285.441=0.007
mean1633.000-1526.000=107.000
σ0.000
min1633.000-1526.000=107.000
max1633.000-1526.000=107.000
mean0.376-0.381=-0.005
σ0.006-0.010=-0.004
min0.373-0.373=0.000
max0.387-0.398=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1285.489-1285.537=-0.048
σ0.081-0.049=0.032
min1285.353-1285.463=-0.109
max1285.548-1285.583=-0.035
mean1633.000-1526.000=107.000
σ0.000
min1633.000-1526.000=107.000
max1633.000-1526.000=107.000
mean1.920-1.985=-0.065
σ0.159-0.255=-0.096
min1.803-1.806=-0.003
max2.192-2.381=-0.189
iters=5
new-facts=6402
prior-facts=1
mean1705.833-1705.833=-0.000
σ6.829-6.874=-0.044
min1702.652-1702.661=-0.009
max1718.046-1718.126=-0.079
mean1633.000-1526.000=107.000
σ0.000
min1633.000-1526.000=107.000
max1633.000-1526.000=107.000
mean3.026-2.913=0.113
σ0.169-0.330=-0.161
min2.827-2.507=0.320
max3.230-3.392=-0.161
iters=5
new-facts=6402
prior-facts=6402
mean1968.444-1968.431=0.012
σ0.022-0.040=-0.017
min1968.427-1968.378=0.049
max1968.475-1968.483=-0.008
mean1904.400-1785.800=118.600
σ225.186-195.988=29.198
min1633.000-1543.000=90.000
max2183.000-2043.000=140.000
mean3.250-3.327=-0.076
σ0.102-0.393=-0.291
min3.166-3.059=0.107
max3.367-4.014=-0.647

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.209-1.596=-0.387
σ0.335-0.232=0.103
min0.916-1.223=-0.308
max1.775-1.797=-0.023

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.780-436.768=0.012
σ572.362-572.349=0.013
min150.590-150.588=0.001
max1295.323-1295.292=0.031
mean90.250
σ8.500
min86.000
max103.000
mean1633.000-1526.000=107.000
σ0.000
min1633.000-1526.000=107.000
max1633.000-1526.000=107.000
mean0.529-0.535=-0.005
σ0.557-0.571=-0.013
min0.248-0.247=0.001
max1.365-1.391=-0.026
policies=20
mean1506.183-1506.166=0.017
σ0.237-0.240=-0.003
min1506.031-1506.004=0.027
max1506.537-1506.523=0.013
mean860.000
σ0.000
min860.000
max860.000
mean1633.000-1526.000=107.000
σ0.000
min1633.000-1526.000=107.000
max1633.000-1526.000=107.000
mean2.518-2.516=0.003
σ0.019-0.027=-0.007
min2.492-2.484=0.008
max2.535-2.548=-0.013
policies=200
mean15069.438-15069.542=-0.104
σ0.120-0.058=0.062
min15069.284-15069.489=-0.205
max15069.572-15069.611=-0.039
mean8600.000
σ0.000
min8600.000
max8600.000
mean1633.000-1526.000=107.000
σ0.000
min1633.000-1526.000=107.000
max1633.000-1526.000=107.000
mean25.409-25.447=-0.038
σ0.095-0.090=0.005
min25.301-25.314=-0.013
max25.519-25.516=0.003