Compare commits

Home / Compare 828ce736 .. f9fed001

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.648-53.647=0.001
σ0.368-0.366=0.002
min53.519-53.520=-0.001
max54.694-54.688=0.005
mean415.500-417.000=-1.500
σ0.707-0.000=0.707
min414.000-417.000=-3.000
max416.000-417.000=-1.000
mean0.139-0.139=0.000
σ0.006-0.004=0.001
min0.129-0.135=-0.006
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean42.942-42.942=-0.000
σ0.004-0.006=-0.002
min42.934-42.932=0.002
max42.948-42.955=-0.007
mean416.100-417.000=-0.900
σ0.316-0.000=0.316
min416.000-417.000=-1.000
max417.000
mean0.121-0.120=0.001
σ0.003-0.004=-0.000
min0.118-0.113=0.005
max0.127-0.126=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.804-991.798=0.006
σ1.276-1.245=0.031
min991.231-991.228=0.003
max997.180-997.040=0.140
mean1072.750-1072.550=0.200
σ328.454-328.809=-0.355
min569.000-570.000=-1.000
max1646.000
mean1.531-1.540=-0.009
σ0.110-0.090=0.020
min1.415-1.402=0.014
max1.889-1.729=0.159

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.392-285.394=-0.002
σ0.011-0.004=0.007
min285.377-285.390=-0.013
max285.406-285.399=0.007
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.383-0.378=0.005
σ0.009-0.008=0.001
min0.375-0.373=0.002
max0.395-0.392=0.003
iters=5
new-facts=1
prior-facts=6402
mean1285.352-1285.357=-0.004
σ0.128-0.133=-0.005
min1285.281-1285.289=-0.008
max1285.581-1285.595=-0.014
mean1646.000
σ0.000
min1646.000
max1646.000
mean2.081-1.883=0.198
σ0.277-0.063=0.214
min1.825-1.824=0.001
max2.421-1.991=0.430
iters=5
new-facts=6402
prior-facts=1
mean1807.708-1807.672=0.036
σ7.001-7.010=-0.009
min1804.349-1804.335=0.014
max1820.215-1820.197=0.018
mean1646.000
σ0.000
min1646.000
max1646.000
mean4.226-4.148=0.078
σ0.169-0.175=-0.006
min4.005-3.995=0.010
max4.397-4.405=-0.008
iters=5
new-facts=6402
prior-facts=6402
mean2070.186-2070.172=0.014
σ0.060-0.007=0.053
min2070.120-2070.163=-0.043
max2070.281-2070.182=0.099
mean1868.200-1849.600=18.600
σ198.856-172.117=26.739
min1646.000
max2096.000-2091.000=5.000
mean4.850-4.463=0.387
σ0.584-0.021=0.562
min4.447-4.426=0.021
max5.829-4.478=1.351

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.178-1.239=-0.061
σ0.271-0.325=-0.053
min0.914-0.918=-0.004
max1.630-1.747=-0.118

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.776-436.779=-0.004
σ572.363-572.362=0.002
min150.588-150.590=-0.001
max1295.321-1295.322=-0.001
mean90.250
σ8.500
min86.000
max103.000
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.531-0.517=0.013
σ0.554-0.534=0.020
min0.252-0.249=0.003
max1.361-1.318=0.043
policies=20
mean1506.185-1506.187=-0.002
σ0.248-0.236=0.012
min1506.024-1506.038=-0.014
max1506.555-1506.539=0.016
mean860.000
σ0.000
min860.000
max860.000
mean1646.000
σ0.000
min1646.000
max1646.000
mean2.529-2.521=0.008
σ0.011-0.006=0.004
min2.519-2.515=0.005
max2.544-2.530=0.015
policies=200
mean15069.452-15069.543=-0.091
σ0.075-0.039=0.036
min15069.396-15069.491=-0.095
max15069.555-15069.576=-0.021
mean8600.000
σ0.000
min8600.000
max8600.000
mean1646.000
σ0.000
min1646.000
max1646.000
mean25.578-25.499=0.079
σ0.098-0.147=-0.049
min25.481-25.354=0.127
max25.687-25.680=0.007