Compare commits

Home / Compare 118a983c .. b08eb184

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.653-53.653=0.001
σ0.366-0.367=-0.001
min53.514-53.514=0.000
max54.695-54.698=-0.002
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.139-0.138=0.001
σ0.004-0.003=0.000
min0.135-0.134=0.001
max0.145-0.144=0.001
cache=y
dps=1
iters=10
policies=100
mean42.980-42.980=-0.000
σ0.007-0.006=0.001
min42.969-42.972=-0.002
max42.992-42.992=0.000
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.120-0.119=0.001
σ0.004-0.005=-0.000
min0.113-0.113=-0.001
max0.127-0.126=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.973-1013.970=0.004
σ1.180-1.201=-0.021
min1013.431-1013.421=0.009
max1018.912-1018.998=-0.086
mean1052.300-1048.150=4.150
σ315.277-318.884=-3.607
min601.000-555.000=46.000
max1655.000-1653.000=2.000
mean1.634-1.657=-0.023
σ0.094-0.092=0.002
min1.560-1.561=-0.001
max1.922-1.862=0.060

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.331-299.051=0.281
σ0.217-0.200=0.017
min299.134-298.861=0.273
max299.882-299.566=0.316
mean1960.000-1967.000=-7.000
σ0.000
min1960.000-1967.000=-7.000
max1960.000-1967.000=-7.000
mean0.567-0.574=-0.006
σ0.026-0.019=0.006
min0.522-0.553=-0.031
max0.599-0.600=-0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.683-294.674=0.009
σ0.009-0.015=-0.006
min294.669-294.653=0.016
max294.694-294.694=-0.000
mean1655.000-1653.000=2.000
σ0.000
min1655.000-1653.000=2.000
max1655.000-1653.000=2.000
mean0.385-0.386=-0.001
σ0.006-0.009=-0.003
min0.381-0.379=0.002
max0.396-0.397=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1316.969-1316.989=-0.020
σ0.071-0.059=0.012
min1316.912-1316.903=0.009
max1317.075-1317.043=0.032
mean1655.000-1653.000=2.000
σ0.000
min1655.000-1653.000=2.000
max1655.000-1653.000=2.000
mean1.943-2.049=-0.106
σ0.062-0.200=-0.138
min1.848-1.848=-0.000
max2.013-2.326=-0.313
iters=5
new-facts=6402
prior-facts=1
mean1555.293-1555.316=-0.023
σ6.884-6.818=0.066
min1552.013-1552.074=-0.061
max1567.602-1567.509=0.093
mean1655.000-1653.000=2.000
σ0.000
min1655.000-1653.000=2.000
max1655.000-1653.000=2.000
mean2.317-2.273=0.044
σ0.236-0.100=0.137
min2.170-2.178=-0.009
max2.732-2.430=0.302
iters=5
new-facts=6402
prior-facts=6402
mean1884.777-1884.773=0.004
σ0.026-0.031=-0.005
min1884.757-1884.754=0.003
max1884.821-1884.828=-0.006
mean1775.600-1771.800=3.800
σ127.186-129.643=-2.457
min1655.000-1653.000=2.000
max1960.000-1967.000=-7.000
mean2.937-3.028=-0.091
σ0.066-0.168=-0.102
min2.874-2.878=-0.004
max3.034-3.274=-0.240

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.167-1.196=-0.029
σ0.357-0.335=0.022
min0.920-0.902=0.018
max1.762-1.724=0.039

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.680-440.488=0.191
σ573.413-573.034=0.379
min153.971-153.967=0.005
max1300.799-1300.039=0.760
mean96.250
σ8.500
min92.000
max109.000
mean1655.000-1653.000=2.000
σ0.000
min1655.000-1653.000=2.000
max1655.000-1653.000=2.000
mean0.539-0.542=-0.002
σ0.547-0.563=-0.016
min0.259-0.258=0.001
max1.360-1.386=-0.027
policies=20
mean1539.920-1539.848=0.072
σ0.306-0.305=0.001
min1539.761-1539.667=0.095
max1540.378-1540.304=0.074
mean920.000
σ0.000
min920.000
max920.000
mean1655.000-1653.000=2.000
σ0.000
min1655.000-1653.000=2.000
max1655.000-1653.000=2.000
mean2.590-2.584=0.007
σ0.009-0.019=-0.010
min2.580-2.560=0.021
max2.601-2.600=0.001
policies=200
mean15406.963-15406.396=0.567
σ0.120-0.184=-0.063
min15406.801-15406.214=0.587
max15407.061-15406.652=0.409
mean9200.000
σ0.000
min9200.000
max9200.000
mean1655.000-1653.000=2.000
σ0.000
min1655.000-1653.000=2.000
max1655.000-1653.000=2.000
mean26.249-26.134=0.115
σ0.132-0.138=-0.006
min26.123-25.980=0.143
max26.435-26.272=0.163