Compare commits

Home / Compare 4aec1c10 .. 82fc0287

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.654-53.655=-0.002
σ0.366-0.370=-0.004
min53.514-53.513=0.001
max54.695-54.708=-0.013
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.139-0.140=-0.001
σ0.004-0.004=-0.001
min0.135-0.136=-0.001
max0.146-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean42.982-42.982=-0.000
σ0.005-0.006=-0.001
min42.976-42.975=0.000
max42.988-42.992=-0.004
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.120-0.121=-0.001
σ0.002-0.003=-0.001
min0.118-0.119=-0.000
max0.126-0.127=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1009.306-1009.024=0.282
σ1.168-1.242=-0.073
min1008.736-1008.433=0.304
max1014.198-1014.234=-0.036
mean1065.900-1058.200=7.700
σ319.603-323.014=-3.411
min602.000-560.000=42.000
max1630.000-1624.000=6.000
mean1.541-1.538=0.003
σ0.051-0.075=-0.023
min1.480-1.473=0.007
max1.658-1.770=-0.112

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.369-329.562=-35.193
σ0.216-0.232=-0.016
min294.247-329.376=-35.129
max294.965-330.174=-35.209
mean2022.000-2135.000=-113.000
σ0.000
min2022.000-2135.000=-113.000
max2022.000-2135.000=-113.000
mean0.586-0.751=-0.165
σ0.030-0.034=-0.005
min0.535-0.713=-0.178
max0.620-0.829=-0.209

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean280.335-280.064=0.271
σ0.014-0.012=0.002
min280.310-280.044=0.266
max280.347-280.073=0.274
mean1630.000-1624.000=6.000
σ0.000
min1630.000-1624.000=6.000
max1630.000-1624.000=6.000
mean0.388-0.385=0.002
σ0.007-0.006=0.001
min0.382-0.381=0.001
max0.398-0.392=0.005
iters=5
new-facts=1
prior-facts=6402
mean1302.580-1302.380=0.199
σ0.101-0.047=0.053
min1302.522-1302.310=0.213
max1302.759-1302.432=0.327
mean1630.000-1624.000=6.000
σ0.000
min1630.000-1624.000=6.000
max1630.000-1624.000=6.000
mean1.969-1.973=-0.004
σ0.125-0.131=-0.006
min1.853-1.860=-0.006
max2.121-2.194=-0.073
iters=5
new-facts=6402
prior-facts=1
mean1540.923-1722.595=-181.672
σ6.830-6.871=-0.041
min1537.619-1719.415=-181.795
max1553.134-1734.882=-181.748
mean1630.000-1624.000=6.000
σ0.000
min1630.000-1624.000=6.000
max1630.000-1624.000=6.000
mean2.268-2.990=-0.722
σ0.169-0.409=-0.240
min2.168-2.574=-0.406
max2.569-3.581=-1.012
iters=5
new-facts=6402
prior-facts=6402
mean1870.407-1985.286=-114.880
σ0.015-0.014=0.001
min1870.390-1985.267=-114.876
max1870.423-1985.304=-114.881
mean1775.400-1870.400=-95.000
σ168.620-215.115=-46.494
min1630.000-1624.000=6.000
max2022.000-2135.000=-113.000
mean2.934-3.332=-0.397
σ0.053-0.084=-0.031
min2.881-3.211=-0.329
max3.010-3.433=-0.423

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.227-1.213=0.014
σ0.309-0.332=-0.022
min0.917-0.908=0.009
max1.732-1.768=-0.036

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.678-441.092=-0.414
σ573.413-573.037=0.377
min153.967-154.565=-0.598
max1300.798-1300.647=0.151
mean96.250-94.250=2.000
σ8.500
min92.000-90.000=2.000
max109.000-107.000=2.000
mean1630.000-1624.000=6.000
σ0.000
min1630.000-1624.000=6.000
max1630.000-1624.000=6.000
mean0.570-0.537=0.033
σ0.593-0.554=0.039
min0.273-0.253=0.020
max1.460-1.368=0.091
policies=20
mean1539.920-1545.922=-6.002
σ0.324-0.323=0.001
min1539.731-1545.750=-6.019
max1540.405-1546.407=-6.001
mean920.000-900.000=20.000
σ0.000
min920.000-900.000=20.000
max920.000-900.000=20.000
mean1630.000-1624.000=6.000
σ0.000
min1630.000-1624.000=6.000
max1630.000-1624.000=6.000
mean2.619-2.633=-0.014
σ0.042-0.012=0.030
min2.594-2.619=-0.025
max2.682-2.645=0.037
policies=200
mean15407.053-15467.033=-59.980
σ0.080-0.170=-0.090
min15406.984-15466.857=-59.873
max15407.164-15467.206=-60.042
mean9200.000-9000.000=200.000
σ0.000
min9200.000-9000.000=200.000
max9200.000-9000.000=200.000
mean1630.000-1624.000=6.000
σ0.000
min1630.000-1624.000=6.000
max1630.000-1624.000=6.000
mean26.202-26.748=-0.545
σ0.169-0.289=-0.119
min26.001-26.486=-0.485
max26.349-27.154=-0.804