Compare commits

Home / Compare 6f58782a .. a1b83ca6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.384-31.040=39.344
σ0.047-0.048=-0.000
min70.356-31.003=39.353
max70.517-31.173=39.344
mean414.000
σ0.000
min414.000
max414.000
mean0.159-0.079=0.079
σ0.003-0.003=-0.000
min0.155-0.076=0.079
max0.165-0.086=0.079
cache=y
dps=1
iters=10
policies=100
mean21.142-21.142=-0.000
σ0.002-0.003=-0.001
min21.137-21.139=-0.001
max21.146-21.146=-0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.064-0.065=-0.001
σ0.002-0.003=-0.002
min0.063-0.063=0.000
max0.069-0.072=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1751.412=0.982
σ0.360-0.362=-0.002
min1751.824-1750.846=0.979
max1752.975-1751.995=0.980
mean1654.400-1654.200=0.200
σ627.581-642.954=-15.373
min618.000-628.000=-10.000
max2769.000-2851.000=-82.000
mean2.806-2.815=-0.010
σ0.190-0.187=0.003
min2.322-2.282=0.041
max2.981-3.071=-0.090

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.139-266.786=3.353
σ0.009-0.006=0.004
min270.131-266.780=3.351
max270.154-266.795=3.359
mean2769.000-2851.000=-82.000
σ0.000
min2769.000-2851.000=-82.000
max2769.000-2851.000=-82.000
mean0.377-0.365=0.012
σ0.004-0.002=0.002
min0.371-0.363=0.009
max0.382-0.367=0.015
iters=5
new-facts=1
prior-facts=6402
mean1930.607-1927.215=3.392
σ0.007-0.003=0.004
min1930.596-1927.211=3.385
max1930.615-1927.218=3.397
mean2769.000-2851.000=-82.000
σ0.000
min2769.000-2851.000=-82.000
max2769.000-2851.000=-82.000
mean2.512-3.031=-0.519
σ0.085-0.115=-0.031
min2.431-2.902=-0.471
max2.654-3.194=-0.541
iters=5
new-facts=6402
prior-facts=1
mean4751.332-4747.715=3.617
σ0.888-0.851=0.037
min4750.819-4747.186=3.633
max4752.914-4749.228=3.687
mean2769.000-2851.000=-82.000
σ0.000
min2769.000-2851.000=-82.000
max2769.000-2851.000=-82.000
mean8.413-8.582=-0.169
σ0.465-0.562=-0.097
min7.741-7.630=0.111
max8.979-9.035=-0.055
iters=5
new-facts=6402
prior-facts=6402
mean4941.699-4938.172=3.527
σ0.144-0.093=0.051
min4941.443-4938.094=3.349
max4941.790-4938.280=3.510
mean3044.400-3077.400=-33.000
σ235.302-239.203=-3.902
min2769.000-2851.000=-82.000
max3371.000-3425.000=-54.000
mean8.680-8.507=0.172
σ0.208-0.189=0.019
min8.394-8.273=0.120
max8.925-8.746=0.179

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.019-1.150=-0.131
σ0.117-0.174=-0.057
min0.940-1.066=-0.126
max1.209-1.461=-0.252

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.371-465.121=1.249
σ575.930-575.764=0.166
min178.400-177.233=1.167
max1330.266-1328.768=1.498
mean84.250-79.750=4.500
σ8.500-7.500=1.000
min80.000-76.000=4.000
max97.000-91.000=6.000
mean2769.000-2851.000=-82.000
σ0.000
min2769.000-2851.000=-82.000
max2769.000-2851.000=-82.000
mean0.448-0.442=0.007
σ0.304-0.309=-0.005
min0.293-0.284=0.009
max0.904-0.905=-0.001
policies=20
mean1784.336-1772.602=11.734
σ0.336-0.342=-0.006
min1784.101-1772.342=11.759
max1784.823-1773.099=11.724
mean800.000-760.000=40.000
σ0.000
min800.000-760.000=40.000
max800.000-760.000=40.000
mean2769.000-2851.000=-82.000
σ0.000
min2769.000-2851.000=-82.000
max2769.000-2851.000=-82.000
mean2.847-2.831=0.016
σ0.128-0.018=0.110
min2.780-2.813=-0.034
max3.040-2.856=0.184
policies=200
mean17849.503-17732.528=116.975
σ0.490-0.425=0.066
min17849.216-17732.083=117.133
max17850.235-17733.096=117.139
mean8000.000-7600.000=400.000
σ0.000
min8000.000-7600.000=400.000
max8000.000-7600.000=400.000
mean2769.000-2851.000=-82.000
σ0.000
min2769.000-2851.000=-82.000
max2769.000-2851.000=-82.000
mean28.008-28.154=-0.146
σ0.113-0.576=-0.463
min27.882-27.518=0.365
max28.156-28.836=-0.681