Compare commits

Home / Compare f794b19d .. 699f919c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-35.617=-1.639
σ0.050-0.056=-0.006
min33.946-35.587=-1.640
max34.118-35.775=-1.657
mean416.600-415.000=1.600
σ0.516-0.000=0.516
min416.000-415.000=1.000
max417.000-415.000=2.000
mean0.081-0.086=-0.005
σ0.004-0.005=-0.000
min0.076-0.083=-0.007
max0.088-0.095=-0.007
cache=y
dps=1
iters=10
policies=100
mean23.318-24.047=-0.729
σ0.003-0.003=-0.000
min23.313-24.042=-0.729
max23.321-24.052=-0.731
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.064-0.067=-0.003
σ0.004-0.005=-0.001
min0.059-0.062=-0.003
max0.072-0.077=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.492-1756.491=1.002
σ0.364-0.365=-0.001
min1756.919-1755.915=1.004
max1758.080-1757.078=1.003
mean1664.750-1628.050=36.700
σ625.149-593.693=31.455
min673.000-660.000=13.000
max2607.000-2428.000=179.000
mean2.398-2.340=0.058
σ0.110-0.090=0.019
min2.290-2.176=0.114
max2.761-2.528=0.234

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.629-324.771=1.859
σ0.060-0.037=0.023
min326.523-324.705=1.818
max326.661-324.790=1.871
mean2607.000-2428.000=179.000
σ0.000
min2607.000-2428.000=179.000
max2607.000-2428.000=179.000
mean0.427-0.419=0.009
σ0.004-0.003=0.001
min0.425-0.415=0.010
max0.434-0.421=0.013
iters=5
new-facts=1
prior-facts=6402
mean1988.796-1985.324=3.472
σ0.016-0.013=0.003
min1988.778-1985.309=3.470
max1988.812-1985.336=3.476
mean2607.000-2428.000=179.000
σ0.000
min2607.000-2428.000=179.000
max2607.000-2428.000=179.000
mean2.722-2.630=0.093
σ0.103-0.141=-0.038
min2.617-2.531=0.086
max2.885-2.875=0.010
iters=5
new-facts=6402
prior-facts=1
mean4813.551-4808.879=4.673
σ7.768-7.787=-0.019
min4809.547-4804.637=4.910
max4827.434-4822.786=4.649
mean2607.000-2428.000=179.000
σ0.000
min2607.000-2428.000=179.000
max2607.000-2428.000=179.000
mean8.685-9.028=-0.343
σ0.583-0.244=0.340
min7.711-8.594=-0.883
max9.221-9.173=0.048
iters=5
new-facts=6402
prior-facts=6402
mean5001.201-4996.627=4.574
σ0.027-0.016=0.011
min5001.171-4996.606=4.565
max5001.230-4996.643=4.587
mean2949.600-2953.400=-3.800
σ257.357-439.441=-182.084
min2607.000-2434.000=173.000
max3290.000-3545.000=-255.000
mean9.762-8.576=1.186
σ0.285-0.214=0.071
min9.353-8.369=0.984
max10.046-8.866=1.180

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.214-1.782=-0.568
σ0.400-0.075=0.325
min0.920-1.660=-0.740
max1.763-1.842=-0.078

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.629-463.200=1.429
σ574.780-574.760=0.021
min177.235-175.817=1.418
max1326.799-1325.339=1.460
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2607.000-2428.000=179.000
σ0.000
min2607.000-2428.000=179.000
max2607.000-2428.000=179.000
mean0.554-0.550=0.005
σ0.562-0.548=0.014
min0.271-0.273=-0.002
max1.398-1.372=0.026
policies=20
mean1772.645-1758.476=14.169
σ0.357-0.341=0.017
min1772.412-1758.254=14.158
max1773.176-1758.982=14.194
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2607.000-2428.000=179.000
σ0.000
min2607.000-2428.000=179.000
max2607.000-2428.000=179.000
mean2.732-2.721=0.011
σ0.008-0.026=-0.018
min2.724-2.692=0.032
max2.741-2.755=-0.014
policies=200
mean17733.866-17592.152=141.714
σ0.552-0.515=0.037
min17733.414-17591.871=141.543
max17734.672-17592.923=141.748
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2607.000-2428.000=179.000
σ0.000
min2607.000-2428.000=179.000
max2607.000-2428.000=179.000
mean27.486-27.541=-0.055
σ0.140-0.151=-0.012
min27.353-27.347=0.006
max27.652-27.672=-0.019