Compare commits

Home / Compare a2ca8385 .. c8d143d2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.618=-0.001
σ0.054-0.054=-0.001
min35.591-35.589=0.003
max35.770-35.772=-0.002
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.082-0.085=-0.003
σ0.005-0.002=0.003
min0.076-0.083=-0.007
max0.094-0.092=0.002
cache=y
dps=1
iters=10
policies=100
mean24.047-24.046=0.001
σ0.005-0.004=0.001
min24.041-24.042=-0.000
max24.055-24.054=0.001
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.067-0.066=0.001
σ0.005-0.004=0.001
min0.062-0.061=0.001
max0.075-0.071=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.492-1756.490=0.002
σ0.366-0.365=0.001
min1755.915-1755.915=-0.000
max1757.082-1757.082=-0.000
mean1643.000-1655.950=-12.950
σ624.725-639.302=-14.578
min653.000-626.000=27.000
max2830.000-2778.000=52.000
mean2.348-2.356=-0.009
σ0.110-0.119=-0.009
min2.134-2.243=-0.108
max2.624-2.798=-0.174

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.749-324.763=-0.014
σ0.029-0.036=-0.007
min324.701-324.701=0.000
max324.780-324.787=-0.008
mean2830.000-2778.000=52.000
σ0.000
min2830.000-2778.000=52.000
max2830.000-2778.000=52.000
mean0.417-0.419=-0.003
σ0.002-0.009=-0.007
min0.415-0.415=-0.000
max0.419-0.436=-0.017
iters=5
new-facts=1
prior-facts=6402
mean1985.310-1985.325=-0.015
σ0.013-0.010=0.003
min1985.303-1985.313=-0.010
max1985.333-1985.339=-0.006
mean2830.000-2778.000=52.000
σ0.000
min2830.000-2778.000=52.000
max2830.000-2778.000=52.000
mean2.640-2.622=0.018
σ0.081-0.097=-0.016
min2.549-2.541=0.008
max2.737-2.768=-0.031
iters=5
new-facts=6402
prior-facts=1
mean4809.016-4808.973=0.043
σ7.779-7.459=0.320
min4805.013-4805.598=-0.585
max4822.920-4822.315=0.604
mean2830.000-2778.000=52.000
σ0.000
min2830.000-2778.000=52.000
max2830.000-2778.000=52.000
mean8.656-9.023=-0.368
σ0.567-0.273=0.293
min7.836-8.703=-0.867
max9.173-9.346=-0.174
iters=5
new-facts=6402
prior-facts=6402
mean4996.628-4996.633=-0.005
σ0.025-0.016=0.009
min4996.600-4996.615=-0.016
max4996.657-4996.649=0.008
mean3060.800-3031.200=29.600
σ301.024-201.312=99.711
min2830.000-2778.000=52.000
max3522.000-3306.000=216.000
mean8.467-8.604=-0.136
σ0.101-0.162=-0.061
min8.393-8.402=-0.008
max8.645-8.786=-0.141

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.975-0.971=0.005
σ0.066-0.065=0.002
min0.913-0.913=0.000
max1.049-1.043=0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.216-463.208=0.008
σ574.772-574.774=-0.002
min175.820-175.815=0.005
max1325.375-1325.370=0.005
mean86.250
σ8.500
min82.000
max99.000
mean2830.000-2778.000=52.000
σ0.000
min2830.000-2778.000=52.000
max2830.000-2778.000=52.000
mean0.430-0.428=0.002
σ0.294-0.295=-0.001
min0.280-0.278=0.002
max0.872-0.871=0.001
policies=20
mean1758.518-1758.515=0.002
σ0.343-0.357=-0.014
min1758.295-1758.279=0.016
max1759.027-1759.045=-0.018
mean820.000
σ0.000
min820.000
max820.000
mean2830.000-2778.000=52.000
σ0.000
min2830.000-2778.000=52.000
max2830.000-2778.000=52.000
mean2.794-2.780=0.015
σ0.002-0.004=-0.003
min2.792-2.776=0.016
max2.796-2.786=0.010
policies=200
mean17592.213-17592.033=0.179
σ0.466-0.466=0.000
min17591.896-17591.603=0.294
max17592.905-17592.684=0.221
mean8200.000
σ0.000
min8200.000
max8200.000
mean2830.000-2778.000=52.000
σ0.000
min2830.000-2778.000=52.000
max2830.000-2778.000=52.000
mean27.839-27.469=0.370
σ0.365-0.124=0.241
min27.466-27.293=0.174
max28.247-27.572=0.675