Compare commits

Home / Compare 2696109e .. 1376dfe7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-35.619=-1.641
σ0.048-0.055=-0.007
min33.947-35.590=-1.643
max34.110-35.774=-1.664
mean413.000-419.000=-6.000
σ0.000
min413.000-419.000=-6.000
max413.000-419.000=-6.000
mean0.082-0.086=-0.004
σ0.005-0.005=0.001
min0.076-0.082=-0.005
max0.092-0.093=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-24.046=-0.729
σ0.001-0.002=-0.001
min23.315-24.043=-0.728
max23.319-24.051=-0.731
mean413.000-419.000=-6.000
σ0.000
min413.000-419.000=-6.000
max413.000-419.000=-6.000
mean0.064-0.064=-0.000
σ0.004-0.004=0.000
min0.059-0.061=-0.002
max0.072-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1756.490=0.812
σ0.364-0.366=-0.001
min1756.729-1755.913=0.816
max1757.891-1757.080=0.811
mean1660.950-1633.800=27.150
σ621.691-592.992=28.699
min669.000-646.000=23.000
max2591.000-2432.000=159.000
mean2.371-2.330=0.040
σ0.139-0.083=0.056
min2.212-2.233=-0.021
max2.695-2.552=0.143

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.438-324.769=1.669
σ0.059-0.046=0.013
min326.333-324.687=1.646
max326.470-324.795=1.676
mean2591.000-2432.000=159.000
σ0.000
min2591.000-2432.000=159.000
max2591.000-2432.000=159.000
mean0.426-0.430=-0.004
σ0.002-0.008=-0.007
min0.425-0.422=0.002
max0.429-0.443=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1988.607-1985.320=3.287
σ0.016-0.014=0.002
min1988.582-1985.301=3.282
max1988.621-1985.334=3.287
mean2591.000-2432.000=159.000
σ0.000
min2591.000-2432.000=159.000
max2591.000-2432.000=159.000
mean2.677-2.664=0.013
σ0.071-0.149=-0.078
min2.578-2.464=0.114
max2.774-2.806=-0.032
iters=5
new-facts=6402
prior-facts=1
mean4813.474-4808.998=4.476
σ7.754-7.715=0.039
min4809.903-4805.079=4.824
max4827.343-4822.789=4.555
mean2591.000-2432.000=159.000
σ0.000
min2591.000-2432.000=159.000
max2591.000-2432.000=159.000
mean8.617-8.834=-0.217
σ0.606-0.430=0.176
min7.965-8.238=-0.274
max9.569-9.367=0.203
iters=5
new-facts=6402
prior-facts=6402
mean5001.008-4996.626=4.382
σ0.019-0.034=-0.014
min5000.985-4996.583=4.403
max5001.025-4996.660=4.365
mean2978.600-2928.600=50.000
σ288.348-411.732=-123.384
min2591.000-2459.000=132.000
max3319.000-3491.000=-172.000
mean9.808-8.495=1.313
σ0.088-0.106=-0.018
min9.713-8.389=1.325
max9.928-8.665=1.263

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.240-1.678=-0.438
σ0.377-0.132=0.244
min0.915-1.510=-0.595
max1.713-1.807=-0.094

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.436-463.202=1.234
σ574.790-574.764=0.026
min177.035-175.811=1.224
max1326.621-1325.347=1.274
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2591.000-2432.000=159.000
σ0.000
min2591.000-2432.000=159.000
max2591.000-2432.000=159.000
mean0.556-0.535=0.021
σ0.561-0.526=0.035
min0.272-0.270=0.001
max1.398-1.324=0.073
policies=20
mean1770.742-1758.491=12.251
σ0.345-0.338=0.007
min1770.519-1758.258=12.261
max1771.255-1758.991=12.264
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2591.000-2432.000=159.000
σ0.000
min2591.000-2432.000=159.000
max2591.000-2432.000=159.000
mean2.725-2.717=0.008
σ0.011-0.016=-0.005
min2.714-2.700=0.014
max2.737-2.736=0.001
policies=200
mean17714.794-17592.143=122.650
σ0.622-0.492=0.130
min17714.356-17591.883=122.472
max17715.712-17592.881=122.831
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2591.000-2432.000=159.000
σ0.000
min2591.000-2432.000=159.000
max2591.000-2432.000=159.000
mean27.583-27.348=0.234
σ0.188-0.152=0.036
min27.410-27.200=0.211
max27.782-27.492=0.290