Compare commits

Home / Compare 680ea81f .. ea7b9661

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-70.708=-36.730
σ0.050-0.045=0.005
min33.940-70.677=-36.738
max34.116-70.833=-36.716
mean414.000
σ0.000
min414.000
max414.000
mean0.084-0.159=-0.075
σ0.004-0.005=-0.001
min0.081-0.153=-0.072
max0.091-0.167=-0.076
cache=y
dps=1
iters=10
policies=100
mean23.318-21.411=1.907
σ0.004-0.003=0.001
min23.313-21.408=1.904
max23.326-21.415=1.911
mean414.000
σ0.000
min414.000
max414.000
mean0.063-0.062=0.001
σ0.003-0.003=-0.000
min0.059-0.059=0.000
max0.069-0.067=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.301-1754.932=2.369
σ0.363-0.363=0.000
min1756.728-1754.363=2.365
max1757.889-1755.523=2.367
mean1663.500-1666.100=-2.600
σ623.293-644.080=-20.787
min671.000-677.000=-6.000
max2599.000-2712.000=-113.000
mean2.396-2.794=-0.398
σ0.185-0.168=0.017
min2.251-2.366=-0.114
max2.968-3.014=-0.046

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.445-272.794=53.651
σ0.049-0.007=0.042
min326.358-272.787=53.571
max326.475-272.802=53.674
mean2599.000-2712.000=-113.000
σ0.000
min2599.000-2712.000=-113.000
max2599.000-2712.000=-113.000
mean0.422-0.377=0.045
σ0.001-0.001=-0.000
min0.420-0.375=0.045
max0.424-0.379=0.045
iters=5
new-facts=1
prior-facts=6402
mean1988.617-1933.218=55.399
σ0.008-0.017=-0.009
min1988.610-1933.198=55.412
max1988.629-1933.244=55.385
mean2599.000-2712.000=-113.000
σ0.000
min2599.000-2712.000=-113.000
max2599.000-2712.000=-113.000
mean2.692-3.107=-0.415
σ0.119-0.158=-0.039
min2.596-2.951=-0.356
max2.890-3.363=-0.473
iters=5
new-facts=6402
prior-facts=1
mean4813.340-4756.916=56.423
σ7.812-7.578=0.234
min4809.420-4753.415=56.005
max4827.307-4770.471=56.836
mean2599.000-2712.000=-113.000
σ0.000
min2599.000-2712.000=-113.000
max2599.000-2712.000=-113.000
mean8.923-8.660=0.263
σ0.310-0.438=-0.128
min8.580-8.030=0.550
max9.312-9.108=0.204
iters=5
new-facts=6402
prior-facts=6402
mean5001.010-4944.449=56.561
σ0.024-0.014=0.010
min5000.984-4944.433=56.551
max5001.038-4944.467=56.572
mean3004.600-3008.800=-4.200
σ259.101-336.166=-77.065
min2619.000-2712.000=-93.000
max3312.000-3505.000=-193.000
mean9.721-8.538=1.183
σ0.182-0.241=-0.059
min9.437-8.344=1.093
max9.944-8.947=0.997

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.232-1.043=0.189
σ0.379-0.130=0.249
min0.916-0.927=-0.011
max1.784-1.245=0.538

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.441-468.313=-3.873
σ574.794-574.243=0.552
min177.039-181.191=-4.152
max1326.632-1329.677=-3.045
mean88.250
σ8.500
min84.000
max101.000
mean2599.000-2712.000=-113.000
σ0.000
min2599.000-2712.000=-113.000
max2599.000-2712.000=-113.000
mean0.546-0.569=-0.023
σ0.547-0.571=-0.024
min0.271-0.280=-0.009
max1.366-1.424=-0.058
policies=20
mean1770.755-1812.198=-41.443
σ0.342-0.381=-0.039
min1770.525-1811.949=-41.424
max1771.263-1812.764=-41.502
mean840.000
σ0.000
min840.000
max840.000
mean2599.000-2712.000=-113.000
σ0.000
min2599.000-2712.000=-113.000
max2599.000-2712.000=-113.000
mean2.708-2.815=-0.108
σ0.020-0.020=0.000
min2.692-2.797=-0.105
max2.737-2.838=-0.101
policies=200
mean17714.924-18128.987=-414.063
σ0.537-0.623=-0.086
min17714.632-18128.595=-413.963
max17715.728-18129.916=-414.188
mean8400.000
σ0.000
min8400.000
max8400.000
mean2599.000-2712.000=-113.000
σ0.000
min2599.000-2712.000=-113.000
max2599.000-2712.000=-113.000
mean27.379-28.304=-0.925
σ0.197-0.089=0.108
min27.129-28.191=-1.061
max27.563-28.406=-0.843