Compare commits

Home / Compare 7dd038d0 .. 724ef584

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.966-35.956=0.010
σ0.103-0.102=0.000
min35.922-35.905=0.017
max36.256-36.245=0.012
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.075-0.076=-0.001
σ0.005-0.004=0.001
min0.071-0.074=-0.003
max0.083-0.083=0.000
cache=y
dps=1
iters=10
policies=100
mean26.209-26.203=0.006
σ0.004-0.005=-0.001
min26.204-26.193=0.011
max26.216-26.208=0.008
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.061-0.061=0.000
σ0.003-0.003=0.000
min0.059-0.059=0.000
max0.069-0.068=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.312-1756.305=0.007
σ0.367-0.368=-0.001
min1755.738-1755.729=0.008
max1756.909-1756.897=0.012
mean1661.400-1655.050=6.350
σ637.290-630.068=7.222
min615.000-619.000=-4.000
max2695.000-2674.000=21.000
mean2.381-2.370=0.011
σ0.168-0.079=0.088
min2.212-2.257=-0.045
max3.011-2.561=0.449

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.841-278.824=0.017
σ0.010-0.007=0.003
min278.826-278.812=0.014
max278.852-278.831=0.021
mean2695.000-2674.000=21.000
σ0.000
min2695.000-2674.000=21.000
max2695.000-2674.000=21.000
mean0.415-0.412=0.003
σ0.014-0.004=0.009
min0.406-0.407=-0.001
max0.439-0.419=0.019
iters=5
new-facts=1
prior-facts=6402
mean2268.899-2268.887=0.012
σ0.014-0.007=0.007
min2268.876-2268.878=-0.002
max2268.913-2268.893=0.020
mean2695.000-2674.000=21.000
σ0.000
min2695.000-2674.000=21.000
max2695.000-2674.000=21.000
mean2.911-2.946=-0.036
σ0.141-0.092=0.049
min2.742-2.881=-0.139
max3.132-3.105=0.027
iters=5
new-facts=6402
prior-facts=1
mean4954.252-4954.156=0.097
σ0.919-0.594=0.325
min4953.743-4953.836=-0.093
max4955.889-4955.215=0.674
mean2695.000-2674.000=21.000
σ0.000
min2695.000-2674.000=21.000
max2695.000-2674.000=21.000
mean8.157-7.947=0.210
σ0.515-0.239=0.275
min7.804-7.708=0.097
max9.011-8.342=0.669
iters=5
new-facts=6402
prior-facts=6402
mean5168.747-5168.826=-0.079
σ0.124-0.092=0.031
min5168.557-5168.722=-0.165
max5168.903-5168.908=-0.004
mean3398.400-3363.200=35.200
σ491.711-467.063=24.648
min2807.000-2736.000=71.000
max4072.000-3969.000=103.000
mean9.297-9.089=0.208
σ0.267-0.492=-0.225
min9.028-8.412=0.615
max9.616-9.562=0.053

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.184-1.091=0.093
σ0.375-0.265=0.110
min0.952-0.933=0.018
max1.847-1.556=0.291

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.359-459.818=0.541
σ572.651-571.583=1.068
min174.026-174.017=0.009
max1319.335-1317.193=2.143
mean79.500
σ7.000
min76.000
max90.000
mean2695.000-2674.000=21.000
σ0.000
min2695.000-2674.000=21.000
max2695.000-2674.000=21.000
mean0.556-0.533=0.023
σ0.577-0.532=0.045
min0.262-0.263=-0.001
max1.422-1.332=0.090
policies=20
mean1740.484-1740.426=0.058
σ0.323-0.335=-0.012
min1740.280-1740.217=0.063
max1740.965-1740.926=0.039
mean760.000
σ0.000
min760.000
max760.000
mean2695.000-2674.000=21.000
σ0.000
min2695.000-2674.000=21.000
max2695.000-2674.000=21.000
mean2.689-2.700=-0.012
σ0.011-0.026=-0.015
min2.674-2.665=0.010
max2.701-2.728=-0.027
policies=200
mean17411.842-17411.276=0.565
σ0.444-0.461=-0.017
min17411.474-17411.022=0.452
max17412.487-17411.967=0.520
mean7600.000
σ0.000
min7600.000
max7600.000
mean2695.000-2674.000=21.000
σ0.000
min2695.000-2674.000=21.000
max2695.000-2674.000=21.000
mean27.015-27.096=-0.082
σ0.088-0.125=-0.037
min26.938-27.001=-0.063
max27.139-27.281=-0.142