Compare commits

Home / Compare f138159b .. 9590171b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.798=0.000
σ0.107-0.108=-0.001
min35.753-35.751=0.003
max36.101-36.104=-0.002
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.073-0.076=-0.003
σ0.005-0.004=0.000
min0.069-0.073=-0.004
max0.081-0.084=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.065-26.064=0.001
σ0.003-0.004=-0.001
min26.061-26.058=0.004
max26.069-26.072=-0.004
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.061-0.061=0.001
σ0.003-0.002=0.001
min0.059-0.058=0.001
max0.069-0.065=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.923-1755.926=-0.002
σ0.366-0.365=0.002
min1755.350-1755.350=0.001
max1756.515-1756.516=-0.001
mean1666.700-1652.050=14.650
σ628.048-647.181=-19.133
min672.000-612.000=60.000
max2652.000-2737.000=-85.000
mean2.791-2.902=-0.111
σ0.185-0.122=0.063
min2.301-2.613=-0.311
max3.089-3.079=0.010

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.196-277.194=0.002
σ0.008-0.004=0.003
min277.188-277.189=-0.002
max277.204-277.198=0.005
mean2652.000-2737.000=-85.000
σ0.000
min2652.000-2737.000=-85.000
max2652.000-2737.000=-85.000
mean0.401-0.394=0.007
σ0.012-0.002=0.009
min0.393-0.390=0.002
max0.418-0.396=0.023
iters=5
new-facts=1
prior-facts=6402
mean2174.447-2174.428=0.019
σ0.015-0.036=-0.021
min2174.436-2174.373=0.064
max2174.472-2174.469=0.003
mean2652.000-2737.000=-85.000
σ0.000
min2652.000-2737.000=-85.000
max2652.000-2737.000=-85.000
mean2.973-2.795=0.178
σ0.148-0.077=0.071
min2.792-2.709=0.083
max3.172-2.875=0.298
iters=5
new-facts=6402
prior-facts=1
mean5052.659-5052.394=0.265
σ1.030-1.206=-0.176
min5052.013-5051.080=0.933
max5054.484-5054.373=0.110
mean2652.000-2737.000=-85.000
σ0.000
min2652.000-2737.000=-85.000
max2652.000-2737.000=-85.000
mean8.743-9.145=-0.402
σ0.885-0.442=0.443
min8.035-8.503=-0.468
max10.174-9.690=0.484
iters=5
new-facts=6402
prior-facts=6402
mean5188.427-5188.402=0.026
σ0.086-0.117=-0.031
min5188.354-5188.249=0.105
max5188.529-5188.526=0.002
mean3221.600-3241.600=-20.000
σ389.487-455.165=-65.679
min2660.000-2737.000=-77.000
max3687.000-3866.000=-179.000
mean8.983-8.753=0.230
σ0.386-0.115=0.271
min8.690-8.614=0.076
max9.641-8.932=0.709

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.244-1.110=0.133
σ0.347-0.256=0.091
min0.950-0.953=-0.003
max1.834-1.545=0.289

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.861-464.852=0.009
σ572.661-572.660=0.001
min178.525-178.517=0.008
max1323.852-1323.842=0.010
mean79.500
σ7.000
min76.000
max90.000
mean2652.000-2737.000=-85.000
σ0.000
min2652.000-2737.000=-85.000
max2652.000-2737.000=-85.000
mean0.577-0.579=-0.002
σ0.579-0.588=-0.010
min0.286-0.283=0.003
max1.445-1.461=-0.017
policies=20
mean1785.485-1785.463=0.022
σ0.347-0.346=0.002
min1785.260-1785.237=0.023
max1786.002-1785.976=0.026
mean760.000
σ0.000
min760.000
max760.000
mean2652.000-2737.000=-85.000
σ0.000
min2652.000-2737.000=-85.000
max2652.000-2737.000=-85.000
mean2.796-2.800=-0.004
σ0.022-0.005=0.017
min2.765-2.792=-0.027
max2.812-2.803=0.009
policies=200
mean17861.527-17861.467=0.060
σ0.478-0.542=-0.064
min17861.259-17861.037=0.222
max17862.244-17862.262=-0.018
mean7600.000
σ0.000
min7600.000
max7600.000
mean2652.000-2737.000=-85.000
σ0.000
min2652.000-2737.000=-85.000
max2652.000-2737.000=-85.000
mean28.208-28.266=-0.058
σ0.121-0.165=-0.044
min28.098-28.058=0.040
max28.342-28.453=-0.111