Compare commits

Home / Compare e327934e .. 5ef5dc9f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.798=0.001
σ0.108-0.106=0.002
min35.751-35.749=0.001
max36.106-36.100=0.006
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.076-0.076=0.000
σ0.003-0.004=-0.001
min0.074-0.072=0.002
max0.082-0.084=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.065-26.065=-0.000
σ0.004-0.004=0.001
min26.054-26.059=-0.004
max26.070-26.071=-0.000
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.061-0.061=0.001
σ0.003-0.002=0.001
min0.060-0.059=0.001
max0.070-0.068=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.921-1755.924=-0.003
σ0.366-0.365=0.001
min1755.352-1755.348=0.004
max1756.497-1756.512=-0.015
mean1668.250-1651.550=16.700
σ627.657-624.431=3.226
min676.000-633.000=43.000
max2664.000-2662.000=2.000
mean2.792-2.872=-0.080
σ0.193-0.101=0.092
min2.283-2.670=-0.387
max3.008-3.124=-0.116

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.195-277.195=0.000
σ0.006-0.004=0.001
min277.188-277.191=-0.003
max277.204-277.202=0.002
mean2664.000-2662.000=2.000
σ0.000
min2664.000-2662.000=2.000
max2664.000-2662.000=2.000
mean0.398-0.393=0.005
σ0.011-0.001=0.009
min0.390-0.392=-0.002
max0.414-0.395=0.019
iters=5
new-facts=1
prior-facts=6402
mean2174.442-2174.442=-0.000
σ0.017-0.038=-0.022
min2174.428-2174.374=0.053
max2174.469-2174.470=-0.002
mean2664.000-2662.000=2.000
σ0.000
min2664.000-2662.000=2.000
max2664.000-2662.000=2.000
mean2.982-3.078=-0.097
σ0.169-0.234=-0.065
min2.709-2.782=-0.073
max3.153-3.362=-0.209
iters=5
new-facts=6402
prior-facts=1
mean5052.624-5052.482=0.142
σ0.980-1.099=-0.118
min5052.017-5051.712=0.305
max5054.363-5054.417=-0.055
mean2664.000-2662.000=2.000
σ0.000
min2664.000-2662.000=2.000
max2664.000-2662.000=2.000
mean8.684-9.132=-0.448
σ0.611-0.594=0.017
min8.095-8.239=-0.145
max9.589-9.883=-0.294
iters=5
new-facts=6402
prior-facts=6402
mean5188.430-5188.358=0.072
σ0.090-0.209=-0.119
min5188.345-5188.011=0.335
max5188.527-5188.524=0.004
mean3220.800-3226.400=-5.600
σ384.962-385.954=-0.992
min2667.000-2687.000=-20.000
max3688.000-3710.000=-22.000
mean8.948-8.906=0.042
σ0.284-0.282=0.002
min8.712-8.680=0.032
max9.412-9.340=0.072

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.238-1.207=0.031
σ0.348-0.206=0.142
min0.956-1.068=-0.112
max1.831-1.550=0.281

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.856-464.852=0.003
σ572.660-572.656=0.003
min178.523-178.520=0.003
max1323.845-1323.837=0.008
mean79.500
σ7.000
min76.000
max90.000
mean2664.000-2662.000=2.000
σ0.000
min2664.000-2662.000=2.000
max2664.000-2662.000=2.000
mean0.552-0.538=0.014
σ0.526-0.498=0.028
min0.281-0.282=-0.001
max1.340-1.285=0.055
policies=20
mean1785.461-1785.469=-0.009
σ0.346-0.351=-0.005
min1785.228-1785.239=-0.012
max1785.973-1785.991=-0.018
mean760.000
σ0.000
min760.000
max760.000
mean2664.000-2662.000=2.000
σ0.000
min2664.000-2662.000=2.000
max2664.000-2662.000=2.000
mean2.785-2.788=-0.003
σ0.012-0.022=-0.010
min2.773-2.759=0.014
max2.797-2.808=-0.011
policies=200
mean17861.450-17861.419=0.031
σ0.524-0.465=0.059
min17861.048-17861.043=0.004
max17862.219-17862.096=0.124
mean7600.000
σ0.000
min7600.000
max7600.000
mean2664.000-2662.000=2.000
σ0.000
min2664.000-2662.000=2.000
max2664.000-2662.000=2.000
mean28.223-28.248=-0.025
σ0.121-0.131=-0.010
min28.125-28.067=0.058
max28.382-28.381=0.001