Compare commits

Home / Compare 02a3071c .. 9008dfb4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.799=0.000
σ0.106-0.108=-0.002
min35.750-35.753=-0.003
max36.099-36.105=-0.006
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.077-0.073=0.004
σ0.004-0.004=-0.001
min0.075-0.068=0.006
max0.084-0.080=0.004
cache=y
dps=1
iters=10
policies=100
mean26.065-26.065=-0.000
σ0.003-0.002=0.001
min26.060-26.062=-0.002
max26.069-26.069=0.001
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.062-0.061=0.002
σ0.002-0.003=-0.000
min0.060-0.059=0.001
max0.068-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.923-1755.921=0.003
σ0.368-0.370=-0.002
min1755.352-1755.352=0.000
max1756.513-1756.518=-0.006
mean1645.050-1666.200=-21.150
σ623.021-630.062=-7.042
min611.000-665.000=-54.000
max2650.000-2621.000=29.000
mean2.850-2.819=0.031
σ0.182-0.180=0.002
min2.303-2.290=0.013
max3.141-3.111=0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.195-277.193=0.002
σ0.005-0.004=0.002
min277.188-277.190=-0.002
max277.202-277.197=0.005
mean2650.000-2621.000=29.000
σ0.000
min2650.000-2621.000=29.000
max2650.000-2621.000=29.000
mean0.397-0.396=0.001
σ0.008-0.004=0.003
min0.392-0.393=-0.000
max0.411-0.403=0.007
iters=5
new-facts=1
prior-facts=6402
mean2174.430-2174.432=-0.002
σ0.005-0.012=-0.007
min2174.425-2174.415=0.010
max2174.436-2174.449=-0.013
mean2650.000-2621.000=29.000
σ0.000
min2650.000-2621.000=29.000
max2650.000-2621.000=29.000
mean3.055-3.050=0.005
σ0.146-0.225=-0.079
min2.809-2.830=-0.020
max3.199-3.333=-0.134
iters=5
new-facts=6402
prior-facts=1
mean5052.638-5052.580=0.059
σ0.962-0.970=-0.008
min5052.036-5052.020=0.016
max5054.344-5054.305=0.039
mean2650.000-2621.000=29.000
σ0.000
min2650.000-2621.000=29.000
max2650.000-2621.000=29.000
mean8.698-9.005=-0.308
σ0.476-0.328=0.148
min8.257-8.538=-0.281
max9.409-9.336=0.073
iters=5
new-facts=6402
prior-facts=6402
mean5188.420-5188.422=-0.002
σ0.091-0.095=-0.004
min5188.349-5188.335=0.014
max5188.521-5188.525=-0.003
mean3233.000-3269.800=-36.800
σ385.841-386.731=-0.889
min2696.000-2729.000=-33.000
max3720.000-3741.000=-21.000
mean8.992-9.225=-0.234
σ0.407-0.531=-0.124
min8.725-8.729=-0.003
max9.701-9.795=-0.094

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.204-1.307=-0.103
σ0.294-0.332=-0.039
min0.950-0.940=0.010
max1.702-1.783=-0.082

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.854-464.856=-0.001
σ572.657-572.660=-0.003
min178.523-178.520=0.003
max1323.840-1323.846=-0.006
mean79.500
σ7.000
min76.000
max90.000
mean2650.000-2621.000=29.000
σ0.000
min2650.000-2621.000=29.000
max2650.000-2621.000=29.000
mean0.583-0.549=0.035
σ0.587-0.534=0.053
min0.283-0.279=0.004
max1.464-1.350=0.114
policies=20
mean1785.488-1785.488=-0.001
σ0.343-0.347=-0.004
min1785.260-1785.259=0.001
max1785.997-1786.004=-0.007
mean760.000
σ0.000
min760.000
max760.000
mean2650.000-2621.000=29.000
σ0.000
min2650.000-2621.000=29.000
max2650.000-2621.000=29.000
mean2.792-2.807=-0.015
σ0.012-0.004=0.007
min2.780-2.801=-0.021
max2.806-2.811=-0.005
policies=200
mean17861.546-17861.430=0.116
σ0.455-0.617=-0.163
min17861.268-17861.094=0.174
max17862.224-17862.355=-0.131
mean7600.000
σ0.000
min7600.000
max7600.000
mean2650.000-2621.000=29.000
σ0.000
min2650.000-2621.000=29.000
max2650.000-2621.000=29.000
mean28.287-28.358=-0.071
σ0.149-0.208=-0.059
min28.127-28.147=-0.020
max28.427-28.636=-0.209