Compare commits

Home / Compare e3a65901 .. 6323ff38

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.046-31.047=-0.000
σ0.049-0.050=-0.001
min31.008-31.008=-0.001
max31.182-31.186=-0.004
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.080-0.079=0.001
σ0.004-0.003=0.001
min0.077-0.076=0.001
max0.087-0.086=0.002
cache=y
dps=1
iters=10
policies=100
mean21.146-21.145=0.000
σ0.003-0.003=0.000
min21.139-21.140=-0.001
max21.149-21.150=-0.001
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.065-0.063=0.002
σ0.004-0.005=-0.001
min0.061-0.059=0.002
max0.074-0.072=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.410=0.000
σ0.362-0.361=0.000
min1750.837-1750.836=0.001
max1751.992-1751.981=0.011
mean1641.450-1648.500=-7.050
σ618.321-631.019=-12.698
min628.000-626.000=2.000
max2480.000-2849.000=-369.000
mean2.799-2.814=-0.015
σ0.110-0.097=0.013
min2.496-2.595=-0.099
max2.962-2.949=0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.779-266.782=-0.003
σ0.010-0.010=-0.000
min266.765-266.770=-0.006
max266.788-266.792=-0.004
mean2480.000-2849.000=-369.000
σ0.000
min2480.000-2849.000=-369.000
max2480.000-2849.000=-369.000
mean0.369-0.368=0.001
σ0.010-0.009=0.001
min0.363-0.363=-0.000
max0.387-0.384=0.003
iters=5
new-facts=1
prior-facts=6402
mean1927.209-1927.210=-0.001
σ0.009-0.008=0.000
min1927.200-1927.200=-0.001
max1927.219-1927.221=-0.002
mean2480.000-2849.000=-369.000
σ0.000
min2480.000-2849.000=-369.000
max2480.000-2849.000=-369.000
mean2.973-2.992=-0.020
σ0.084-0.080=0.004
min2.879-2.902=-0.023
max3.092-3.106=-0.014
iters=5
new-facts=6402
prior-facts=1
mean4747.768-4747.686=0.081
σ0.846-0.985=-0.140
min4747.259-4746.633=0.625
max4749.268-4749.314=-0.046
mean2480.000-2849.000=-369.000
σ0.000
min2480.000-2849.000=-369.000
max2480.000-2849.000=-369.000
mean8.346-8.019=0.327
σ0.283-0.518=-0.235
min8.068-7.625=0.443
max8.702-8.906=-0.204
iters=5
new-facts=6402
prior-facts=6402
mean4938.199-4938.200=-0.001
σ0.092-0.092=-0.001
min4938.091-4938.099=-0.008
max4938.274-4938.276=-0.002
mean2957.600-3088.400=-130.800
σ417.961-313.340=104.621
min2480.000-2849.000=-369.000
max3522.000-3569.000=-47.000
mean8.546-8.527=0.019
σ0.267-0.179=0.088
min8.289-8.322=-0.034
max8.969-8.731=0.238

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.786-1.061=0.725
σ0.126-0.129=-0.003
min1.566-0.946=0.621
max1.866-1.263=0.603

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.110-465.118=-0.008
σ575.754-575.755=-0.001
min177.229-177.238=-0.009
max1328.741-1328.751=-0.010
mean79.750
σ7.500
min76.000
max91.000
mean2480.000-2849.000=-369.000
σ0.000
min2480.000-2849.000=-369.000
max2480.000-2849.000=-369.000
mean0.551-0.440=0.111
σ0.538-0.308=0.231
min0.278-0.282=-0.004
max1.359-0.902=0.457
policies=20
mean1772.555-1772.604=-0.049
σ0.334-0.335=-0.001
min1772.335-1772.351=-0.017
max1773.052-1773.094=-0.042
mean760.000
σ0.000
min760.000
max760.000
mean2480.000-2849.000=-369.000
σ0.000
min2480.000-2849.000=-369.000
max2480.000-2849.000=-369.000
mean2.745-2.819=-0.074
σ0.013-0.027=-0.014
min2.733-2.781=-0.048
max2.757-2.839=-0.082
policies=200
mean17732.203-17732.244=-0.041
σ0.452-0.534=-0.082
min17731.891-17731.799=0.092
max17732.860-17732.996=-0.136
mean7600.000
σ0.000
min7600.000
max7600.000
mean2480.000-2849.000=-369.000
σ0.000
min2480.000-2849.000=-369.000
max2480.000-2849.000=-369.000
mean27.681-28.167=-0.486
σ0.089-0.665=-0.576
min27.599-27.478=0.121
max27.797-28.908=-1.111