Compare commits

Home / Compare 31054b0d .. e7e963c3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.795-35.795=0.000
σ0.109-0.108=0.001
min35.751-35.752=-0.001
max36.105-36.102=0.003
mean417.900-413.000=4.900
σ0.316-0.000=0.316
min417.000-413.000=4.000
max418.000-413.000=5.000
mean0.073-0.077=-0.004
σ0.004-0.004=-0.000
min0.068-0.073=-0.005
max0.080-0.084=-0.004
cache=y
dps=1
iters=10
policies=100
mean26.065-26.064=0.000
σ0.004-0.003=0.001
min26.060-26.060=0.001
max26.072-26.069=0.003
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.059-0.058=0.001
σ0.002-0.003=-0.001
min0.057-0.056=0.001
max0.065-0.066=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.237-1751.236=0.000
σ0.363-0.362=0.000
min1750.666-1750.670=-0.004
max1751.820-1751.822=-0.002
mean1661.850-1661.300=0.550
σ634.449-635.382=-0.933
min620.000
max2792.000-2779.000=13.000
mean2.866-2.887=-0.021
σ0.097-0.106=-0.009
min2.642-2.655=-0.013
max3.037-3.112=-0.075

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.569-275.569=-0.000
σ0.007-0.006=0.000
min275.564-275.561=0.003
max275.578-275.575=0.003
mean2792.000-2779.000=13.000
σ0.000
min2792.000-2779.000=13.000
max2792.000-2779.000=13.000
mean0.406-0.405=0.001
σ0.010-0.012=-0.003
min0.398-0.395=0.002
max0.419-0.422=-0.004
iters=5
new-facts=1
prior-facts=6402
mean2168.097-2168.088=0.009
σ0.003-0.014=-0.011
min2168.092-2168.068=0.024
max2168.099-2168.104=-0.006
mean2792.000-2779.000=13.000
σ0.000
min2792.000-2779.000=13.000
max2792.000-2779.000=13.000
mean2.990-3.026=-0.036
σ0.154-0.136=0.019
min2.782-2.818=-0.036
max3.138-3.187=-0.049
iters=5
new-facts=6402
prior-facts=1
mean5047.673-5047.934=-0.262
σ1.120-0.897=0.224
min5046.469-5047.346=-0.877
max5049.523-5049.501=0.022
mean2792.000-2779.000=13.000
σ0.000
min2792.000-2779.000=13.000
max2792.000-2779.000=13.000
mean8.924-9.191=-0.268
σ0.511-0.589=-0.078
min8.086-8.485=-0.399
max9.444-10.020=-0.576
iters=5
new-facts=6402
prior-facts=6402
mean5179.045-5179.055=-0.010
σ0.077-0.084=-0.007
min5178.970-5178.969=0.001
max5179.129-5179.149=-0.020
mean3240.000-3258.000=-18.000
σ353.095-354.970=-1.875
min2792.000-2779.000=13.000
max3706.000-3703.000=3.000
mean9.973-10.000=-0.027
σ0.112-0.259=-0.146
min9.795-9.577=0.218
max10.104-10.226=-0.122

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.064-1.063=0.002
σ0.121-0.127=-0.006
min0.950-0.945=0.005
max1.248-1.258=-0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.204-463.202=0.003
σ572.664-572.665=-0.001
min176.869-176.863=0.006
max1322.200-1322.199=0.001
mean77.500
σ7.000
min74.000
max88.000
mean2792.000-2779.000=13.000
σ0.000
min2792.000-2779.000=13.000
max2792.000-2779.000=13.000
mean0.440-0.439=0.001
σ0.308-0.300=0.008
min0.284-0.288=-0.004
max0.902-0.889=0.013
policies=20
mean1768.976-1768.976=-0.000
σ0.315-0.315=-0.000
min1768.770-1768.766=0.004
max1769.436-1769.437=-0.001
mean740.000
σ0.000
min740.000
max740.000
mean2792.000-2779.000=13.000
σ0.000
min2792.000-2779.000=13.000
max2792.000-2779.000=13.000
mean2.797-2.794=0.002
σ0.111-0.126=-0.016
min2.736-2.727=0.009
max2.963-2.984=-0.021
policies=200
mean17696.203-17695.966=0.236
σ0.557-0.500=0.057
min17695.774-17695.664=0.110
max17697.021-17696.714=0.307
mean7400.000
σ0.000
min7400.000
max7400.000
mean2792.000-2779.000=13.000
σ0.000
min2792.000-2779.000=13.000
max2792.000-2779.000=13.000
mean27.649-27.715=-0.067
σ0.139-0.081=0.058
min27.519-27.637=-0.118
max27.786-27.820=-0.034