Compare commits

Home / Compare 72d92d5c .. 4f9a68a7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.952-35.951=0.001
σ0.101-0.101=-0.000
min35.901-35.908=-0.008
max36.238-36.238=-0.000
mean413.900-415.000=-1.100
σ0.316-0.000=0.316
min413.000-415.000=-2.000
max414.000-415.000=-1.000
mean0.078-0.079=-0.001
σ0.004-0.005=-0.001
min0.073-0.075=-0.002
max0.087-0.087=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.201-26.200=0.001
σ0.004-0.005=-0.001
min26.197-26.193=0.004
max26.207-26.210=-0.003
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.061-0.061=0.000
σ0.003-0.003=-0.000
min0.060-0.060=-0.000
max0.068-0.070=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.300-1756.300=-0.000
σ0.367-0.369=-0.002
min1755.723-1755.721=0.001
max1756.891-1756.891=-0.000
mean1658.850-1679.000=-20.150
σ632.080-636.673=-4.593
min612.000-681.000=-69.000
max2727.000-2692.000=35.000
mean2.408-2.334=0.074
σ0.128-0.077=0.051
min2.282-2.188=0.095
max2.819-2.497=0.321

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.816-278.816=0.000
σ0.006-0.004=0.002
min278.812-278.812=-0.000
max278.826-278.821=0.005
mean2727.000-2692.000=35.000
σ0.000
min2727.000-2692.000=35.000
max2727.000-2692.000=35.000
mean0.408-0.411=-0.003
σ0.004-0.005=-0.000
min0.405-0.407=-0.002
max0.416-0.419=-0.003
iters=5
new-facts=1
prior-facts=6402
mean2268.868-2268.874=-0.006
σ0.015-0.015=0.000
min2268.848-2268.852=-0.004
max2268.885-2268.892=-0.007
mean2727.000-2692.000=35.000
σ0.000
min2727.000-2692.000=35.000
max2727.000-2692.000=35.000
mean2.921-2.952=-0.032
σ0.142-0.110=0.032
min2.781-2.880=-0.098
max3.130-3.148=-0.018
iters=5
new-facts=6402
prior-facts=1
mean4954.240-4954.215=0.024
σ0.814-0.807=0.008
min4953.732-4953.726=0.006
max4955.687-4955.641=0.046
mean2727.000-2692.000=35.000
σ0.000
min2727.000-2692.000=35.000
max2727.000-2692.000=35.000
mean7.974-8.048=-0.074
σ0.242-0.206=0.036
min7.688-7.738=-0.051
max8.232-8.232=0.001
iters=5
new-facts=6402
prior-facts=6402
mean5168.784-5168.784=0.001
σ0.082-0.085=-0.003
min5168.716-5168.719=-0.003
max5168.876-5168.878=-0.002
mean3396.800-3376.400=20.400
σ487.659-450.816=36.843
min2818.000-2773.000=45.000
max4070.000-3964.000=106.000
mean9.336-9.177=0.159
σ0.337-0.215=0.122
min9.088-8.842=0.246
max9.886-9.428=0.458

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.139-1.112=0.027
σ0.228-0.237=-0.009
min0.926-0.942=-0.016
max1.459-1.461=-0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.810-459.811=-0.001
σ571.586-571.587=-0.001
min174.005-174.009=-0.004
max1317.188-1317.191=-0.003
mean79.500
σ7.000
min76.000
max90.000
mean2727.000-2692.000=35.000
σ0.000
min2727.000-2692.000=35.000
max2727.000-2692.000=35.000
mean0.546-0.552=-0.006
σ0.554-0.569=-0.015
min0.267-0.264=0.004
max1.377-1.406=-0.029
policies=20
mean1740.316-1740.317=-0.000
σ0.314-0.329=-0.015
min1740.115-1740.098=0.017
max1740.785-1740.806=-0.021
mean760.000
σ0.000
min760.000
max760.000
mean2727.000-2692.000=35.000
σ0.000
min2727.000-2692.000=35.000
max2727.000-2692.000=35.000
mean2.670-2.695=-0.026
σ0.015-0.009=0.006
min2.653-2.687=-0.033
max2.683-2.703=-0.020
policies=200
mean17410.197-17410.162=0.034
σ0.476-0.457=0.019
min17409.934-17409.896=0.037
max17410.910-17410.845=0.065
mean7600.000
σ0.000
min7600.000
max7600.000
mean2727.000-2692.000=35.000
σ0.000
min2727.000-2692.000=35.000
max2727.000-2692.000=35.000
mean27.036-27.040=-0.004
σ0.121-0.092=0.028
min26.858-26.935=-0.077
max27.120-27.156=-0.036