Compare commits

Home / Compare f6158e48 .. ec75e01c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.692-36.725=-0.033
σ0.593-0.633=-0.040
min35.929-35.924=0.005
max37.212-37.523=-0.310
mean4136.000-3978.000=158.000
σ0.000
min4136.000-3978.000=158.000
max4136.000-3978.000=158.000
mean0.076-0.075=0.000
σ0.001-0.004=-0.003
min0.075-0.071=0.004
max0.077-0.083=-0.006
cache=y
dps=1
iters=10
policies=100
mean26.712-26.587=0.126
σ0.644-0.604=0.041
min26.209-26.203=0.006
max27.464-27.465=-0.001
mean4136.000-3978.000=158.000
σ0.000
min4136.000-3978.000=158.000
max4136.000-3978.000=158.000
mean0.060-0.060=0.001
σ0.001-0.001=-0.000
min0.059-0.058=0.001
max0.061-0.061=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.366-1756.358=0.008
σ0.373-0.372=0.001
min1755.794-1755.788=0.007
max1756.966-1756.958=0.008
mean1649.800-1656.850=-7.050
σ625.248-636.410=-11.161
min613.000-611.000=2.000
max2651.000-2687.000=-36.000
mean2.339-2.316=0.023
σ0.241-0.213=0.028
min2.136-2.138=-0.002
max3.050-2.890=0.160

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.699-278.668=0.032
σ0.012-0.010=0.001
min278.687-278.656=0.031
max278.715-278.678=0.037
mean2651.000-2687.000=-36.000
σ0.000
min2651.000-2687.000=-36.000
max2651.000-2687.000=-36.000
mean0.416-0.420=-0.004
σ0.002-0.001=0.001
min0.413-0.418=-0.005
max0.419-0.421=-0.002
iters=5
new-facts=1
prior-facts=6402
mean2268.864-2268.847=0.017
σ0.006-0.002=0.004
min2268.853-2268.843=0.011
max2268.869-2268.849=0.020
mean2651.000-2687.000=-36.000
σ0.000
min2651.000-2687.000=-36.000
max2651.000-2687.000=-36.000
mean3.054-3.007=0.047
σ0.151-0.139=0.012
min2.868-2.902=-0.034
max3.214-3.253=-0.039
iters=5
new-facts=6402
prior-facts=1
mean4952.357-4952.351=0.006
σ0.789-0.775=0.013
min4951.949-4951.988=-0.039
max4953.767-4953.737=0.029
mean2651.000-2687.000=-36.000
σ0.000
min2651.000-2687.000=-36.000
max2651.000-2687.000=-36.000
mean7.896-7.799=0.098
σ0.193-0.084=0.109
min7.714-7.656=0.058
max8.163-7.867=0.296
iters=5
new-facts=6402
prior-facts=6402
mean5166.999-5167.050=-0.051
σ0.165-0.008=0.157
min5166.706-5167.041=-0.336
max5167.096-5167.063=0.033
mean3422.600-3380.400=42.200
σ478.771-471.495=7.275
min2877.000-2745.000=132.000
max4136.000-3978.000=158.000
mean9.350-9.238=0.112
σ0.480-0.124=0.356
min8.517-9.114=-0.597
max9.725-9.397=0.328

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.027-1.106=-0.079
σ0.131-0.245=-0.114
min0.936-0.937=-0.001
max1.241-1.531=-0.290

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.259-460.253=0.006
σ572.607-572.608=-0.000
min173.954-173.948=0.006
max1319.170-1319.165=0.006
mean79.500
σ7.000
min76.000
max90.000
mean435.000-437.000=-2.000
σ0.000
min435.000-437.000=-2.000
max435.000-437.000=-2.000
mean0.559-0.541=0.018
σ0.570-0.536=0.034
min0.267-0.267=0.001
max1.414-1.345=0.070
policies=20
mean1740.048-1739.992=0.056
σ0.335-0.333=0.002
min1739.810-1739.756=0.054
max1740.541-1740.480=0.061
mean760.000
σ0.000
min760.000
max760.000
mean446.250-447.500=-1.250
σ10.308-9.950=0.358
min435.000-437.000=-2.000
max455.000-456.000=-1.000
mean2.673-2.662=0.011
σ0.015-0.012=0.003
min2.661-2.645=0.017
max2.693-2.670=0.023
policies=200
mean17409.790-17409.356=0.434
σ0.081-0.045=0.036
min17409.686-17409.326=0.360
max17409.879-17409.421=0.458
mean7600.000
σ0.000
min7600.000
max7600.000
mean492.750-491.250=1.500
σ2.754-1.708=1.046
min490.000-489.000=1.000
max496.000-493.000=3.000
mean26.869-26.881=-0.012
σ0.097-0.055=0.042
min26.776-26.839=-0.063
max27.005-26.960=0.045