Compare commits

Home / Compare d65502b5 .. beeb2952

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.980=-0.001
σ0.048-0.047=0.001
min33.950-33.953=-0.003
max34.111-34.108=0.002
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.083-0.084=-0.001
σ0.004-0.003=0.000
min0.077-0.081=-0.004
max0.091-0.090=0.002
cache=y
dps=1
iters=10
policies=100
mean23.318-23.317=0.001
σ0.002-0.001=0.001
min23.315-23.315=-0.000
max23.324-23.319=0.005
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.063-0.065=-0.001
σ0.005-0.003=0.002
min0.059-0.061=-0.002
max0.074-0.071=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.430-1757.301=0.128
σ0.365-0.366=-0.001
min1756.855-1756.727=0.128
max1758.019-1757.889=0.130
mean1646.950-1651.950=-5.000
σ625.876-627.084=-1.209
min636.000-676.000=-40.000
max2837.000-2599.000=238.000
mean2.366-2.338=0.028
σ0.087-0.168=-0.081
min2.264-2.084=0.180
max2.650-2.692=-0.042

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.571-326.440=0.130
σ0.035-0.060=-0.024
min326.515-326.335=0.180
max326.607-326.477=0.131
mean2837.000-2599.000=238.000
σ0.000
min2837.000-2599.000=238.000
max2837.000-2599.000=238.000
mean0.424-0.438=-0.014
σ0.004-0.014=-0.010
min0.421-0.422=-0.000
max0.431-0.449=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1988.732-1988.613=0.119
σ0.014-0.009=0.005
min1988.719-1988.601=0.119
max1988.751-1988.621=0.130
mean2837.000-2599.000=238.000
σ0.000
min2837.000-2599.000=238.000
max2837.000-2599.000=238.000
mean2.723-2.692=0.031
σ0.069-0.134=-0.065
min2.646-2.512=0.134
max2.803-2.868=-0.065
iters=5
new-facts=6402
prior-facts=1
mean4813.472-4813.335=0.137
σ7.472-7.816=-0.344
min4810.068-4809.354=0.714
max4826.838-4827.308=-0.470
mean2837.000-2599.000=238.000
σ0.000
min2837.000-2599.000=238.000
max2837.000-2599.000=238.000
mean8.616-8.776=-0.160
σ0.579-0.214=0.365
min7.809-8.540=-0.730
max9.191-9.095=0.096
iters=5
new-facts=6402
prior-facts=6402
mean5001.074-5001.010=0.064
σ0.175-0.022=0.154
min5000.763-5000.984=-0.221
max5001.174-5001.038=0.137
mean3035.000-3006.600=28.400
σ269.659-326.292=-56.633
min2837.000-2599.000=238.000
max3451.000-3318.000=133.000
mean9.775-9.725=0.050
σ0.174-0.096=0.078
min9.635-9.611=0.024
max10.059-9.844=0.215

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.000-1.237=-0.237
σ0.069-0.437=-0.368
min0.912-0.919=-0.006
max1.062-1.846=-0.784

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.571-464.437=0.135
σ574.766-574.790=-0.024
min177.175-177.039=0.136
max1326.720-1326.622=0.099
mean88.250
σ8.500
min84.000
max101.000
mean2837.000-2599.000=238.000
σ0.000
min2837.000-2599.000=238.000
max2837.000-2599.000=238.000
mean0.437-0.559=-0.123
σ0.310-0.572=-0.262
min0.280-0.271=0.009
max0.902-1.417=-0.516
policies=20
mean1772.088-1770.758=1.329
σ0.366-0.347=0.019
min1771.829-1770.533=1.296
max1772.626-1771.274=1.352
mean840.000
σ0.000
min840.000
max840.000
mean2837.000-2599.000=238.000
σ0.000
min2837.000-2599.000=238.000
max2837.000-2599.000=238.000
mean2.792-2.705=0.088
σ0.021-0.008=0.013
min2.773-2.693=0.080
max2.819-2.710=0.108
policies=200
mean17727.667-17714.946=12.721
σ0.455-0.483=-0.027
min17727.341-17714.663=12.678
max17728.341-17715.668=12.673
mean8400.000
σ0.000
min8400.000
max8400.000
mean2837.000-2599.000=238.000
σ0.000
min2837.000-2599.000=238.000
max2837.000-2599.000=238.000
mean27.826-27.434=0.392
σ0.369-0.121=0.248
min27.476-27.325=0.151
max28.169-27.553=0.616