Compare commits

Home / Compare be9eb675 .. 831a3efa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=0.000
σ0.048-0.047=0.001
min33.950-33.950=-0.000
max34.110-34.107=0.003
mean411.000-417.000=-6.000
σ0.000
min411.000-417.000=-6.000
max411.000-417.000=-6.000
mean0.085-0.085=-0.001
σ0.004-0.004=-0.000
min0.078-0.082=-0.004
max0.090-0.092=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.318-23.318=0.000
σ0.002-0.002=0.000
min23.316-23.313=0.002
max23.323-23.320=0.003
mean411.000-417.000=-6.000
σ0.000
min411.000-417.000=-6.000
max411.000-417.000=-6.000
mean0.065-0.065=-0.001
σ0.003-0.002=0.000
min0.060-0.064=-0.004
max0.068-0.072=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.494-1757.494=0.001
σ0.366-0.364=0.002
min1756.919-1756.923=-0.004
max1758.085-1758.086=-0.001
mean1644.350-1670.850=-26.500
σ625.152-641.962=-16.809
min634.000-678.000=-44.000
max2833.000-2644.000=189.000
mean2.378-2.372=0.006
σ0.073-0.134=-0.060
min2.268-2.215=0.053
max2.579-2.736=-0.157

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.645-326.642=0.003
σ0.045-0.033=0.013
min326.565-326.585=-0.021
max326.672-326.670=0.002
mean2833.000-2644.000=189.000
σ0.000
min2833.000-2644.000=189.000
max2833.000-2644.000=189.000
mean0.424-0.424=-0.000
σ0.001-0.001=0.000
min0.423-0.423=-0.000
max0.425-0.424=0.001
iters=5
new-facts=1
prior-facts=6402
mean1988.806-1988.797=0.009
σ0.007-0.020=-0.014
min1988.795-1988.766=0.029
max1988.813-1988.818=-0.005
mean2833.000-2644.000=189.000
σ0.000
min2833.000-2644.000=189.000
max2833.000-2644.000=189.000
mean2.697-2.666=0.031
σ0.102-0.084=0.018
min2.604-2.565=0.040
max2.865-2.784=0.082
iters=5
new-facts=6402
prior-facts=1
mean4813.667-4813.513=0.154
σ7.684-7.469=0.215
min4810.099-4810.101=-0.002
max4827.411-4826.873=0.537
mean2833.000-2644.000=189.000
σ0.000
min2833.000-2644.000=189.000
max2833.000-2644.000=189.000
mean8.639-8.808=-0.169
σ0.487-0.278=0.209
min7.831-8.426=-0.595
max9.010-9.116=-0.106
iters=5
new-facts=6402
prior-facts=6402
mean5001.065-5001.212=-0.148
σ0.317-0.033=0.283
min5000.499-5001.182=-0.683
max5001.232-5001.266=-0.035
mean3062.400-2997.000=65.400
σ228.242-267.931=-39.689
min2833.000-2644.000=189.000
max3398.000-3312.000=86.000
mean9.906-9.920=-0.014
σ0.083-0.190=-0.107
min9.816-9.749=0.067
max10.021-10.218=-0.197

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.906-1.172=-0.266
σ0.022-0.300=-0.278
min0.887-0.931=-0.044
max0.938-1.688=-0.750

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.626-464.631=-0.004
σ574.765-574.779=-0.014
min177.238-177.238=-0.000
max1326.774-1326.799=-0.025
mean88.250
σ8.500
min84.000
max101.000
mean2833.000-2644.000=189.000
σ0.000
min2833.000-2644.000=189.000
max2833.000-2644.000=189.000
mean0.436-0.557=-0.121
σ0.302-0.567=-0.265
min0.280-0.271=0.008
max0.889-1.407=-0.518
policies=20
mean1772.693-1772.690=0.003
σ0.366-0.362=0.004
min1772.461-1772.454=0.007
max1773.237-1773.228=0.009
mean840.000
σ0.000
min840.000
max840.000
mean2833.000-2644.000=189.000
σ0.000
min2833.000-2644.000=189.000
max2833.000-2644.000=189.000
mean2.803-2.745=0.058
σ0.012-0.017=-0.005
min2.791-2.721=0.070
max2.818-2.759=0.059
policies=200
mean17734.041-17734.013=0.028
σ0.520-0.429=0.091
min17733.679-17733.774=-0.095
max17734.812-17734.655=0.157
mean8400.000
σ0.000
min8400.000
max8400.000
mean2833.000-2644.000=189.000
σ0.000
min2833.000-2644.000=189.000
max2833.000-2644.000=189.000
mean28.087-27.590=0.497
σ0.494-0.087=0.407
min27.648-27.515=0.133
max28.728-27.682=1.046