Compare commits

Home / Compare 42c590b9 .. be9eb675

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=-0.000
σ0.047-0.048=-0.001
min33.950-33.947=0.003
max34.107-34.109=-0.002
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.085-0.082=0.003
σ0.004-0.005=-0.001
min0.082-0.076=0.006
max0.092-0.092=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.318-23.317=0.000
σ0.002-0.003=-0.001
min23.313-23.314=-0.000
max23.320-23.322=-0.002
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.065-0.065=0.000
σ0.002-0.002=0.000
min0.064-0.064=0.000
max0.072-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.494-1757.494=0.000
σ0.364-0.366=-0.002
min1756.923-1756.920=0.003
max1758.086-1758.085=0.000
mean1670.850-1662.450=8.400
σ641.962-650.031=-8.070
min678.000-653.000=25.000
max2644.000-2825.000=-181.000
mean2.372-2.362=0.011
σ0.134-0.111=0.022
min2.215-2.170=0.045
max2.736-2.679=0.056

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.642-326.640=0.002
σ0.033-0.044=-0.011
min326.585-326.563=0.023
max326.670-326.666=0.005
mean2644.000-2825.000=-181.000
σ0.000
min2644.000-2825.000=-181.000
max2644.000-2825.000=-181.000
mean0.424-0.424=-0.000
σ0.001-0.001=-0.001
min0.423-0.422=0.000
max0.424-0.426=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1988.797-1988.804=-0.007
σ0.020-0.003=0.017
min1988.766-1988.801=-0.035
max1988.818-1988.807=0.011
mean2644.000-2825.000=-181.000
σ0.000
min2644.000-2825.000=-181.000
max2644.000-2825.000=-181.000
mean2.666-2.728=-0.062
σ0.084-0.117=-0.033
min2.565-2.623=-0.058
max2.784-2.876=-0.093
iters=5
new-facts=6402
prior-facts=1
mean4813.513-4813.644=-0.131
σ7.469-7.726=-0.257
min4810.101-4810.139=-0.038
max4826.873-4827.464=-0.591
mean2644.000-2825.000=-181.000
σ0.000
min2644.000-2825.000=-181.000
max2644.000-2825.000=-181.000
mean8.808-8.834=-0.027
σ0.278-0.299=-0.021
min8.426-8.392=0.034
max9.116-9.152=-0.036
iters=5
new-facts=6402
prior-facts=6402
mean5001.212-5001.055=0.157
σ0.033-0.330=-0.296
min5001.182-5000.468=0.714
max5001.266-5001.246=0.020
mean2997.000-3057.600=-60.600
σ267.931-246.150=21.781
min2644.000-2825.000=-181.000
max3312.000-3416.000=-104.000
mean9.920-9.592=0.328
σ0.190-0.622=-0.432
min9.749-8.497=1.252
max10.218-10.017=0.201

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.172-1.020=0.152
σ0.300-0.126=0.174
min0.931-0.906=0.025
max1.688-1.217=0.471

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.631-464.629=0.002
σ574.779-574.773=0.006
min177.238-177.239=-0.001
max1326.799-1326.789=0.010
mean88.250
σ8.500
min84.000
max101.000
mean2644.000-2825.000=-181.000
σ0.000
min2644.000-2825.000=-181.000
max2644.000-2825.000=-181.000
mean0.557-0.435=0.122
σ0.567-0.307=0.260
min0.271-0.279=-0.007
max1.407-0.896=0.512
policies=20
mean1772.690-1772.724=-0.034
σ0.362-0.367=-0.005
min1772.454-1772.473=-0.018
max1773.228-1773.267=-0.038
mean840.000
σ0.000
min840.000
max840.000
mean2644.000-2825.000=-181.000
σ0.000
min2644.000-2825.000=-181.000
max2644.000-2825.000=-181.000
mean2.745-2.802=-0.057
σ0.017-0.012=0.005
min2.721-2.793=-0.072
max2.759-2.819=-0.061
policies=200
mean17734.013-17733.991=0.022
σ0.429-0.575=-0.146
min17733.774-17733.569=0.205
max17734.655-17734.833=-0.177
mean8400.000
σ0.000
min8400.000
max8400.000
mean2644.000-2825.000=-181.000
σ0.000
min2644.000-2825.000=-181.000
max2644.000-2825.000=-181.000
mean27.590-27.918=-0.328
σ0.087-0.442=-0.355
min27.515-27.408=0.107
max27.682-28.358=-0.677