Compare commits

Home / Compare da6b9c2b .. 05470d92

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.783-70.783=-0.000
σ0.046-0.047=-0.000
min70.750-70.757=-0.007
max70.912-70.913=-0.002
mean416.000
σ0.000
min416.000
max416.000
mean0.160-0.160=0.000
σ0.003-0.002=0.001
min0.157-0.157=0.000
max0.169-0.165=0.003
cache=y
dps=1
iters=10
policies=100
mean21.494-21.494=0.000
σ0.003-0.001=0.001
min21.490-21.490=0.000
max21.499-21.495=0.004
mean416.000
σ0.000
min416.000
max416.000
mean0.066-0.062=0.004
σ0.003-0.003=-0.000
min0.064-0.058=0.005
max0.072-0.067=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1716.157-1754.095=-37.938
σ169.526-0.360=169.165
min995.923-1753.531=-757.608
max1754.630-1754.682=-0.051
mean1664.100-1645.600=18.500
σ640.845-603.361=37.484
min630.000-646.000=-16.000
max2778.000-2457.000=321.000
mean2.699-2.825=-0.126
σ0.370-0.207=0.162
min1.555-2.268=-0.713
max3.113-3.172=-0.059

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.953-271.956=-0.003
σ0.002-0.007=-0.005
min271.951-271.947=0.005
max271.955-271.964=-0.008
mean2778.000-2457.000=321.000
σ0.000
min2778.000-2457.000=321.000
max2778.000-2457.000=321.000
mean0.378-0.387=-0.009
σ0.001-0.009=-0.007
min0.376-0.380=-0.004
max0.380-0.400=-0.021
iters=5
new-facts=1
prior-facts=6402
mean1932.322-1932.328=-0.006
σ0.003-0.008=-0.004
min1932.316-1932.320=-0.004
max1932.325-1932.336=-0.011
mean2778.000-2457.000=321.000
σ0.000
min2778.000-2457.000=321.000
max2778.000-2457.000=321.000
mean3.018-2.947=0.071
σ0.065-0.320=-0.255
min2.958-2.395=0.563
max3.127-3.182=-0.055
iters=5
new-facts=6402
prior-facts=1
mean4753.117-4753.124=-0.007
σ0.890-0.882=0.008
min4752.587-4752.588=-0.001
max4754.691-4754.683=0.009
mean2778.000-2457.000=321.000
σ0.000
min2778.000-2457.000=321.000
max2778.000-2457.000=321.000
mean8.322-8.326=-0.004
σ0.594-0.574=0.021
min7.584-7.587=-0.003
max8.941-8.962=-0.022
iters=5
new-facts=6402
prior-facts=6402
mean4943.416-4943.560=-0.144
σ0.192-0.020=0.173
min4943.199-4943.532=-0.333
max4943.564-4943.575=-0.011
mean3025.000-2969.200=55.800
σ228.680-251.536=-22.856
min2778.000-2649.000=129.000
max3325.000-3309.000=16.000
mean8.550-8.517=0.033
σ0.140-0.189=-0.049
min8.450-8.395=0.055
max8.790-8.850=-0.060

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.988-1.757=-0.769
σ0.142-0.111=0.030
min0.918-1.636=-0.718
max1.241-1.855=-0.613

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.662-468.656=0.006
σ574.927-574.921=0.007
min181.189-181.190=-0.001
max1331.053-1331.037=0.016
mean88.250
σ8.500
min84.000
max101.000
mean2778.000-2457.000=321.000
σ0.000
min2778.000-2457.000=321.000
max2778.000-2457.000=321.000
mean0.446-0.559=-0.113
σ0.299-0.542=-0.243
min0.294-0.284=0.010
max0.894-1.372=-0.477
policies=20
mean1812.253-1812.201=0.053
σ0.383-0.388=-0.005
min1811.993-1811.941=0.052
max1812.813-1812.773=0.040
mean840.000
σ0.000
min840.000
max840.000
mean2778.000-2457.000=321.000
σ0.000
min2778.000-2457.000=321.000
max2778.000-2457.000=321.000
mean2.926-2.842=0.085
σ0.001-0.010=-0.010
min2.925-2.829=0.097
max2.927-2.854=0.074
policies=200
mean18129.089-18129.144=-0.055
σ0.574-0.308=0.266
min18128.587-18128.908=-0.321
max18129.887-18129.594=0.293
mean8400.000
σ0.000
min8400.000
max8400.000
mean2778.000-2457.000=321.000
σ0.000
min2778.000-2457.000=321.000
max2778.000-2457.000=321.000
mean28.786-28.581=0.204
σ0.365-0.094=0.271
min28.490-28.460=0.031
max29.318-28.680=0.638