Compare commits

Home / Compare 4eb0b547 .. cf47e68f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.783-70.781=0.002
σ0.047-0.047=0.000
min70.757-70.748=0.008
max70.913-70.910=0.003
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.160-0.158=0.003
σ0.002-0.005=-0.003
min0.157-0.150=0.007
max0.165-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.494-21.493=0.000
σ0.001-0.003=-0.001
min21.490-21.490=-0.000
max21.495-21.498=-0.002
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.062-0.065=-0.003
σ0.003-0.003=0.000
min0.058-0.064=-0.005
max0.067-0.073=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.095-1754.093=0.002
σ0.360-0.361=-0.001
min1753.531-1753.533=-0.002
max1754.682-1754.693=-0.012
mean1645.600-1632.550=13.050
σ603.361-609.509=-6.149
min646.000-641.000=5.000
max2457.000-2452.000=5.000
mean2.825-2.835=-0.010
σ0.207-0.195=0.013
min2.268-2.165=0.103
max3.172-3.115=0.057

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.956-271.955=0.001
σ0.007-0.007=0.000
min271.947-271.948=-0.001
max271.964-271.965=-0.001
mean2457.000-2452.000=5.000
σ0.000
min2457.000-2452.000=5.000
max2457.000-2452.000=5.000
mean0.387-0.383=0.003
σ0.009-0.007=0.002
min0.380-0.379=0.000
max0.400-0.396=0.005
iters=5
new-facts=1
prior-facts=6402
mean1932.328-1932.328=0.001
σ0.008-0.010=-0.003
min1932.320-1932.314=0.006
max1932.336-1932.341=-0.005
mean2457.000-2452.000=5.000
σ0.000
min2457.000-2452.000=5.000
max2457.000-2452.000=5.000
mean2.947-2.947=-0.000
σ0.320-0.205=0.115
min2.395-2.613=-0.218
max3.182-3.174=0.008
iters=5
new-facts=6402
prior-facts=1
mean4753.124-4753.129=-0.005
σ0.882-0.837=0.045
min4752.588-4752.614=-0.026
max4754.683-4754.613=0.070
mean2457.000-2452.000=5.000
σ0.000
min2457.000-2452.000=5.000
max2457.000-2452.000=5.000
mean8.326-8.265=0.061
σ0.574-0.497=0.077
min7.587-7.605=-0.018
max8.962-8.882=0.080
iters=5
new-facts=6402
prior-facts=6402
mean4943.560-4943.552=0.008
σ0.020-0.018=0.001
min4943.532-4943.531=0.001
max4943.575-4943.573=0.002
mean2969.200-2995.400=-26.200
σ251.536-312.114=-60.579
min2649.000-2590.000=59.000
max3309.000-3400.000=-91.000
mean8.517-8.492=0.025
σ0.189-0.095=0.094
min8.395-8.381=0.014
max8.850-8.628=0.222

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.757-1.806=-0.050
σ0.111-0.092=0.020
min1.636-1.726=-0.090
max1.855-1.960=-0.105

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.656-468.655=0.001
σ574.921-574.922=-0.001
min181.190-181.187=0.004
max1331.037-1331.038=-0.001
mean88.250
σ8.500
min84.000
max101.000
mean2457.000-2452.000=5.000
σ0.000
min2457.000-2452.000=5.000
max2457.000-2452.000=5.000
mean0.559-0.542=0.016
σ0.542-0.504=0.038
min0.284-0.285=-0.001
max1.372-1.299=0.073
policies=20
mean1812.201-1812.198=0.002
σ0.388-0.390=-0.002
min1811.941-1811.939=0.002
max1812.773-1812.775=-0.003
mean840.000
σ0.000
min840.000
max840.000
mean2457.000-2452.000=5.000
σ0.000
min2457.000-2452.000=5.000
max2457.000-2452.000=5.000
mean2.842-2.839=0.003
σ0.010-0.015=-0.004
min2.829-2.824=0.004
max2.854-2.853=0.001
policies=200
mean18129.144-18129.238=-0.094
σ0.308-0.478=-0.170
min18128.908-18128.967=-0.059
max18129.594-18129.953=-0.360
mean8400.000
σ0.000
min8400.000
max8400.000
mean2457.000-2452.000=5.000
σ0.000
min2457.000-2452.000=5.000
max2457.000-2452.000=5.000
mean28.581-28.494=0.087
σ0.094-0.050=0.045
min28.460-28.424=0.036
max28.680-28.530=0.150