Compare commits

Home / Compare f73ed819 .. e581033f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.783=-0.002
σ0.045-0.047=-0.002
min70.751-70.757=-0.006
max70.906-70.913=-0.007
mean416.000
σ0.000
min416.000
max416.000
mean0.159-0.160=-0.002
σ0.005-0.002=0.002
min0.150-0.157=-0.007
max0.165-0.165=0.000
cache=y
dps=1
iters=10
policies=100
mean21.492-21.494=-0.001
σ0.003-0.001=0.001
min21.488-21.490=-0.002
max21.496-21.495=0.001
mean416.000
σ0.000
min416.000
max416.000
mean0.065-0.062=0.003
σ0.003-0.003=-0.000
min0.063-0.058=0.005
max0.074-0.067=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.895-1754.095=0.800
σ0.361-0.360=0.000
min1754.330-1753.531=0.800
max1755.478-1754.682=0.797
mean1636.150-1645.600=-9.450
σ606.544-603.361=3.183
min646.000
max2435.000-2457.000=-22.000
mean2.750-2.825=-0.075
σ0.235-0.207=0.028
min2.201-2.268=-0.067
max3.046-3.172=-0.126

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.760-271.956=0.804
σ0.005-0.007=-0.002
min272.755-271.947=0.809
max272.768-271.964=0.804
mean2435.000-2457.000=-22.000
σ0.000
min2435.000-2457.000=-22.000
max2435.000-2457.000=-22.000
mean0.382-0.387=-0.005
σ0.001-0.009=-0.008
min0.380-0.380=0.001
max0.383-0.400=-0.017
iters=5
new-facts=1
prior-facts=6402
mean1792.866-1932.328=-139.462
σ313.660-0.008=313.653
min1231.774-1932.320=-700.546
max1933.162-1932.336=0.826
mean2435.000-2457.000=-22.000
σ0.000
min2435.000-2457.000=-22.000
max2435.000-2457.000=-22.000
mean2.812-2.947=-0.134
σ0.644-0.320=0.324
min1.681-2.395=-0.714
max3.300-3.182=0.118
iters=5
new-facts=6402
prior-facts=1
mean4753.875-4753.124=0.752
σ0.985-0.882=0.103
min4753.376-4752.588=0.788
max4755.634-4754.683=0.951
mean2435.000-2457.000=-22.000
σ0.000
min2435.000-2457.000=-22.000
max2435.000-2457.000=-22.000
mean8.811-8.326=0.485
σ0.639-0.574=0.065
min7.884-7.587=0.296
max9.566-8.962=0.603
iters=5
new-facts=6402
prior-facts=6402
mean4944.289-4943.560=0.729
σ0.167-0.020=0.147
min4943.990-4943.532=0.458
max4944.372-4943.575=0.797
mean2821.200-2969.200=-148.000
σ330.353-251.536=78.817
min2435.000-2649.000=-214.000
max3269.000-3309.000=-40.000
mean8.404-8.517=-0.113
σ0.074-0.189=-0.116
min8.329-8.395=-0.066
max8.507-8.850=-0.343

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.798-1.757=0.041
σ0.071-0.111=-0.041
min1.733-1.636=0.097
max1.897-1.855=0.042

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.652-468.656=-0.003
σ574.923-574.921=0.002
min181.189-181.190=-0.001
max1331.036-1331.037=-0.001
mean88.250
σ8.500
min84.000
max101.000
mean2435.000-2457.000=-22.000
σ0.000
min2435.000-2457.000=-22.000
max2435.000-2457.000=-22.000
mean0.571-0.559=0.012
σ0.554-0.542=0.012
min0.289-0.284=0.005
max1.402-1.372=0.030
policies=20
mean1812.199-1812.201=-0.002
σ0.390-0.388=0.002
min1811.935-1811.941=-0.006
max1812.775-1812.773=0.002
mean840.000
σ0.000
min840.000
max840.000
mean2435.000-2457.000=-22.000
σ0.000
min2435.000-2457.000=-22.000
max2435.000-2457.000=-22.000
mean2.831-2.842=-0.011
σ0.016-0.010=0.005
min2.807-2.829=-0.021
max2.840-2.854=-0.013
policies=200
mean18129.204-18129.144=0.060
σ0.503-0.308=0.195
min18128.899-18128.908=-0.009
max18129.955-18129.594=0.362
mean8400.000
σ0.000
min8400.000
max8400.000
mean2435.000-2457.000=-22.000
σ0.000
min2435.000-2457.000=-22.000
max2435.000-2457.000=-22.000
mean28.657-28.581=0.076
σ0.087-0.094=-0.007
min28.552-28.460=0.093
max28.762-28.680=0.083