Compare commits

Home / Compare 82f19593 .. 360f79cd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.701-70.702=-0.001
σ0.046-0.045=0.002
min70.670-70.674=-0.004
max70.828-70.826=0.002
mean411.000-418.000=-7.000
σ0.000
min411.000-418.000=-7.000
max411.000-418.000=-7.000
mean0.159-0.157=0.002
σ0.003-0.005=-0.002
min0.156-0.148=0.008
max0.165-0.164=0.001
cache=y
dps=1
iters=10
policies=100
mean21.409-21.409=-0.000
σ0.003-0.002=0.001
min21.405-21.406=-0.001
max21.414-21.413=0.001
mean411.000-418.000=-7.000
σ0.000
min411.000-418.000=-7.000
max411.000-418.000=-7.000
mean0.065-0.064=0.001
σ0.002-0.004=-0.002
min0.064-0.059=0.005
max0.071-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.931-1754.930=0.001
σ0.362-0.359=0.003
min1754.355-1754.367=-0.012
max1755.517-1755.501=0.017
mean1664.800-1664.150=0.650
σ618.766-619.996=-1.230
min622.000-635.000=-13.000
max2493.000
mean2.809-2.824=-0.015
σ0.135-0.174=-0.039
min2.485-2.496=-0.011
max2.996-3.256=-0.260

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.792-272.793=-0.000
σ0.005-0.007=-0.001
min272.787-272.782=0.005
max272.798-272.798=-0.000
mean2493.000
σ0.000
min2493.000
max2493.000
mean0.379-0.381=-0.002
σ0.002-0.010=-0.008
min0.377-0.375=0.001
max0.382-0.399=-0.017
iters=5
new-facts=1
prior-facts=6402
mean1933.217-1933.222=-0.005
σ0.014-0.010=0.004
min1933.195-1933.208=-0.013
max1933.230-1933.230=0.000
mean2493.000
σ0.000
min2493.000
max2493.000
mean3.084-3.069=0.015
σ0.089-0.069=0.021
min3.029-3.005=0.024
max3.239-3.177=0.062
iters=5
new-facts=6402
prior-facts=1
mean4756.868-4756.937=-0.069
σ7.592-7.638=-0.045
min4753.098-4753.474=-0.377
max4770.444-4770.600=-0.156
mean2493.000
σ0.000
min2493.000
max2493.000
mean8.343-8.642=-0.298
σ0.318-0.462=-0.144
min7.967-7.853=0.114
max8.679-8.953=-0.274
iters=5
new-facts=6402
prior-facts=6402
mean4944.448-4944.452=-0.004
σ0.022-0.009=0.012
min4944.420-4944.438=-0.018
max4944.470-4944.461=0.009
mean2976.600-3006.200=-29.600
σ398.977-284.488=114.489
min2493.000-2608.000=-115.000
max3521.000-3359.000=162.000
mean8.393-8.504=-0.111
σ0.137-0.173=-0.036
min8.285-8.328=-0.043
max8.630-8.793=-0.163

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.639-1.559=0.080
σ0.234-0.208=0.026
min1.227-1.226=0.001
max1.812-1.791=0.021

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.303-468.305=-0.002
σ574.229-574.233=-0.005
min181.185-181.187=-0.002
max1329.646-1329.655=-0.009
mean88.250
σ8.500
min84.000
max101.000
mean2493.000
σ0.000
min2493.000
max2493.000
mean0.534-0.563=-0.029
σ0.504-0.540=-0.036
min0.281-0.286=-0.006
max1.289-1.373=-0.084
policies=20
mean1812.172-1812.177=-0.005
σ0.385-0.383=0.002
min1811.924-1811.925=-0.001
max1812.743-1812.743=-0.000
mean840.000
σ0.000
min840.000
max840.000
mean2493.000
σ0.000
min2493.000
max2493.000
mean2.805-2.813=-0.009
σ0.027-0.013=0.014
min2.778-2.803=-0.025
max2.837-2.829=0.008
policies=200
mean18128.957-18128.896=0.061
σ0.588-0.566=0.022
min18128.442-18128.424=0.019
max18129.804-18129.707=0.098
mean8400.000
σ0.000
min8400.000
max8400.000
mean2493.000
σ0.000
min2493.000
max2493.000
mean28.323-28.306=0.017
σ0.073-0.083=-0.010
min28.264-28.193=0.071
max28.420-28.394=0.026