Compare commits

Home / Compare 8218abd2 .. 04f356e0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.566=0.001
σ0.047-0.050=-0.003
min70.538-70.536=0.002
max70.696-70.705=-0.008
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.159-0.155=0.004
σ0.003-0.004=-0.001
min0.154-0.150=0.004
max0.165-0.162=0.002
cache=y
dps=1
iters=10
policies=100
mean21.287-21.288=-0.001
σ0.003-0.003=0.000
min21.283-21.284=-0.001
max21.292-21.292=0.000
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.063-0.064=-0.001
σ0.003-0.004=-0.000
min0.059-0.058=0.001
max0.069-0.073=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.172-1753.569=-0.398
σ0.362-0.362=0.001
min1752.597-1752.996=-0.399
max1753.756-1754.151=-0.395
mean1644.500-1652.250=-7.750
σ633.205-627.905=5.300
min630.000-648.000=-18.000
max2774.000-2843.000=-69.000
mean2.841-2.778=0.064
σ0.165-0.215=-0.050
min2.338-2.270=0.067
max3.018-3.214=-0.196

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.618-272.019=-0.401
σ0.004-0.009=-0.004
min271.613-272.008=-0.395
max271.624-272.027=-0.403
mean2774.000-2843.000=-69.000
σ0.000
min2774.000-2843.000=-69.000
max2774.000-2843.000=-69.000
mean0.378-0.391=-0.014
σ0.002-0.010=-0.008
min0.376-0.379=-0.003
max0.381-0.405=-0.024
iters=5
new-facts=1
prior-facts=6402
mean1932.043-1932.442=-0.399
σ0.018-0.011=0.007
min1932.023-1932.427=-0.404
max1932.063-1932.457=-0.394
mean2774.000-2843.000=-69.000
σ0.000
min2774.000-2843.000=-69.000
max2774.000-2843.000=-69.000
mean2.975-2.910=0.065
σ0.084-0.194=-0.110
min2.898-2.610=0.288
max3.119-3.139=-0.020
iters=5
new-facts=6402
prior-facts=1
mean4752.771-4753.178=-0.407
σ0.884-0.848=0.036
min4752.245-4752.629=-0.384
max4754.340-4754.684=-0.344
mean2774.000-2843.000=-69.000
σ0.000
min2774.000-2843.000=-69.000
max2774.000-2843.000=-69.000
mean8.658-8.624=0.034
σ0.413-0.699=-0.286
min8.231-7.600=0.631
max9.176-9.530=-0.353
iters=5
new-facts=6402
prior-facts=6402
mean4943.231-4943.560=-0.329
σ0.015-0.162=-0.148
min4943.221-4943.271=-0.051
max4943.257-4943.655=-0.398
mean2979.600-3090.600=-111.000
σ212.805-249.380=-36.575
min2774.000-2843.000=-69.000
max3301.000-3347.000=-46.000
mean8.464-8.724=-0.260
σ0.065-0.227=-0.162
min8.390-8.424=-0.034
max8.527-9.062=-0.535

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.078-1.070=0.007
σ0.115-0.176=-0.061
min0.935-0.924=0.011
max1.256-1.360=-0.104

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.287-473.078=-0.791
σ575.929-575.922=0.007
min184.320-185.110=-0.790
max1336.180-1336.961=-0.780
mean88.250
σ8.500
min84.000
max101.000
mean2774.000-2843.000=-69.000
σ0.000
min2774.000-2843.000=-69.000
max2774.000-2843.000=-69.000
mean0.445-0.468=-0.022
σ0.289-0.335=-0.046
min0.298-0.298=-0.001
max0.879-0.970=-0.091
policies=20
mean1843.578-1851.436=-7.857
σ0.397-0.374=0.023
min1843.286-1851.156=-7.871
max1844.158-1851.981=-7.823
mean840.000
σ0.000
min840.000
max840.000
mean2774.000-2843.000=-69.000
σ0.000
min2774.000-2843.000=-69.000
max2774.000-2843.000=-69.000
mean2.941-2.955=-0.014
σ0.111-0.007=0.105
min2.847-2.950=-0.103
max3.096-2.965=0.131
policies=200
mean18442.146-18521.035=-78.890
σ0.497-0.419=0.078
min18441.829-18520.736=-78.907
max18442.882-18521.650=-78.768
mean8400.000
σ0.000
min8400.000
max8400.000
mean2774.000-2843.000=-69.000
σ0.000
min2774.000-2843.000=-69.000
max2774.000-2843.000=-69.000
mean28.778-29.210=-0.433
σ0.175-0.474=-0.299
min28.617-28.788=-0.171
max28.990-29.681=-0.691