Compare commits

Home / Compare 3729031b .. 15137a00

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.781=0.001
σ0.046-0.047=-0.001
min70.756-70.747=0.009
max70.911-70.910=0.001
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.157-0.158=-0.002
σ0.005-0.004=0.001
min0.150-0.155=-0.004
max0.165-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.494-21.493=0.001
σ0.002-0.003=-0.001
min21.492-21.489=0.003
max21.497-21.497=0.000
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.065-0.065=0.000
σ0.002-0.002=-0.000
min0.063-0.063=0.000
max0.071-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.096-1754.094=0.002
σ0.361-0.362=-0.001
min1753.533-1753.526=0.006
max1754.690-1754.682=0.008
mean1654.150-1660.000=-5.850
σ631.469-634.589=-3.120
min624.000-627.000=-3.000
max2704.000-2709.000=-5.000
mean2.760-2.804=-0.045
σ0.263-0.217=0.046
min2.268-2.256=0.012
max3.088-3.151=-0.063

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.597-271.602=-0.005
σ0.007-0.008=-0.001
min271.587-271.593=-0.005
max271.604-271.609=-0.005
mean2704.000-2709.000=-5.000
σ0.000
min2704.000-2709.000=-5.000
max2704.000-2709.000=-5.000
mean0.382-0.385=-0.003
σ0.004-0.005=-0.001
min0.378-0.380=-0.001
max0.387-0.392=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1931.995-1791.737=140.258
σ0.018-313.621=-313.603
min1931.965-1230.715=701.250
max1932.008-1932.015=-0.008
mean2704.000-2709.000=-5.000
σ0.000
min2704.000-2709.000=-5.000
max2704.000-2709.000=-5.000
mean2.531-2.359=0.173
σ0.087-0.419=-0.332
min2.456-1.625=0.831
max2.646-2.646=-0.000
iters=5
new-facts=6402
prior-facts=1
mean4752.739-4752.697=0.043
σ0.926-0.940=-0.014
min4752.192-4752.251=-0.060
max4754.366-4754.377=-0.012
mean2704.000-2709.000=-5.000
σ0.000
min2704.000-2709.000=-5.000
max2704.000-2709.000=-5.000
mean8.872-8.815=0.057
σ0.642-0.305=0.337
min8.275-8.315=-0.040
max9.880-9.082=0.797
iters=5
new-facts=6402
prior-facts=6402
mean4943.207-4943.137=0.070
σ0.017-0.169=-0.152
min4943.188-4942.836=0.352
max4943.222-4943.223=-0.001
mean2974.600-2932.800=41.800
σ233.116-219.313=13.803
min2704.000-2709.000=-5.000
max3302.000-3260.000=42.000
mean8.636-8.538=0.098
σ0.251-0.270=-0.019
min8.443-8.335=0.108
max9.066-9.012=0.054

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.015-0.994=0.021
σ0.135-0.136=-0.001
min0.925-0.926=-0.002
max1.235-1.237=-0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.615-468.619=-0.003
σ574.890-574.894=-0.004
min181.169-181.167=0.002
max1330.951-1330.960=-0.009
mean88.250
σ8.500
min84.000
max101.000
mean2704.000-2709.000=-5.000
σ0.000
min2704.000-2709.000=-5.000
max2704.000-2709.000=-5.000
mean0.545-0.563=-0.019
σ0.527-0.549=-0.022
min0.270-0.286=-0.016
max1.334-1.386=-0.052
policies=20
mean1811.953-1811.960=-0.007
σ0.376-0.384=-0.007
min1811.699-1811.702=-0.002
max1812.510-1812.526=-0.016
mean840.000
σ0.000
min840.000
max840.000
mean2704.000-2709.000=-5.000
σ0.000
min2704.000-2709.000=-5.000
max2704.000-2709.000=-5.000
mean2.839-2.848=-0.009
σ0.013-0.012=0.000
min2.826-2.839=-0.013
max2.856-2.866=-0.010
policies=200
mean18126.707-18126.733=-0.026
σ0.457-0.475=-0.018
min18126.405-18126.450=-0.045
max18127.385-18127.444=-0.058
mean8400.000
σ0.000
min8400.000
max8400.000
mean2704.000-2709.000=-5.000
σ0.000
min2704.000-2709.000=-5.000
max2704.000-2709.000=-5.000
mean28.609-28.610=-0.001
σ0.183-0.092=0.091
min28.461-28.478=-0.017
max28.876-28.674=0.202