Compare commits

Home / Compare 0c7978d0 .. f17aee57

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.784-70.780=0.003
σ0.047-0.044=0.003
min70.748-70.750=-0.001
max70.914-70.902=0.012
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.158-0.157=0.001
σ0.005-0.005=0.000
min0.150-0.149=0.002
max0.165-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.493-21.493=-0.000
σ0.002-0.003=-0.001
min21.490-21.488=0.002
max21.496-21.497=-0.002
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.065-0.065=0.000
σ0.002-0.002=-0.000
min0.064-0.062=0.002
max0.072-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.895-1754.093=0.802
σ0.360-0.363=-0.003
min1754.322-1753.528=0.794
max1755.486-1754.676=0.809
mean1665.700-1670.250=-4.550
σ642.651-638.892=3.758
min678.000-672.000=6.000
max2704.000-2734.000=-30.000
mean2.798-2.822=-0.024
σ0.254-0.177=0.077
min2.150-2.264=-0.114
max3.503-3.032=0.471

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.759-271.956=0.802
σ0.006-0.007=-0.001
min272.754-271.947=0.807
max272.767-271.966=0.801
mean2704.000-2734.000=-30.000
σ0.000
min2704.000-2734.000=-30.000
max2704.000-2734.000=-30.000
mean0.383-0.385=-0.002
σ0.004-0.007=-0.003
min0.379-0.381=-0.002
max0.390-0.398=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1933.130-1932.331=0.799
σ0.011-0.013=-0.003
min1933.121-1932.313=0.808
max1933.146-1932.347=0.798
mean2704.000-2734.000=-30.000
σ0.000
min2704.000-2734.000=-30.000
max2704.000-2734.000=-30.000
mean3.103-2.946=0.157
σ0.094-0.286=-0.192
min2.990-2.449=0.541
max3.189-3.173=0.016
iters=5
new-facts=6402
prior-facts=1
mean4753.838-4752.979=0.859
σ0.938-1.009=-0.072
min4753.128-4752.048=1.080
max4755.479-4754.701=0.777
mean2704.000-2734.000=-30.000
σ0.000
min2704.000-2734.000=-30.000
max2704.000-2734.000=-30.000
mean8.480-8.621=-0.140
σ0.498-0.369=0.129
min7.962-8.013=-0.051
max9.063-8.926=0.137
iters=5
new-facts=6402
prior-facts=6402
mean4944.357-4943.556=0.801
σ0.018-0.014=0.005
min4944.332-4943.537=0.795
max4944.375-4943.570=0.805
mean2996.000-3041.200=-45.200
σ328.917-224.355=104.562
min2704.000-2734.000=-30.000
max3465.000-3328.000=137.000
mean8.433-8.486=-0.053
σ0.095-0.126=-0.031
min8.327-8.338=-0.011
max8.564-8.631=-0.066

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.104-1.056=0.048
σ0.142-0.132=0.010
min0.930-0.938=-0.008
max1.257-1.262=-0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.644-468.666=-0.022
σ574.894-574.934=-0.040
min181.186-181.190=-0.004
max1330.985-1331.067=-0.083
mean88.250
σ8.500
min84.000
max101.000
mean2704.000-2734.000=-30.000
σ0.000
min2704.000-2734.000=-30.000
max2704.000-2734.000=-30.000
mean0.583-0.585=-0.002
σ0.594-0.588=0.007
min0.284-0.287=-0.002
max1.475-1.466=0.008
policies=20
mean1812.172-1812.213=-0.042
σ0.379-0.388=-0.009
min1811.926-1811.945=-0.019
max1812.733-1812.785=-0.052
mean840.000
σ0.000
min840.000
max840.000
mean2704.000-2734.000=-30.000
σ0.000
min2704.000-2734.000=-30.000
max2704.000-2734.000=-30.000
mean2.833-2.843=-0.010
σ0.022-0.021=0.001
min2.804-2.817=-0.013
max2.856-2.863=-0.007
policies=200
mean18129.190-18129.228=-0.038
σ0.528-0.437=0.090
min18128.806-18128.941=-0.135
max18129.970-18129.880=0.090
mean8400.000
σ0.000
min8400.000
max8400.000
mean2704.000-2734.000=-30.000
σ0.000
min2704.000-2734.000=-30.000
max2704.000-2734.000=-30.000
mean28.500-28.664=-0.163
σ0.071-0.042=0.029
min28.413-28.618=-0.206
max28.563-28.718=-0.155