Compare commits

Home / Compare 8b93393c .. f2a9ef1a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.699-70.784=-0.085
σ0.045-0.047=-0.002
min70.665-70.748=-0.084
max70.824-70.914=-0.091
mean414.000
σ0.000
min414.000
max414.000
mean0.160-0.158=0.002
σ0.003-0.005=-0.002
min0.155-0.150=0.004
max0.165-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.409-21.493=-0.084
σ0.003-0.002=0.001
min21.403-21.490=-0.087
max21.413-21.496=-0.082
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.065=-0.001
σ0.003-0.002=0.000
min0.063-0.064=-0.001
max0.072-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.898-1754.895=0.002
σ0.362-0.360=0.002
min1754.331-1754.322=0.010
max1755.484-1755.486=-0.001
mean1666.650-1665.700=0.950
σ644.656-642.651=2.005
min676.000-678.000=-2.000
max2713.000-2704.000=9.000
mean2.831-2.798=0.033
σ0.182-0.254=-0.072
min2.155-2.150=0.005
max3.041-3.503=-0.461

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.759-272.759=0.000
σ0.008-0.006=0.002
min272.749-272.754=-0.005
max272.766-272.767=-0.001
mean2713.000-2704.000=9.000
σ0.000
min2713.000-2704.000=9.000
max2713.000-2704.000=9.000
mean0.386-0.383=0.003
σ0.006-0.004=0.002
min0.383-0.379=0.004
max0.397-0.390=0.007
iters=5
new-facts=1
prior-facts=6402
mean1933.136-1933.130=0.006
σ0.014-0.011=0.004
min1933.116-1933.121=-0.005
max1933.150-1933.146=0.004
mean2713.000-2704.000=9.000
σ0.000
min2713.000-2704.000=9.000
max2713.000-2704.000=9.000
mean3.009-3.103=-0.094
σ0.044-0.094=-0.050
min2.947-2.990=-0.043
max3.071-3.189=-0.118
iters=5
new-facts=6402
prior-facts=1
mean4753.839-4753.838=0.001
σ0.931-0.938=-0.007
min4753.114-4753.128=-0.014
max4755.465-4755.479=-0.014
mean2713.000-2704.000=9.000
σ0.000
min2713.000-2704.000=9.000
max2713.000-2704.000=9.000
mean8.285-8.480=-0.196
σ0.592-0.498=0.094
min7.614-7.962=-0.348
max8.948-9.063=-0.115
iters=5
new-facts=6402
prior-facts=6402
mean4944.362-4944.357=0.006
σ0.016-0.018=-0.002
min4944.344-4944.332=0.012
max4944.383-4944.375=0.008
mean3039.000-2996.000=43.000
σ286.279-328.917=-42.638
min2713.000-2704.000=9.000
max3424.000-3465.000=-41.000
mean8.501-8.433=0.068
σ0.114-0.095=0.019
min8.326-8.327=-0.002
max8.601-8.564=0.037

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.021-1.104=-0.083
σ0.163-0.142=0.021
min0.907-0.930=-0.023
max1.263-1.257=0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.642-468.644=-0.001
σ574.894-574.894=0.000
min181.188-181.186=0.001
max1330.984-1330.985=-0.001
mean88.250
σ8.500
min84.000
max101.000
mean2713.000-2704.000=9.000
σ0.000
min2713.000-2704.000=9.000
max2713.000-2704.000=9.000
mean0.556-0.583=-0.027
σ0.534-0.594=-0.060
min0.287-0.284=0.003
max1.358-1.475=-0.117
policies=20
mean1812.197-1812.172=0.026
σ0.383-0.379=0.004
min1811.941-1811.926=0.015
max1812.763-1812.733=0.029
mean840.000
σ0.000
min840.000
max840.000
mean2713.000-2704.000=9.000
σ0.000
min2713.000-2704.000=9.000
max2713.000-2704.000=9.000
mean2.842-2.833=0.009
σ0.018-0.022=-0.003
min2.817-2.804=0.012
max2.859-2.856=0.003
policies=200
mean18128.907-18129.190=-0.283
σ0.577-0.528=0.050
min18128.499-18128.806=-0.307
max18129.761-18129.970=-0.209
mean8400.000
σ0.000
min8400.000
max8400.000
mean2713.000-2704.000=9.000
σ0.000
min2713.000-2704.000=9.000
max2713.000-2704.000=9.000
mean28.573-28.500=0.073
σ0.073-0.071=0.001
min28.484-28.413=0.071
max28.661-28.563=0.098