Compare commits

Home / Compare 4a7fe85c .. 919e4302

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.732-70.731=0.001
σ0.051-0.050=0.000
min70.704-70.694=0.010
max70.873-70.869=0.004
mean415.000
σ0.000
min415.000
max415.000
mean0.163-0.163=-0.000
σ0.005-0.009=-0.004
min0.156-0.153=0.003
max0.172-0.181=-0.009
cache=y
dps=1
iters=10
policies=100
mean21.445-21.445=-0.000
σ0.002-0.002=-0.000
min21.441-21.441=-0.001
max21.448-21.449=-0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.063-0.063=-0.000
σ0.004-0.004=-0.000
min0.059-0.060=-0.001
max0.071-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.288-1755.286=0.002
σ0.361-0.361=0.000
min1754.713-1754.720=-0.007
max1755.868-1755.872=-0.005
mean1647.150-1636.900=10.250
σ632.756-610.730=22.026
min640.000-622.000=18.000
max2842.000-2466.000=376.000
mean2.803-2.761=0.042
σ0.194-0.200=-0.006
min2.266-2.269=-0.003
max3.112-2.972=0.140

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.767-272.767=-0.000
σ0.008-0.006=0.002
min272.758-272.759=-0.001
max272.779-272.775=0.004
mean2842.000-2466.000=376.000
σ0.000
min2842.000-2466.000=376.000
max2842.000-2466.000=376.000
mean0.385-0.382=0.003
σ0.006-0.004=0.002
min0.379-0.377=0.001
max0.393-0.388=0.005
iters=5
new-facts=1
prior-facts=6402
mean1933.149-1933.150=-0.001
σ0.017-0.018=-0.000
min1933.123-1933.127=-0.004
max1933.168-1933.175=-0.007
mean2842.000-2466.000=376.000
σ0.000
min2842.000-2466.000=376.000
max2842.000-2466.000=376.000
mean2.988-3.058=-0.070
σ0.108-0.243=-0.136
min2.826-2.721=0.105
max3.122-3.395=-0.272
iters=5
new-facts=6402
prior-facts=1
mean4753.791-4753.893=-0.101
σ0.593-0.838=-0.245
min4753.465-4753.407=0.059
max4754.847-4755.383=-0.536
mean2842.000-2466.000=376.000
σ0.000
min2842.000-2466.000=376.000
max2842.000-2466.000=376.000
mean8.468-8.554=-0.086
σ0.395-0.414=-0.019
min7.848-7.959=-0.112
max8.875-9.053=-0.178
iters=5
new-facts=6402
prior-facts=6402
mean4944.384-4944.315=0.069
σ0.015-0.162=-0.147
min4944.369-4944.027=0.342
max4944.402-4944.408=-0.005
mean3018.600-2906.800=111.800
σ253.737-375.319=-121.583
min2842.000-2466.000=376.000
max3431.000-3417.000=14.000
mean8.405-8.373=0.032
σ0.046-0.054=-0.008
min8.358-8.306=0.052
max8.478-8.440=0.038

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.026-1.760=-0.734
σ0.135-0.152=-0.018
min0.935-1.502=-0.567
max1.247-1.891=-0.644

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.845-472.820=0.025
σ574.897-574.899=-0.002
min185.386-185.370=0.016
max1335.190-1335.168=0.022
mean88.250
σ8.500
min84.000
max101.000
mean2842.000-2466.000=376.000
σ0.000
min2842.000-2466.000=376.000
max2842.000-2466.000=376.000
mean0.451-0.566=-0.116
σ0.304-0.557=-0.254
min0.292-0.284=0.008
max0.906-1.402=-0.496
policies=20
mean1854.179-1853.981=0.197
σ0.365-0.368=-0.003
min1853.910-1853.730=0.180
max1854.713-1854.526=0.188
mean840.000
σ0.000
min840.000
max840.000
mean2842.000-2466.000=376.000
σ0.000
min2842.000-2466.000=376.000
max2842.000-2466.000=376.000
mean2.952-2.861=0.092
σ0.012-0.024=-0.013
min2.943-2.838=0.105
max2.968-2.893=0.075
policies=200
mean18547.526-18546.459=1.067
σ0.710-0.468=0.242
min18546.553-18546.212=0.341
max18548.221-18547.160=1.060
mean8400.000
σ0.000
min8400.000
max8400.000
mean2842.000-2466.000=376.000
σ0.000
min2842.000-2466.000=376.000
max2842.000-2466.000=376.000
mean29.406-28.847=0.559
σ0.476-0.048=0.428
min28.977-28.782=0.195
max29.829-28.886=0.943