Compare commits

Home / Compare 149942fc .. e7443c54

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.570-70.568=0.001
σ0.042-0.047=-0.005
min70.545-70.545=-0.001
max70.689-70.701=-0.013
mean415.800-415.600=0.200
σ0.422-0.516=-0.095
min415.000
max416.000
mean0.161-0.158=0.003
σ0.004-0.005=-0.002
min0.157-0.147=0.009
max0.167-0.168=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.291-21.292=-0.001
σ0.002-0.003=-0.001
min21.288-21.285=0.002
max21.295-21.296=-0.001
mean416.000
σ0.000
min416.000
max416.000
mean0.065-0.064=0.001
σ0.002-0.003=-0.001
min0.063-0.058=0.005
max0.071-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1749.769-1749.770=-0.001
σ0.359-0.362=-0.003
min1749.201-1749.195=0.006
max1750.351-1750.353=-0.002
mean1657.000-1671.450=-14.450
σ642.118-633.206=8.912
min623.000-683.000=-60.000
max2888.000-2706.000=182.000
mean2.819-2.840=-0.021
σ0.178-0.143=0.035
min2.174-2.423=-0.249
max2.985-3.037=-0.052

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean268.233-268.227=0.006
σ0.005-0.010=-0.005
min268.230-268.211=0.019
max268.242-268.238=0.004
mean2888.000-2706.000=182.000
σ0.000
min2888.000-2706.000=182.000
max2888.000-2706.000=182.000
mean0.383-0.385=-0.002
σ0.009-0.008=0.002
min0.373-0.376=-0.003
max0.395-0.391=0.004
iters=5
new-facts=1
prior-facts=6402
mean1928.645-1928.638=0.008
σ0.014-0.009=0.005
min1928.629-1928.624=0.005
max1928.664-1928.647=0.017
mean2888.000-2706.000=182.000
σ0.000
min2888.000-2706.000=182.000
max2888.000-2706.000=182.000
mean2.948-3.050=-0.102
σ0.165-0.124=0.041
min2.675-2.954=-0.279
max3.118-3.242=-0.123
iters=5
new-facts=6402
prior-facts=1
mean4749.251-4749.406=-0.154
σ1.005-0.883=0.123
min4748.395-4748.875=-0.479
max4750.991-4750.974=0.017
mean2888.000-2706.000=182.000
σ0.000
min2888.000-2706.000=182.000
max2888.000-2706.000=182.000
mean8.661-8.396=0.265
σ0.264-0.438=-0.175
min8.373-7.951=0.422
max9.051-8.974=0.077
iters=5
new-facts=6402
prior-facts=6402
mean4939.837-4939.831=0.006
σ0.014-0.022=-0.008
min4939.815-4939.805=0.009
max4939.851-4939.852=-0.001
mean3081.600-3020.000=61.600
σ212.043-250.738=-38.695
min2888.000-2706.000=182.000
max3402.000-3368.000=34.000
mean8.525-8.508=0.017
σ0.143-0.214=-0.072
min8.360-8.240=0.119
max8.725-8.803=-0.078

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.047-1.206=-0.159
σ0.178-0.358=-0.180
min0.936-0.939=-0.002
max1.348-1.795=-0.447

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.515-465.504=0.011
σ575.927-575.926=0.001
min177.538-177.535=0.003
max1329.406-1329.393=0.013
mean86.250
σ8.500
min82.000
max99.000
mean2888.000-2706.000=182.000
σ0.000
min2888.000-2706.000=182.000
max2888.000-2706.000=182.000
mean0.480-0.550=-0.070
σ0.374-0.540=-0.165
min0.289-0.278=0.011
max1.042-1.360=-0.318
policies=20
mean1775.734-1775.661=0.073
σ0.374-0.369=0.005
min1775.466-1775.431=0.035
max1776.283-1776.211=0.072
mean820.000
σ0.000
min820.000
max820.000
mean2888.000-2706.000=182.000
σ0.000
min2888.000-2706.000=182.000
max2888.000-2706.000=182.000
mean2.854-2.773=0.082
σ0.005-0.018=-0.013
min2.851-2.761=0.091
max2.862-2.799=0.063
policies=200
mean17764.015-17763.868=0.147
σ0.433-0.593=-0.161
min17763.764-17763.495=0.269
max17764.663-17764.741=-0.079
mean8200.000
σ0.000
min8200.000
max8200.000
mean2888.000-2706.000=182.000
σ0.000
min2888.000-2706.000=182.000
max2888.000-2706.000=182.000
mean28.418-27.905=0.512
σ0.430-0.131=0.299
min27.898-27.727=0.171
max28.808-28.043=0.766