Compare commits

Home / Compare 7432e0b4 .. d53c0589

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.734-70.735=-0.001
σ0.051-0.052=-0.001
min70.700-70.705=-0.005
max70.875-70.880=-0.005
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.158-0.156=0.001
σ0.004-0.004=0.000
min0.150-0.151=-0.001
max0.164-0.164=0.000
cache=y
dps=1
iters=10
policies=100
mean21.450-21.447=0.003
σ0.002-0.002=0.000
min21.446-21.444=0.002
max21.454-21.451=0.004
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.064-0.064=-0.000
σ0.003-0.003=-0.000
min0.059-0.060=-0.001
max0.067-0.072=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.883-1751.878=0.004
σ0.361-0.359=0.002
min1751.306-1751.309=-0.003
max1752.464-1752.456=0.008
mean1659.100-1666.350=-7.250
σ626.797-623.902=2.895
min682.000-654.000=28.000
max2659.000-2501.000=158.000
mean2.870-2.826=0.044
σ0.100-0.126=-0.025
min2.677-2.590=0.087
max3.050-3.151=-0.101

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.973-270.966=0.007
σ0.005-0.005=0.000
min270.966-270.960=0.006
max270.978-270.972=0.006
mean2659.000-2501.000=158.000
σ0.000
min2659.000-2501.000=158.000
max2659.000-2501.000=158.000
mean0.379-0.371=0.008
σ0.008-0.004=0.004
min0.371-0.367=0.004
max0.392-0.379=0.014
iters=5
new-facts=1
prior-facts=6402
mean1931.344-1931.361=-0.018
σ0.018-0.024=-0.007
min1931.322-1931.324=-0.002
max1931.366-1931.383=-0.018
mean2659.000-2501.000=158.000
σ0.000
min2659.000-2501.000=158.000
max2659.000-2501.000=158.000
mean3.011-2.929=0.082
σ0.136-0.202=-0.067
min2.783-2.646=0.137
max3.115-3.194=-0.078
iters=5
new-facts=6402
prior-facts=1
mean4752.009-4752.092=-0.083
σ0.940-0.844=0.096
min4751.209-4751.672=-0.463
max4753.632-4753.599=0.033
mean2659.000-2501.000=158.000
σ0.000
min2659.000-2501.000=158.000
max2659.000-2501.000=158.000
mean8.424-8.393=0.031
σ0.486-0.323=0.163
min7.829-7.876=-0.047
max9.173-8.645=0.527
iters=5
new-facts=6402
prior-facts=6402
mean4942.527-4942.513=0.014
σ0.136-0.145=-0.009
min4942.284-4942.255=0.029
max4942.603-4942.598=0.005
mean2981.800-2929.400=52.400
σ335.782-392.169=-56.386
min2659.000-2501.000=158.000
max3450.000-3474.000=-24.000
mean8.403-8.398=0.006
σ0.042-0.150=-0.109
min8.353-8.305=0.048
max8.469-8.663=-0.194

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.074-1.682=-0.607
σ0.153-0.199=-0.046
min0.923-1.360=-0.437
max1.235-1.848=-0.613

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.067-466.057=0.009
σ574.937-574.926=0.012
min178.593-178.588=0.004
max1328.473-1328.446=0.027
mean86.250
σ8.500
min82.000
max99.000
mean2659.000-2501.000=158.000
σ0.000
min2659.000-2501.000=158.000
max2659.000-2501.000=158.000
mean0.569-0.572=-0.003
σ0.583-0.583=0.001
min0.275-0.279=-0.004
max1.444-1.446=-0.001
policies=20
mean1786.138-1786.144=-0.005
σ0.371-0.360=0.011
min1785.912-1785.916=-0.004
max1786.694-1786.681=0.013
mean820.000
σ0.000
min820.000
max820.000
mean2659.000-2501.000=158.000
σ0.000
min2659.000-2501.000=158.000
max2659.000-2501.000=158.000
mean2.765-2.774=-0.009
σ0.022-0.021=0.001
min2.739-2.753=-0.014
max2.793-2.801=-0.008
policies=200
mean17868.370-17868.401=-0.031
σ0.450-0.346=0.104
min17868.020-17868.211=-0.191
max17869.029-17868.920=0.109
mean8200.000
σ0.000
min8200.000
max8200.000
mean2659.000-2501.000=158.000
σ0.000
min2659.000-2501.000=158.000
max2659.000-2501.000=158.000
mean27.923-27.851=0.072
σ0.077-0.040=0.037
min27.856-27.800=0.056
max28.003-27.898=0.105