Compare commits

Home / Compare 184e86a7 .. 9a143f48

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.562=0.004
σ0.045-0.046=-0.001
min70.538-70.534=0.004
max70.688-70.689=-0.001
mean414.800-413.000=1.800
σ0.422-0.000=0.422
min414.000-413.000=1.000
max415.000-413.000=2.000
mean0.159-0.159=0.001
σ0.003-0.003=-0.000
min0.156-0.154=0.002
max0.164-0.164=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.288-21.290=-0.002
σ0.003-0.012=-0.009
min21.285-21.283=0.002
max21.292-21.322=-0.030
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.063-0.065=-0.002
σ0.003-0.003=0.000
min0.060-0.064=-0.004
max0.071-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.376-1753.374=0.002
σ0.361-0.360=0.000
min1752.802-1752.805=-0.003
max1753.965-1753.963=0.002
mean1656.400-1659.300=-2.900
σ646.966-635.966=11.000
min636.000-617.000=19.000
max2898.000-2801.000=97.000
mean2.829-2.795=0.033
σ0.199-0.150=0.049
min2.177-2.435=-0.259
max3.037-3.106=-0.069

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.758-271.753=0.005
σ0.006-0.005=0.001
min271.751-271.745=0.006
max271.767-271.758=0.010
mean2898.000-2801.000=97.000
σ0.000
min2898.000-2801.000=97.000
max2898.000-2801.000=97.000
mean0.380-0.381=-0.001
σ0.004-0.007=-0.003
min0.378-0.370=0.008
max0.387-0.389=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.180-1932.177=0.003
σ0.012-0.006=0.006
min1932.163-1932.167=-0.004
max1932.197-1932.183=0.014
mean2898.000-2801.000=97.000
σ0.000
min2898.000-2801.000=97.000
max2898.000-2801.000=97.000
mean3.068-3.007=0.061
σ0.132-0.172=-0.040
min2.919-2.765=0.155
max3.215-3.249=-0.034
iters=5
new-facts=6402
prior-facts=1
mean4752.839-4752.779=0.061
σ0.960-0.615=0.344
min4751.809-4752.455=-0.646
max4754.418-4753.878=0.541
mean2898.000-2801.000=97.000
σ0.000
min2898.000-2801.000=97.000
max2898.000-2801.000=97.000
mean8.286-8.617=-0.331
σ0.624-0.190=0.434
min7.676-8.428=-0.752
max9.176-8.902=0.274
iters=5
new-facts=6402
prior-facts=6402
mean4943.385-4943.376=0.009
σ0.017-0.026=-0.009
min4943.364-4943.343=0.021
max4943.404-4943.407=-0.004
mean3063.200-3044.200=19.000
σ246.640-250.771=-4.131
min2898.000-2801.000=97.000
max3450.000-3402.000=48.000
mean8.528-8.831=-0.303
σ0.143-0.311=-0.168
min8.396-8.366=0.030
max8.745-9.162=-0.417

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.052-1.075=-0.023
σ0.126-0.175=-0.048
min0.933-0.931=0.002
max1.246-1.361=-0.115

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.863-467.862=0.001
σ575.925-575.940=-0.015
min179.893-179.885=0.008
max1331.750-1331.771=-0.021
mean86.250
σ8.500
min82.000
max99.000
mean2898.000-2801.000=97.000
σ0.000
min2898.000-2801.000=97.000
max2898.000-2801.000=97.000
mean0.445-0.469=-0.025
σ0.301-0.378=-0.077
min0.292-0.276=0.016
max0.897-1.036=-0.140
policies=20
mean1799.176-1799.135=0.041
σ0.348-0.356=-0.008
min1798.919-1798.918=0.001
max1799.686-1799.667=0.020
mean820.000
σ0.000
min820.000
max820.000
mean2898.000-2801.000=97.000
σ0.000
min2898.000-2801.000=97.000
max2898.000-2801.000=97.000
mean2.884-2.796=0.088
σ0.019-0.024=-0.005
min2.866-2.768=0.098
max2.908-2.823=0.085
policies=200
mean17998.312-17998.486=-0.174
σ0.483-0.555=-0.072
min17997.988-17998.092=-0.104
max17999.031-17999.308=-0.277
mean8200.000
σ0.000
min8200.000
max8200.000
mean2898.000-2801.000=97.000
σ0.000
min2898.000-2801.000=97.000
max2898.000-2801.000=97.000
mean28.515-28.106=0.409
σ0.488-0.102=0.386
min28.078-27.988=0.090
max28.991-28.219=0.772