Compare commits

Home / Compare d44a9d9a .. e8dd59b0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.611-70.563=0.048
σ0.046-0.047=-0.001
min70.585-70.543=0.042
max70.737-70.695=0.042
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.156-0.161=-0.004
σ0.006-0.004=0.002
min0.148-0.157=-0.009
max0.166-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.333-21.291=0.041
σ0.003-0.011=-0.009
min21.327-21.286=0.042
max21.335-21.323=0.012
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.064-0.064=0.000
σ0.002-0.002=0.000
min0.063-0.063=0.000
max0.071-0.070=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1753.374=0.000
σ0.360-0.362=-0.002
min1752.805-1752.809=-0.004
max1753.950-1753.958=-0.008
mean1661.600-1664.300=-2.700
σ638.255-628.827=9.428
min618.000-683.000=-65.000
max2810.000-2772.000=38.000
mean2.777-2.801=-0.024
σ0.205-0.151=0.054
min2.144-2.383=-0.239
max3.046-3.070=-0.024

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.754-271.754=-0.000
σ0.007-0.007=-0.000
min271.749-271.744=0.005
max271.762-271.763=-0.001
mean2810.000-2772.000=38.000
σ0.000
min2810.000-2772.000=38.000
max2810.000-2772.000=38.000
mean0.379-0.387=-0.008
σ0.005-0.014=-0.009
min0.375-0.369=0.006
max0.388-0.398=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1932.172-1932.184=-0.012
σ0.012-0.013=-0.002
min1932.162-1932.170=-0.007
max1932.192-1932.206=-0.015
mean2810.000-2772.000=38.000
σ0.000
min2810.000-2772.000=38.000
max2810.000-2772.000=38.000
mean3.032-2.918=0.113
σ0.053-0.270=-0.216
min2.996-2.441=0.555
max3.124-3.106=0.018
iters=5
new-facts=6402
prior-facts=1
mean4752.781-4752.932=-0.152
σ1.020-0.906=0.114
min4751.855-4752.410=-0.554
max4754.535-4754.543=-0.008
mean2810.000-2772.000=38.000
σ0.000
min2810.000-2772.000=38.000
max2810.000-2772.000=38.000
mean8.708-8.514=0.194
σ0.167-0.409=-0.242
min8.505-7.946=0.560
max8.955-8.970=-0.015
iters=5
new-facts=6402
prior-facts=6402
mean4943.305-4943.379=-0.074
σ0.152-0.016=0.136
min4943.034-4943.361=-0.327
max4943.391-4943.401=-0.009
mean2989.600-2996.800=-7.200
σ204.159-226.526=-22.368
min2810.000-2772.000=38.000
max3308.000-3331.000=-23.000
mean8.565-8.489=0.076
σ0.110-0.123=-0.014
min8.423-8.379=0.044
max8.697-8.634=0.063

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.032-1.032=-0.000
σ0.218-0.163=0.055
min0.926-0.927=-0.001
max1.421-1.305=0.117

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.857-467.861=-0.004
σ575.931-575.940=-0.010
min179.885-179.888=-0.003
max1331.753-1331.771=-0.018
mean86.250
σ8.500
min82.000
max99.000
mean2810.000-2772.000=38.000
σ0.000
min2810.000-2772.000=38.000
max2810.000-2772.000=38.000
mean0.474-0.470=0.004
σ0.384-0.375=0.009
min0.279-0.281=-0.002
max1.050-1.032=0.018
policies=20
mean1799.169-1799.169=-0.001
σ0.362-0.371=-0.009
min1798.960-1798.899=0.061
max1799.710-1799.717=-0.007
mean820.000
σ0.000
min820.000
max820.000
mean2810.000-2772.000=38.000
σ0.000
min2810.000-2772.000=38.000
max2810.000-2772.000=38.000
mean2.796-2.805=-0.009
σ0.016-0.030=-0.014
min2.780-2.779=0.001
max2.815-2.847=-0.032
policies=200
mean17998.476-17998.362=0.113
σ0.390-0.599=-0.209
min17998.244-17998.013=0.230
max17999.058-17999.259=-0.201
mean8200.000
σ0.000
min8200.000
max8200.000
mean2810.000-2772.000=38.000
σ0.000
min2810.000-2772.000=38.000
max2810.000-2772.000=38.000
mean28.063-28.126=-0.064
σ0.122-0.096=0.025
min27.981-28.016=-0.035
max28.244-28.249=-0.006