Compare commits

Home / Compare 00ebc55c .. c79b1eb4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.564=0.218
σ0.047-0.046=0.001
min70.747-70.541=0.206
max70.911-70.694=0.217
mean415.000
σ0.000
min415.000
max415.000
mean0.160-0.158=0.002
σ0.004-0.003=0.001
min0.157-0.155=0.002
max0.169-0.164=0.005
cache=y
dps=1
iters=10
policies=100
mean21.493-21.288=0.205
σ0.002-0.002=-0.001
min21.491-21.285=0.206
max21.496-21.292=0.204
mean415.000
σ0.000
min415.000
max415.000
mean0.065-0.064=0.000
σ0.002-0.002=0.000
min0.063-0.062=0.001
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.095-1753.374=0.721
σ0.361-0.361=0.000
min1753.529-1752.802=0.727
max1754.676-1753.956=0.721
mean1643.400-1658.000=-14.600
σ604.721-644.335=-39.614
min655.000-618.000=37.000
max2458.000-2771.000=-313.000
mean2.848-2.832=0.016
σ0.169-0.142=0.026
min2.277-2.441=-0.164
max3.190-3.134=0.056

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.951-271.757=0.194
σ0.006-0.007=-0.000
min271.944-271.750=0.194
max271.958-271.766=0.192
mean2458.000-2771.000=-313.000
σ0.000
min2458.000-2771.000=-313.000
max2458.000-2771.000=-313.000
mean0.380-0.380=-0.000
σ0.002-0.007=-0.005
min0.378-0.373=0.006
max0.383-0.388=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1932.329-1932.184=0.145
σ0.010-0.007=0.003
min1932.319-1932.177=0.142
max1932.342-1932.193=0.149
mean2458.000-2771.000=-313.000
σ0.000
min2458.000-2771.000=-313.000
max2458.000-2771.000=-313.000
mean2.966-2.988=-0.022
σ0.138-0.137=0.001
min2.727-2.811=-0.084
max3.084-3.196=-0.112
iters=5
new-facts=6402
prior-facts=1
mean4752.948-4752.712=0.236
σ0.995-0.736=0.258
min4752.153-4751.913=0.240
max4754.685-4753.919=0.766
mean2458.000-2771.000=-313.000
σ0.000
min2458.000-2771.000=-313.000
max2458.000-2771.000=-313.000
mean8.644-8.319=0.326
σ0.556-0.415=0.140
min7.772-7.749=0.022
max9.240-8.736=0.504
iters=5
new-facts=6402
prior-facts=6402
mean4943.489-4943.374=0.115
σ0.152-0.023=0.129
min4943.218-4943.342=-0.123
max4943.577-4943.401=0.175
mean2979.000-3018.400=-39.400
σ256.990-285.605=-28.615
min2638.000-2771.000=-133.000
max3300.000-3424.000=-124.000
mean8.458-8.434=0.024
σ0.096-0.119=-0.023
min8.311-8.316=-0.005
max8.552-8.633=-0.081

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.831-1.015=0.816
σ0.099-0.140=-0.041
min1.740-0.922=0.818
max1.986-1.244=0.742

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.627-467.861=0.766
σ574.923-575.925=-1.002
min181.164-179.890=1.274
max1331.011-1331.748=-0.737
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2458.000-2771.000=-313.000
σ0.000
min2458.000-2771.000=-313.000
max2458.000-2771.000=-313.000
mean0.579-0.443=0.135
σ0.571-0.299=0.272
min0.288-0.292=-0.004
max1.435-0.892=0.543
policies=20
mean1811.914-1799.177=12.737
σ0.372-0.337=0.035
min1811.689-1798.924=12.765
max1812.465-1799.672=12.793
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2458.000-2771.000=-313.000
σ0.000
min2458.000-2771.000=-313.000
max2458.000-2771.000=-313.000
mean2.820-2.841=-0.021
σ0.036-0.081=-0.045
min2.773-2.796=-0.023
max2.860-2.962=-0.102
policies=200
mean18126.656-17998.497=128.159
σ0.535-0.464=0.071
min18126.243-17998.156=128.087
max18127.418-17999.182=128.236
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2458.000-2771.000=-313.000
σ0.000
min2458.000-2771.000=-313.000
max2458.000-2771.000=-313.000
mean28.602-28.190=0.413
σ0.085-0.076=0.008
min28.509-28.119=0.390
max28.688-28.297=0.392