Compare commits

Home / Compare cc45a119 .. 4d2b387b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.568-70.393=0.174
σ0.044-0.046=-0.002
min70.541-70.365=0.176
max70.687-70.522=0.164
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.159-0.159=0.000
σ0.003-0.004=-0.001
min0.157-0.151=0.006
max0.164-0.165=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.288-21.144=0.143
σ0.003-0.003=-0.001
min21.283-21.139=0.144
max21.293-21.149=0.144
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.065-0.064=0.001
σ0.003-0.002=0.000
min0.063-0.060=0.003
max0.072-0.069=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1715.453-1752.700=-37.247
σ169.569-0.361=169.209
min995.034-1752.129=-757.095
max1753.957-1753.283=0.674
mean1631.800-1660.950=-29.150
σ606.234-634.000=-27.766
min638.000-618.000=20.000
max2457.000-2771.000=-314.000
mean2.745-2.811=-0.066
σ0.328-0.192=0.136
min1.453-2.213=-0.760
max3.059-2.961=0.097

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.754-270.611=1.143
σ0.006-0.006=-0.001
min271.748-270.605=1.143
max271.763-270.619=1.144
mean2457.000-2771.000=-314.000
σ0.000
min2457.000-2771.000=-314.000
max2457.000-2771.000=-314.000
mean0.384-0.379=0.005
σ0.005-0.005=-0.000
min0.380-0.374=0.006
max0.391-0.387=0.004
iters=5
new-facts=1
prior-facts=6402
mean1932.170-1931.037=1.134
σ0.013-0.006=0.008
min1932.148-1931.028=1.119
max1932.182-1931.044=1.139
mean2457.000-2771.000=-314.000
σ0.000
min2457.000-2771.000=-314.000
max2457.000-2771.000=-314.000
mean3.104-2.988=0.117
σ0.120-0.148=-0.028
min2.970-2.786=0.185
max3.266-3.192=0.073
iters=5
new-facts=6402
prior-facts=1
mean4752.928-4751.772=1.157
σ0.894-0.893=0.001
min4752.390-4751.237=1.154
max4754.520-4753.359=1.161
mean2457.000-2771.000=-314.000
σ0.000
min2457.000-2771.000=-314.000
max2457.000-2771.000=-314.000
mean8.384-8.599=-0.215
σ0.449-0.440=0.009
min7.804-8.189=-0.385
max9.019-9.192=-0.173
iters=5
new-facts=6402
prior-facts=6402
mean4943.242-4942.086=1.157
σ0.194-0.187=0.006
min4943.011-4941.871=1.140
max4943.398-4942.253=1.146
mean2918.400-3007.400=-89.000
σ385.683-223.052=162.631
min2457.000-2771.000=-314.000
max3432.000-3315.000=117.000
mean8.529-8.591=-0.062
σ0.172-0.201=-0.029
min8.371-8.416=-0.046
max8.769-8.883=-0.113

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.740-0.987=0.753
σ0.121-0.141=-0.020
min1.576-0.920=0.656
max1.885-1.238=0.647

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.855-467.206=0.649
σ575.925-575.940=-0.016
min179.887-179.230=0.657
max1331.742-1331.116=0.625
mean86.250
σ8.500
min82.000
max99.000
mean2457.000-2771.000=-314.000
σ0.000
min2457.000-2771.000=-314.000
max2457.000-2771.000=-314.000
mean0.559-0.444=0.116
σ0.552-0.305=0.247
min0.280-0.288=-0.008
max1.387-0.901=0.486
policies=20
mean1799.148-1792.616=6.532
σ0.373-0.328=0.044
min1798.914-1792.377=6.537
max1799.704-1793.101=6.603
mean820.000
σ0.000
min820.000
max820.000
mean2457.000-2771.000=-314.000
σ0.000
min2457.000-2771.000=-314.000
max2457.000-2771.000=-314.000
mean2.796-2.838=-0.043
σ0.020-0.091=-0.071
min2.783-2.784=-0.001
max2.825-2.974=-0.149
policies=200
mean17998.414-17932.984=65.430
σ0.365-0.536=-0.171
min17998.212-17932.582=65.630
max17998.961-17933.774=65.187
mean8200.000
σ0.000
min8200.000
max8200.000
mean2457.000-2771.000=-314.000
σ0.000
min2457.000-2771.000=-314.000
max2457.000-2771.000=-314.000
mean28.140-28.110=0.030
σ0.049-0.166=-0.117
min28.082-27.901=0.181
max28.195-28.301=-0.106