Compare commits

Home / Compare 0db0ad2e .. 05aafc3e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.561-70.566=-0.005
σ0.046-0.047=-0.001
min70.540-70.541=-0.001
max70.692-70.696=-0.004
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.157-0.159=-0.002
σ0.004-0.004=0.001
min0.150-0.155=-0.005
max0.164-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=-0.000
σ0.003-0.004=-0.001
min21.284-21.283=0.001
max21.292-21.297=-0.005
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.064-0.065=-0.001
σ0.002-0.002=0.000
min0.058-0.063=-0.004
max0.066-0.071=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1753.374=0.001
σ0.360-0.362=-0.002
min1752.805-1752.803=0.002
max1753.961-1753.981=-0.020
mean1662.250-1658.850=3.400
σ638.187-632.132=6.055
min620.000-617.000=3.000
max2812.000-2777.000=35.000
mean2.843-2.799=0.044
σ0.144-0.140=0.005
min2.516-2.556=-0.041
max3.133-3.178=-0.046

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.755-271.754=0.001
σ0.009-0.005=0.004
min271.744-271.749=-0.005
max271.766-271.760=0.006
mean2812.000-2777.000=35.000
σ0.000
min2812.000-2777.000=35.000
max2812.000-2777.000=35.000
mean0.384-0.383=0.001
σ0.011-0.007=0.005
min0.370-0.378=-0.007
max0.400-0.393=0.007
iters=5
new-facts=1
prior-facts=6402
mean1932.179-1932.178=0.001
σ0.015-0.014=0.002
min1932.160-1932.157=0.002
max1932.197-1932.194=0.003
mean2812.000-2777.000=35.000
σ0.000
min2812.000-2777.000=35.000
max2812.000-2777.000=35.000
mean2.929-2.886=0.044
σ0.152-0.191=-0.039
min2.726-2.575=0.151
max3.120-3.073=0.047
iters=5
new-facts=6402
prior-facts=1
mean4752.754-4752.807=-0.054
σ1.045-0.996=0.049
min4751.862-4752.100=-0.237
max4754.566-4754.566=-0.000
mean2812.000-2777.000=35.000
σ0.000
min2812.000-2777.000=35.000
max2812.000-2777.000=35.000
mean8.958-8.503=0.454
σ0.133-0.549=-0.416
min8.796-7.652=1.144
max9.146-9.127=0.019
iters=5
new-facts=6402
prior-facts=6402
mean4943.366-4943.377=-0.011
σ0.015-0.018=-0.003
min4943.348-4943.351=-0.003
max4943.385-4943.399=-0.014
mean3004.000-2994.400=9.600
σ274.332-210.559=63.772
min2812.000-2777.000=35.000
max3446.000-3304.000=142.000
mean8.453-8.559=-0.106
σ0.048-0.085=-0.037
min8.408-8.457=-0.049
max8.533-8.634=-0.101

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.009-1.041=-0.031
σ0.156-0.185=-0.029
min0.931-0.920=0.010
max1.289-1.354=-0.065

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.866-467.858=0.008
σ575.935-575.936=-0.000
min179.890-179.889=0.001
max1331.769-1331.761=0.008
mean86.250
σ8.500
min82.000
max99.000
mean2812.000-2777.000=35.000
σ0.000
min2812.000-2777.000=35.000
max2812.000-2777.000=35.000
mean0.557-0.477=0.081
σ0.536-0.397=0.139
min0.287-0.275=0.012
max1.361-1.071=0.290
policies=20
mean1799.151-1799.170=-0.019
σ0.351-0.372=-0.021
min1798.909-1798.920=-0.011
max1799.666-1799.723=-0.058
mean820.000
σ0.000
min820.000
max820.000
mean2812.000-2777.000=35.000
σ0.000
min2812.000-2777.000=35.000
max2812.000-2777.000=35.000
mean2.850-2.788=0.062
σ0.135-0.021=0.114
min2.779-2.772=0.007
max3.053-2.818=0.235
policies=200
mean17998.407-17998.484=-0.078
σ0.576-0.423=0.153
min17997.991-17998.258=-0.267
max17999.244-17999.119=0.125
mean8200.000
σ0.000
min8200.000
max8200.000
mean2812.000-2777.000=35.000
σ0.000
min2812.000-2777.000=35.000
max2812.000-2777.000=35.000
mean28.158-28.115=0.043
σ0.152-0.172=-0.020
min28.070-27.994=0.076
max28.386-28.368=0.018