Compare commits

Home / Compare dcd31166 .. 84d652d3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.696-70.282=0.414
σ0.046-0.046=-0.001
min70.666-70.253=0.412
max70.822-70.410=0.412
mean415.500-416.000=-0.500
σ0.527-0.000=0.527
min415.000-416.000=-1.000
max416.000
mean0.159-0.159=0.000
σ0.005-0.003=0.002
min0.150-0.156=-0.006
max0.166-0.164=0.002
cache=y
dps=1
iters=10
policies=100
mean21.408-20.991=0.417
σ0.003-0.004=-0.000
min21.403-20.986=0.417
max21.412-20.998=0.413
mean416.000
σ0.000
min416.000
max416.000
mean0.065-0.063=0.002
σ0.003-0.003=-0.000
min0.063-0.060=0.004
max0.073-0.070=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.094-1754.093=0.001
σ0.358-0.359=-0.001
min1753.533-1753.530=0.003
max1754.663-1754.674=-0.011
mean1664.150-1666.750=-2.600
σ635.829-630.566=5.263
min630.000-669.000=-39.000
max2783.000-2622.000=161.000
mean2.818-2.813=0.004
σ0.157-0.114=0.042
min2.369-2.553=-0.183
max3.016-2.993=0.024

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.958-271.955=0.003
σ0.006-0.007=-0.001
min271.951-271.948=0.003
max271.965-271.963=0.002
mean2783.000-2622.000=161.000
σ0.000
min2783.000-2622.000=161.000
max2783.000-2622.000=161.000
mean0.388-0.384=0.004
σ0.010-0.005=0.004
min0.380-0.379=0.002
max0.405-0.393=0.012
iters=5
new-facts=1
prior-facts=6402
mean1932.315-1932.324=-0.010
σ0.016-0.009=0.007
min1932.299-1932.313=-0.014
max1932.334-1932.332=0.002
mean2783.000-2622.000=161.000
σ0.000
min2783.000-2622.000=161.000
max2783.000-2622.000=161.000
mean2.930-2.903=0.027
σ0.232-0.266=-0.034
min2.526-2.457=0.069
max3.126-3.145=-0.019
iters=5
new-facts=6402
prior-facts=1
mean4753.060-4753.036=0.024
σ0.896-0.928=-0.032
min4752.616-4752.581=0.035
max4754.661-4754.694=-0.033
mean2783.000-2622.000=161.000
σ0.000
min2783.000-2622.000=161.000
max2783.000-2622.000=161.000
mean8.585-8.599=-0.013
σ0.442-0.436=0.006
min7.846-7.956=-0.110
max8.976-8.981=-0.005
iters=5
new-facts=6402
prior-facts=6402
mean4943.561-4943.556=0.005
σ0.013-0.015=-0.002
min4943.545-4943.536=0.009
max4943.571-4943.572=-0.001
mean2989.000-2973.800=15.200
σ221.088-268.054=-46.965
min2783.000-2622.000=161.000
max3328.000-3335.000=-7.000
mean8.479-8.543=-0.064
σ0.106-0.254=-0.149
min8.370-8.297=0.072
max8.638-8.945=-0.307

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.172-1.317=-0.145
σ0.267-0.362=-0.095
min0.938-0.934=0.004
max1.559-1.851=-0.291

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.667-468.660=0.007
σ574.940-574.936=0.004
min181.190-181.191=-0.001
max1331.076-1331.063=0.013
mean88.250
σ8.500
min84.000
max101.000
mean2783.000-2622.000=161.000
σ0.000
min2783.000-2622.000=161.000
max2783.000-2622.000=161.000
mean0.449-0.540=-0.090
σ0.305-0.497=-0.192
min0.289-0.290=-0.002
max0.907-1.285=-0.378
policies=20
mean1812.248-1812.214=0.034
σ0.389-0.389=0.000
min1811.968-1811.952=0.016
max1812.813-1812.785=0.028
mean840.000
σ0.000
min840.000
max840.000
mean2783.000-2622.000=161.000
σ0.000
min2783.000-2622.000=161.000
max2783.000-2622.000=161.000
mean2.973-2.854=0.120
σ0.054-0.017=0.037
min2.941-2.842=0.099
max3.054-2.879=0.176
policies=200
mean18129.227-18129.220=0.007
σ0.451-0.487=-0.037
min18128.902-18128.913=-0.011
max18129.887-18129.946=-0.058
mean8400.000
σ0.000
min8400.000
max8400.000
mean2783.000-2622.000=161.000
σ0.000
min2783.000-2622.000=161.000
max2783.000-2622.000=161.000
mean28.760-28.619=0.141
σ0.116-0.058=0.057
min28.648-28.548=0.101
max28.920-28.690=0.230