Compare commits

Home / Compare 9f60a4e8 .. 50074109

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.391-70.388=0.002
σ0.047-0.045=0.002
min70.362-70.363=-0.001
max70.521-70.512=0.009
mean415.000
σ0.000
min415.000
max415.000
mean0.162-0.156=0.006
σ0.003-0.005=-0.002
min0.158-0.148=0.009
max0.168-0.163=0.005
cache=y
dps=1
iters=10
policies=100
mean21.144-21.145=-0.000
σ0.003-0.002=0.000
min21.141-21.141=0.000
max21.149-21.147=0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.064-0.064=0.000
σ0.002-0.002=0.000
min0.062-0.062=0.001
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.395-1752.395=0.000
σ0.360-0.361=-0.001
min1751.828-1751.823=0.005
max1752.981-1752.981=0.000
mean1658.100-1636.550=21.550
σ629.040-615.915=13.124
min619.000-631.000=-12.000
max2775.000-2474.000=301.000
mean2.858-2.816=0.042
σ0.096-0.180=-0.083
min2.631-2.207=0.424
max3.070-2.990=0.080

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.143-270.140=0.003
σ0.004-0.007=-0.003
min270.136-270.130=0.006
max270.146-270.148=-0.002
mean2775.000-2474.000=301.000
σ0.000
min2775.000-2474.000=301.000
max2775.000-2474.000=301.000
mean0.378-0.358=0.019
σ0.002-0.022=-0.020
min0.375-0.326=0.049
max0.379-0.376=0.003
iters=5
new-facts=1
prior-facts=6402
mean1930.594-1930.611=-0.017
σ0.023-0.011=0.012
min1930.570-1930.599=-0.029
max1930.616-1930.623=-0.006
mean2775.000-2474.000=301.000
σ0.000
min2775.000-2474.000=301.000
max2775.000-2474.000=301.000
mean2.532-2.515=0.017
σ0.185-0.077=0.107
min2.327-2.445=-0.118
max2.830-2.602=0.229
iters=5
new-facts=6402
prior-facts=1
mean4751.308-4751.255=0.053
σ0.899-0.860=0.038
min4750.793-4750.781=0.012
max4752.905-4752.788=0.117
mean2775.000-2474.000=301.000
σ0.000
min2775.000-2474.000=301.000
max2775.000-2474.000=301.000
mean8.521-8.814=-0.293
σ0.551-0.416=0.135
min7.644-8.292=-0.647
max9.065-9.245=-0.180
iters=5
new-facts=6402
prior-facts=6402
mean4941.704-4941.773=-0.070
σ0.172-0.015=0.157
min4941.396-4941.758=-0.362
max4941.795-4941.795=-0.001
mean3010.000-3006.200=3.800
σ219.589-261.276=-41.687
min2775.000-2621.000=154.000
max3308.000-3319.000=-11.000
mean8.513-8.521=-0.008
σ0.123-0.129=-0.006
min8.385-8.381=0.003
max8.683-8.700=-0.018

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.998-1.792=-0.794
σ0.147-0.114=0.034
min0.927-1.632=-0.706
max1.262-1.932=-0.671

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.374-466.370=0.005
σ575.928-575.924=0.004
min178.400-178.404=-0.004
max1330.266-1330.256=0.010
mean84.250
σ8.500
min80.000
max97.000
mean2775.000-2474.000=301.000
σ0.000
min2775.000-2474.000=301.000
max2775.000-2474.000=301.000
mean0.441-0.546=-0.105
σ0.300-0.534=-0.234
min0.286-0.276=0.010
max0.892-1.347=-0.455
policies=20
mean1784.351-1784.325=0.025
σ0.372-0.356=0.016
min1784.105-1784.103=0.002
max1784.902-1784.856=0.046
mean800.000
σ0.000
min800.000
max800.000
mean2775.000-2474.000=301.000
σ0.000
min2775.000-2474.000=301.000
max2775.000-2474.000=301.000
mean2.843-2.769=0.074
σ0.076-0.005=0.070
min2.772-2.763=0.009
max2.942-2.773=0.168
policies=200
mean17849.819-17849.757=0.062
σ0.529-0.572=-0.043
min17849.383-17849.381=0.002
max17850.588-17850.603=-0.015
mean8000.000
σ0.000
min8000.000
max8000.000
mean2775.000-2474.000=301.000
σ0.000
min2775.000-2474.000=301.000
max2775.000-2474.000=301.000
mean28.010-27.836=0.174
σ0.184-0.073=0.111
min27.851-27.784=0.068
max28.274-27.940=0.334