Compare commits

Home / Compare 703e0949 .. 929db996

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.041=-0.001
σ0.047-0.046=0.001
min31.005-31.006=-0.001
max31.172-31.170=0.003
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.079-0.080=-0.001
σ0.003-0.004=-0.000
min0.076-0.077=-0.000
max0.086-0.087=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=-0.001
σ0.003-0.003=-0.000
min21.139-21.140=-0.001
max21.146-21.147=-0.001
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.064-0.062=0.002
σ0.003-0.004=-0.001
min0.062-0.058=0.004
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.413-1751.412=0.002
σ0.363-0.362=0.001
min1750.841-1750.847=-0.006
max1752.000-1751.997=0.003
mean1656.700-1637.950=18.750
σ642.369-614.053=28.316
min629.000-634.000=-5.000
max2851.000-2471.000=380.000
mean2.877-2.847=0.030
σ0.155-0.140=0.016
min2.493-2.560=-0.068
max3.061-3.043=0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.760-266.780=-0.020
σ0.008-0.005=0.003
min266.753-266.776=-0.023
max266.772-266.787=-0.016
mean2851.000-2471.000=380.000
σ0.000
min2851.000-2471.000=380.000
max2851.000-2471.000=380.000
mean0.364-0.366=-0.002
σ0.002-0.004=-0.002
min0.363-0.364=-0.001
max0.368-0.373=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1927.209-1927.209=-0.000
σ0.009-0.009=0.000
min1927.200-1927.201=-0.001
max1927.224-1927.222=0.002
mean2851.000-2471.000=380.000
σ0.000
min2851.000-2471.000=380.000
max2851.000-2471.000=380.000
mean2.998-3.022=-0.024
σ0.128-0.342=-0.214
min2.815-2.505=0.310
max3.166-3.450=-0.284
iters=5
new-facts=6402
prior-facts=1
mean4747.562-4747.753=-0.191
σ0.935-0.778=0.157
min4746.595-4747.294=-0.699
max4749.125-4749.135=-0.010
mean2851.000-2471.000=380.000
σ0.000
min2851.000-2471.000=380.000
max2851.000-2471.000=380.000
mean8.507-8.196=0.312
σ0.670-0.361=0.309
min7.663-7.826=-0.163
max9.041-8.734=0.307
iters=5
new-facts=6402
prior-facts=6402
mean4938.169-4938.090=0.079
σ0.090-0.210=-0.119
min4938.088-4937.734=0.354
max4938.274-4938.247=0.027
mean3065.000-2932.600=132.400
σ220.575-404.824=-184.248
min2851.000-2471.000=380.000
max3385.000-3459.000=-74.000
mean8.608-8.497=0.111
σ0.286-0.152=0.134
min8.327-8.384=-0.057
max8.992-8.685=0.307

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.051-1.636=-0.585
σ0.132-0.095=0.037
min0.932-1.542=-0.610
max1.254-1.796=-0.542

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.119-465.113=0.006
σ575.756-575.756=-0.000
min177.240-177.230=0.009
max1328.752-1328.747=0.005
mean79.750
σ7.500
min76.000
max91.000
mean2851.000-2471.000=380.000
σ0.000
min2851.000-2471.000=380.000
max2851.000-2471.000=380.000
mean0.448-0.546=-0.098
σ0.312-0.527=-0.215
min0.287-0.279=0.007
max0.915-1.336=-0.421
policies=20
mean1772.622-1772.564=0.057
σ0.335-0.340=-0.005
min1772.377-1772.330=0.047
max1773.114-1773.069=0.045
mean760.000
σ0.000
min760.000
max760.000
mean2851.000-2471.000=380.000
σ0.000
min2851.000-2471.000=380.000
max2851.000-2471.000=380.000
mean2.835-2.763=0.072
σ0.006-0.007=-0.001
min2.827-2.754=0.073
max2.841-2.771=0.070
policies=200
mean17732.440-17732.517=-0.076
σ0.532-0.490=0.041
min17732.036-17732.251=-0.215
max17733.217-17733.252=-0.035
mean7600.000
σ0.000
min7600.000
max7600.000
mean2851.000-2471.000=380.000
σ0.000
min2851.000-2471.000=380.000
max2851.000-2471.000=380.000
mean28.193-27.850=0.343
σ0.475-0.153=0.322
min27.677-27.703=-0.026
max28.630-28.050=0.580