Compare commits

Home / Compare 824601bf .. 3185a422

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.041-31.040=0.000
σ0.049-0.049=0.000
min30.999-31.000=-0.001
max31.175-31.175=-0.000
mean412.000-411.000=1.000
σ0.000
min412.000-411.000=1.000
max412.000-411.000=1.000
mean0.077-0.079=-0.001
σ0.006-0.002=0.004
min0.070-0.077=-0.007
max0.089-0.084=0.005
cache=y
dps=1
iters=10
policies=100
mean21.142-21.142=-0.000
σ0.002-0.003=-0.000
min21.139-21.139=0.001
max21.146-21.146=0.000
mean412.000-411.000=1.000
σ0.000
min412.000-411.000=1.000
max412.000-411.000=1.000
mean0.061-0.065=-0.004
σ0.003-0.004=-0.001
min0.058-0.059=-0.001
max0.067-0.073=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.410-1751.411=-0.001
σ0.363-0.362=0.001
min1750.846-1750.852=-0.005
max1751.998-1751.993=0.005
mean1648.750-1653.600=-4.850
σ637.791-646.421=-8.631
min630.000-649.000=-19.000
max2842.000-2848.000=-6.000
mean2.788-2.856=-0.068
σ0.162-0.136=0.026
min2.282-2.480=-0.198
max2.994-3.188=-0.194

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.644-279.072=-7.428
σ0.008-0.005=0.003
min271.631-279.064=-7.433
max271.652-279.077=-7.425
mean2842.000-2848.000=-6.000
σ0.000
min2842.000-2848.000=-6.000
max2842.000-2848.000=-6.000
mean0.378-0.391=-0.013
σ0.005-0.005=0.000
min0.375-0.387=-0.012
max0.387-0.398=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1932.102-1939.518=-7.416
σ0.018-0.012=0.006
min1932.080-1939.500=-7.420
max1932.118-1939.530=-7.412
mean2842.000-2848.000=-6.000
σ0.000
min2842.000-2848.000=-6.000
max2842.000-2848.000=-6.000
mean2.594-2.824=-0.231
σ0.246-0.206=0.040
min2.385-2.500=-0.115
max3.004-3.011=-0.006
iters=5
new-facts=6402
prior-facts=1
mean4752.414-4760.056=-7.642
σ1.008-0.791=0.217
min4751.622-4759.561=-7.940
max4754.113-4761.458=-7.346
mean2842.000-2848.000=-6.000
σ0.000
min2842.000-2848.000=-6.000
max2842.000-2848.000=-6.000
mean8.159-8.165=-0.006
σ0.468-0.379=0.089
min7.752-7.733=0.020
max8.906-8.634=0.273
iters=5
new-facts=6402
prior-facts=6402
mean4943.043-4950.467=-7.424
σ0.080-0.078=0.002
min4942.971-4950.401=-7.430
max4943.131-4950.555=-7.424
mean3063.600-3077.200=-13.600
σ295.017-302.031=-7.014
min2842.000-2848.000=-6.000
max3521.000-3541.000=-20.000
mean8.432-8.491=-0.059
σ0.270-0.122=0.148
min8.276-8.378=-0.101
max8.910-8.639=0.271

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.044-1.077=-0.033
σ0.117-0.108=0.009
min0.937-0.935=0.002
max1.222-1.238=-0.017

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.122-463.339=1.783
σ575.755-572.202=3.553
min177.237-177.229=0.009
max1328.754-1321.642=7.112
mean79.750
σ7.500
min76.000
max91.000
mean2842.000-2848.000=-6.000
σ0.000
min2842.000-2848.000=-6.000
max2842.000-2848.000=-6.000
mean0.434-0.439=-0.005
σ0.305-0.308=-0.003
min0.281-0.281=-0.001
max0.891-0.901=-0.010
policies=20
mean1772.626-1772.598=0.028
σ0.333-0.338=-0.005
min1772.393-1772.348=0.045
max1773.115-1773.093=0.023
mean760.000
σ0.000
min760.000
max760.000
mean2842.000-2848.000=-6.000
σ0.000
min2842.000-2848.000=-6.000
max2842.000-2848.000=-6.000
mean2.831-2.840=-0.010
σ0.011-0.021=-0.010
min2.817-2.816=0.001
max2.844-2.863=-0.019
policies=200
mean17732.541-17732.480=0.061
σ0.465-0.483=-0.018
min17732.189-17732.189=0.000
max17733.227-17733.203=0.024
mean7600.000
σ0.000
min7600.000
max7600.000
mean2842.000-2848.000=-6.000
σ0.000
min2842.000-2848.000=-6.000
max2842.000-2848.000=-6.000
mean28.173-28.171=0.003
σ0.575-0.455=0.120
min27.577-27.763=-0.186
max28.875-28.586=0.288