Compare commits

Home / Compare 653a77fa .. 3da987ae

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.994-33.994=-0.000
σ0.052-0.052=-0.000
min33.965-33.955=0.010
max34.139-34.139=0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.085-0.085=-0.000
σ0.004-0.003=0.001
min0.082-0.082=-0.000
max0.093-0.091=0.002
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.001
σ0.002-0.003=-0.001
min23.314-23.315=-0.000
max23.320-23.324=-0.004
mean414.000
σ0.000
min414.000
max414.000
mean0.064-0.066=-0.002
σ0.003-0.003=0.000
min0.060-0.063=-0.003
max0.069-0.073=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1762.690-1762.685=0.005
σ0.366-0.365=0.001
min1762.117-1762.116=0.001
max1763.287-1763.285=0.002
mean1624.350-1655.950=-31.600
σ596.784-624.419=-27.635
min643.000-665.000=-22.000
max2409.000-2609.000=-200.000
mean2.370-2.488=-0.118
σ0.108-0.231=-0.124
min2.221-2.194=0.026
max2.663-2.997=-0.334

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean339.177-339.177=-0.000
σ0.064-0.059=0.004
min339.063-339.072=-0.009
max339.207-339.211=-0.004
mean2409.000-2609.000=-200.000
σ0.000
min2409.000-2609.000=-200.000
max2409.000-2609.000=-200.000
mean0.435-0.432=0.003
σ0.001-0.001=0.000
min0.434-0.431=0.003
max0.436-0.433=0.003
iters=5
new-facts=1
prior-facts=6402
mean2003.798-2003.806=-0.008
σ0.014-0.014=0.000
min2003.784-2003.793=-0.009
max2003.814-2003.827=-0.012
mean2409.000-2609.000=-200.000
σ0.000
min2409.000-2609.000=-200.000
max2409.000-2609.000=-200.000
mean3.166-3.208=-0.042
σ0.201-0.071=0.130
min2.884-3.148=-0.264
max3.450-3.317=0.133
iters=5
new-facts=6402
prior-facts=1
mean4828.423-4828.554=-0.131
σ7.753-7.684=0.069
min4824.527-4825.030=-0.503
max4842.285-4842.298=-0.013
mean2409.000-2609.000=-200.000
σ0.000
min2409.000-2609.000=-200.000
max2409.000-2609.000=-200.000
mean8.415-8.444=-0.029
σ0.272-0.399=-0.127
min7.946-7.936=0.011
max8.641-8.937=-0.297
iters=5
new-facts=6402
prior-facts=6402
mean5016.207-5016.060=0.147
σ0.017-0.329=-0.312
min5016.181-5015.472=0.709
max5016.221-5016.218=0.003
mean2957.400-2984.400=-27.000
σ276.609-295.647=-19.039
min2577.000-2609.000=-32.000
max3296.000-3371.000=-75.000
mean8.667-8.634=0.033
σ0.231-0.168=0.063
min8.507-8.428=0.079
max9.068-8.846=0.222

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.827-1.185=0.643
σ0.071-0.313=-0.242
min1.744-0.918=0.826
max1.911-1.684=0.227

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.144-468.158=-0.014
σ575.280-575.293=-0.013
min180.503-180.506=-0.003
max1331.064-1331.097=-0.034
mean92.250
σ8.500
min88.000
max105.000
mean2409.000-2609.000=-200.000
σ0.000
min2409.000-2609.000=-200.000
max2409.000-2609.000=-200.000
mean0.588-0.549=0.039
σ0.615-0.534=0.081
min0.279-0.281=-0.002
max1.510-1.350=0.160
policies=20
mean1805.315-1805.350=-0.035
σ0.398-0.391=0.007
min1805.071-1805.103=-0.033
max1805.909-1805.931=-0.022
mean880.000
σ0.000
min880.000
max880.000
mean2409.000-2609.000=-200.000
σ0.000
min2409.000-2609.000=-200.000
max2409.000-2609.000=-200.000
mean2.765-2.793=-0.028
σ0.021-0.042=-0.021
min2.739-2.764=-0.026
max2.789-2.855=-0.066
policies=200
mean18060.903-18061.005=-0.102
σ0.497-0.625=-0.128
min18060.645-18060.654=-0.010
max18061.649-18061.941=-0.292
mean8800.000
σ0.000
min8800.000
max8800.000
mean2409.000-2609.000=-200.000
σ0.000
min2409.000-2609.000=-200.000
max2409.000-2609.000=-200.000
mean27.957-27.922=0.035
σ0.136-0.154=-0.018
min27.805-27.786=0.019
max28.081-28.107=-0.025