Compare commits

Home / Compare 1ea9154c .. fd6166ec

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798-35.798=-0.000
σ0.107-0.108=-0.001
min35.749-35.752=-0.003
max36.101-36.104=-0.004
mean418.000-411.000=7.000
σ0.000
min418.000-411.000=7.000
max418.000-411.000=7.000
mean0.074-0.074=0.000
σ0.005-0.004=0.001
min0.068-0.069=-0.001
max0.083-0.080=0.003
cache=y
dps=1
iters=10
policies=100
mean26.065-26.064=0.001
σ0.002-0.003=-0.002
min26.062-26.060=0.002
max26.067-26.070=-0.003
mean418.000-411.000=7.000
σ0.000
min418.000-411.000=7.000
max418.000-411.000=7.000
mean0.061-0.061=0.000
σ0.002-0.002=0.000
min0.059-0.059=-0.000
max0.068-0.067=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.922-1755.921=0.000
σ0.367-0.368=-0.001
min1755.352-1755.354=-0.002
max1756.516-1756.509=0.008
mean1669.550-1632.100=37.450
σ627.745-607.034=20.711
min677.000-652.000=25.000
max2667.000-2429.000=238.000
mean2.804-2.804=0.000
σ0.128-0.185=-0.057
min2.535-2.291=0.244
max2.972-3.053=-0.081

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.194-277.196=-0.002
σ0.005-0.004=0.001
min277.188-277.191=-0.003
max277.199-277.200=-0.001
mean2667.000-2429.000=238.000
σ0.000
min2667.000-2429.000=238.000
max2667.000-2429.000=238.000
mean0.395-0.399=-0.004
σ0.004-0.009=-0.005
min0.392-0.393=-0.001
max0.402-0.410=-0.009
iters=5
new-facts=1
prior-facts=6402
mean2174.435-2174.432=0.004
σ0.021-0.027=-0.006
min2174.406-2174.392=0.014
max2174.464-2174.463=0.001
mean2667.000-2429.000=238.000
σ0.000
min2667.000-2429.000=238.000
max2667.000-2429.000=238.000
mean2.825-2.920=-0.095
σ0.137-0.270=-0.133
min2.746-2.691=0.054
max3.068-3.359=-0.291
iters=5
new-facts=6402
prior-facts=1
mean5052.660-5052.612=0.049
σ1.025-1.028=-0.002
min5051.998-5052.072=-0.074
max5054.478-5054.444=0.034
mean2667.000-2429.000=238.000
σ0.000
min2667.000-2429.000=238.000
max2667.000-2429.000=238.000
mean8.823-9.148=-0.324
σ1.015-0.687=0.328
min8.029-8.144=-0.115
max10.468-9.996=0.471
iters=5
new-facts=6402
prior-facts=6402
mean5188.352-5188.422=-0.070
σ0.211-0.093=0.118
min5188.002-5188.351=-0.349
max5188.527-5188.529=-0.002
mean3276.200-3192.200=84.000
σ482.314-485.079=-2.765
min2667.000-2604.000=63.000
max3858.000-3837.000=21.000
mean8.937-8.894=0.043
σ0.429-0.210=0.219
min8.652-8.669=-0.017
max9.675-9.128=0.546

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.243-1.804=-0.561
σ0.372-0.106=0.266
min0.941-1.666=-0.725
max1.878-1.946=-0.068

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.855-464.844=0.011
σ572.657-572.646=0.012
min178.521-178.520=0.001
max1323.841-1323.812=0.029
mean79.500
σ7.000
min76.000
max90.000
mean2667.000-2429.000=238.000
σ0.000
min2667.000-2429.000=238.000
max2667.000-2429.000=238.000
mean0.546-0.559=-0.014
σ0.514-0.557=-0.044
min0.279-0.279=0.000
max1.316-1.395=-0.079
policies=20
mean1785.465-1785.456=0.009
σ0.349-0.349=0.000
min1785.230-1785.227=0.003
max1785.983-1785.975=0.009
mean760.000
σ0.000
min760.000
max760.000
mean2667.000-2429.000=238.000
σ0.000
min2667.000-2429.000=238.000
max2667.000-2429.000=238.000
mean2.785-2.789=-0.004
σ0.022-0.013=0.009
min2.763-2.769=-0.006
max2.815-2.797=0.018
policies=200
mean17861.512-17861.406=0.106
σ0.550-0.408=0.141
min17861.098-17861.124=-0.026
max17862.322-17862.011=0.311
mean7600.000
σ0.000
min7600.000
max7600.000
mean2667.000-2429.000=238.000
σ0.000
min2667.000-2429.000=238.000
max2667.000-2429.000=238.000
mean28.261-28.114=0.146
σ0.102-0.067=0.035
min28.127-28.050=0.077
max28.352-28.180=0.171