Compare commits

Home / Compare 91eadc06 .. e65b0a37

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.788-70.786=0.002
σ0.047-0.045=0.002
min70.758-70.758=0.000
max70.919-70.911=0.008
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.156-0.154=0.002
σ0.005-0.004=0.001
min0.149-0.150=-0.000
max0.165-0.160=0.006
cache=y
dps=1
iters=10
policies=100
mean21.496-21.496=0.000
σ0.004-0.003=0.001
min21.491-21.492=-0.001
max21.503-21.499=0.003
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.062-0.062=0.000
σ0.003-0.003=-0.000
min0.059-0.059=-0.000
max0.067-0.070=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.096-1754.092=0.003
σ0.361-0.359=0.001
min1753.533-1753.530=0.003
max1754.679-1754.681=-0.002
mean1669.450-1648.100=21.350
σ640.983-610.775=30.209
min630.000-635.000=-5.000
max2731.000-2471.000=260.000
mean2.851-2.760=0.090
σ0.160-0.207=-0.047
min2.494-2.364=0.130
max3.115-3.227=-0.112

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.956-271.956=-0.001
σ0.008-0.008=-0.001
min271.948-271.946=0.003
max271.966-271.966=0.001
mean2731.000-2471.000=260.000
σ0.000
min2731.000-2471.000=260.000
max2731.000-2471.000=260.000
mean0.386-0.390=-0.004
σ0.010-0.010=0.001
min0.378-0.380=-0.002
max0.398-0.399=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.330-1932.321=0.009
σ0.012-0.011=0.001
min1932.315-1932.309=0.006
max1932.346-1932.335=0.011
mean2731.000-2471.000=260.000
σ0.000
min2731.000-2471.000=260.000
max2731.000-2471.000=260.000
mean3.014-2.925=0.089
σ0.229-0.257=-0.028
min2.662-2.479=0.183
max3.275-3.142=0.133
iters=5
new-facts=6402
prior-facts=1
mean4753.045-4753.073=-0.027
σ0.918-0.923=-0.006
min4752.556-4752.572=-0.016
max4754.679-4754.720=-0.041
mean2731.000-2471.000=260.000
σ0.000
min2731.000-2471.000=260.000
max2731.000-2471.000=260.000
mean8.751-8.710=0.041
σ0.472-0.301=0.171
min8.017-8.368=-0.351
max9.114-9.038=0.077
iters=5
new-facts=6402
prior-facts=6402
mean4943.482-4943.554=-0.072
σ0.144-0.024=0.120
min4943.225-4943.535=-0.309
max4943.573-4943.586=-0.013
mean2979.200-3001.200=-22.000
σ220.222-279.158=-58.936
min2731.000-2613.000=118.000
max3292.000-3312.000=-20.000
mean8.537-8.453=0.084
σ0.156-0.087=0.069
min8.396-8.345=0.050
max8.803-8.588=0.215

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.044-1.710=-0.666
σ0.134-0.125=0.009
min0.923-1.520=-0.597
max1.251-1.843=-0.592

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.663-468.654=0.009
σ574.938-574.926=0.012
min181.194-181.188=0.006
max1331.070-1331.043=0.027
mean88.250
σ8.500
min84.000
max101.000
mean2731.000-2471.000=260.000
σ0.000
min2731.000-2471.000=260.000
max2731.000-2471.000=260.000
mean0.543-0.570=-0.027
σ0.505-0.564=-0.059
min0.279-0.281=-0.002
max1.300-1.416=-0.116
policies=20
mean1812.224-1812.179=0.045
σ0.388-0.388=0.000
min1811.968-1811.927=0.041
max1812.800-1812.755=0.045
mean840.000
σ0.000
min840.000
max840.000
mean2731.000-2471.000=260.000
σ0.000
min2731.000-2471.000=260.000
max2731.000-2471.000=260.000
mean2.844-2.825=0.018
σ0.035-0.016=0.019
min2.809-2.808=0.001
max2.884-2.844=0.041
policies=200
mean18129.195-18129.154=0.042
σ0.399-0.434=-0.035
min18128.868-18128.861=0.006
max18129.775-18129.796=-0.022
mean8400.000
σ0.000
min8400.000
max8400.000
mean2731.000-2471.000=260.000
σ0.000
min2731.000-2471.000=260.000
max2731.000-2471.000=260.000
mean28.455-28.528=-0.073
σ0.070-0.077=-0.007
min28.356-28.430=-0.073
max28.516-28.597=-0.081