Compare commits

Home / Compare f833f630 .. 3f4a2315

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.565-70.563=0.002
σ0.046-0.045=0.001
min70.539-70.539=0.000
max70.691-70.688=0.003
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.156-0.158=-0.002
σ0.006-0.005=0.000
min0.147-0.149=-0.002
max0.164-0.165=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.288-21.292=-0.003
σ0.002-0.012=-0.010
min21.285-21.284=0.000
max21.291-21.324=-0.033
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.064-0.064=-0.000
σ0.002-0.002=0.000
min0.063-0.063=-0.000
max0.070-0.070=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.570-1753.568=0.002
σ0.360-0.359=0.001
min1752.999-1753.005=-0.006
max1754.147-1754.150=-0.003
mean1660.450-1654.000=6.450
σ643.360-629.319=14.041
min685.000-621.000=64.000
max2757.000-2710.000=47.000
mean2.835-2.813=0.022
σ0.107-0.168=-0.061
min2.628-2.437=0.191
max3.002-3.072=-0.070

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.017-272.018=-0.001
σ0.004-0.006=-0.003
min272.012-272.008=0.003
max272.021-272.026=-0.005
mean2757.000-2710.000=47.000
σ0.000
min2757.000-2710.000=47.000
max2757.000-2710.000=47.000
mean0.390-0.400=-0.010
σ0.009-0.002=0.008
min0.379-0.398=-0.019
max0.403-0.402=0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.436-1932.433=0.003
σ0.019-0.012=0.006
min1932.412-1932.419=-0.007
max1932.462-1932.447=0.015
mean2757.000-2710.000=47.000
σ0.000
min2757.000-2710.000=47.000
max2757.000-2710.000=47.000
mean2.910-3.024=-0.113
σ0.293-0.080=0.212
min2.392-2.957=-0.565
max3.103-3.163=-0.060
iters=5
new-facts=6402
prior-facts=1
mean4753.027-4753.120=-0.093
σ0.615-0.897=-0.282
min4752.677-4752.389=0.288
max4754.124-4754.684=-0.561
mean2757.000-2710.000=47.000
σ0.000
min2757.000-2710.000=47.000
max2757.000-2710.000=47.000
mean8.752-8.057=0.694
σ0.188-0.379=-0.191
min8.576-7.763=0.813
max9.041-8.547=0.494
iters=5
new-facts=6402
prior-facts=6402
mean4943.634-4943.625=0.009
σ0.019-0.013=0.006
min4943.617-4943.609=0.008
max4943.658-4943.646=0.012
mean2987.000-3012.200=-25.200
σ218.754-349.587=-130.833
min2757.000-2710.000=47.000
max3303.000-3523.000=-220.000
mean8.523-8.548=-0.025
σ0.114-0.257=-0.143
min8.376-8.332=0.044
max8.648-8.953=-0.305

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.074-1.099=-0.025
σ0.225-0.163=0.062
min0.944-0.938=0.006
max1.465-1.273=0.192

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.112-473.108=0.004
σ575.947-575.921=0.026
min185.131-185.138=-0.007
max1337.032-1336.990=0.043
mean88.250
σ8.500
min84.000
max101.000
mean2757.000-2710.000=47.000
σ0.000
min2757.000-2710.000=47.000
max2757.000-2710.000=47.000
mean0.561-0.545=0.017
σ0.542-0.513=0.030
min0.289-0.287=0.002
max1.375-1.314=0.061
policies=20
mean1851.647-1851.677=-0.030
σ0.380-0.375=0.005
min1851.386-1851.416=-0.030
max1852.209-1852.231=-0.023
mean840.000
σ0.000
min840.000
max840.000
mean2757.000-2710.000=47.000
σ0.000
min2757.000-2710.000=47.000
max2757.000-2710.000=47.000
mean2.866-2.864=0.001
σ0.015-0.009=0.006
min2.845-2.856=-0.011
max2.881-2.876=0.006
policies=200
mean18523.510-18523.587=-0.076
σ0.544-0.500=0.044
min18523.122-18523.296=-0.174
max18524.306-18524.335=-0.029
mean8400.000
σ0.000
min8400.000
max8400.000
mean2757.000-2710.000=47.000
σ0.000
min2757.000-2710.000=47.000
max2757.000-2710.000=47.000
mean28.861-28.899=-0.038
σ0.084-0.089=-0.005
min28.764-28.773=-0.009
max28.935-28.975=-0.040