Compare commits

Home / Compare 32a16447 .. e4b7c9c8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.780=0.002
σ0.047-0.044=0.003
min70.748-70.750=-0.002
max70.911-70.902=0.009
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.160-0.157=0.004
σ0.004-0.005=-0.001
min0.157-0.149=0.008
max0.168-0.166=0.002
cache=y
dps=1
iters=10
policies=100
mean21.492-21.493=-0.001
σ0.002-0.003=-0.001
min21.489-21.488=0.002
max21.495-21.497=-0.002
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.063-0.065=-0.002
σ0.003-0.002=0.001
min0.060-0.062=-0.002
max0.069-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.095-1754.093=0.001
σ0.360-0.363=-0.003
min1753.528-1753.528=0.000
max1754.679-1754.676=0.003
mean1647.150-1670.250=-23.100
σ610.366-638.892=-28.527
min640.000-672.000=-32.000
max2467.000-2734.000=-267.000
mean2.834-2.822=0.012
σ0.120-0.177=-0.057
min2.472-2.264=0.208
max3.083-3.032=0.051

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.954-271.956=-0.003
σ0.006-0.007=-0.001
min271.947-271.947=-0.000
max271.960-271.966=-0.006
mean2467.000-2734.000=-267.000
σ0.000
min2467.000-2734.000=-267.000
max2467.000-2734.000=-267.000
mean0.379-0.385=-0.006
σ0.002-0.007=-0.005
min0.378-0.381=-0.003
max0.384-0.398=-0.015
iters=5
new-facts=1
prior-facts=6402
mean1932.329-1932.331=-0.001
σ0.011-0.013=-0.002
min1932.315-1932.313=0.002
max1932.341-1932.347=-0.006
mean2467.000-2734.000=-267.000
σ0.000
min2467.000-2734.000=-267.000
max2467.000-2734.000=-267.000
mean3.049-2.946=0.103
σ0.091-0.286=-0.195
min2.929-2.449=0.481
max3.143-3.173=-0.030
iters=5
new-facts=6402
prior-facts=1
mean4752.978-4752.979=-0.000
σ1.008-1.009=-0.001
min4752.056-4752.048=0.008
max4754.699-4754.701=-0.003
mean2467.000-2734.000=-267.000
σ0.000
min2467.000-2734.000=-267.000
max2467.000-2734.000=-267.000
mean8.639-8.621=0.018
σ0.382-0.369=0.013
min8.019-8.013=0.006
max8.976-8.926=0.050
iters=5
new-facts=6402
prior-facts=6402
mean4943.416-4943.556=-0.140
σ0.311-0.014=0.298
min4942.859-4943.537=-0.678
max4943.568-4943.570=-0.002
mean3000.000-3041.200=-41.200
σ278.951-224.355=54.596
min2606.000-2734.000=-128.000
max3345.000-3328.000=17.000
mean8.554-8.486=0.068
σ0.192-0.126=0.066
min8.330-8.338=-0.008
max8.857-8.631=0.226

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.823-1.056=0.768
σ0.121-0.132=-0.011
min1.627-0.938=0.688
max1.929-1.262=0.667

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.655-468.666=-0.011
σ574.927-574.934=-0.007
min181.190-181.190=-0.001
max1331.046-1331.067=-0.022
mean88.250
σ8.500
min84.000
max101.000
mean2467.000-2734.000=-267.000
σ0.000
min2467.000-2734.000=-267.000
max2467.000-2734.000=-267.000
mean0.557-0.585=-0.028
σ0.530-0.588=-0.057
min0.285-0.287=-0.002
max1.352-1.466=-0.114
policies=20
mean1812.166-1812.213=-0.047
σ0.362-0.388=-0.026
min1811.940-1811.945=-0.005
max1812.705-1812.785=-0.080
mean840.000
σ0.000
min840.000
max840.000
mean2467.000-2734.000=-267.000
σ0.000
min2467.000-2734.000=-267.000
max2467.000-2734.000=-267.000
mean2.839-2.843=-0.004
σ0.016-0.021=-0.005
min2.819-2.817=0.002
max2.857-2.863=-0.006
policies=200
mean18129.090-18129.228=-0.138
σ0.617-0.437=0.180
min18128.653-18128.941=-0.288
max18129.986-18129.880=0.106
mean8400.000
σ0.000
min8400.000
max8400.000
mean2467.000-2734.000=-267.000
σ0.000
min2467.000-2734.000=-267.000
max2467.000-2734.000=-267.000
mean28.531-28.664=-0.132
σ0.039-0.042=-0.003
min28.498-28.618=-0.121
max28.575-28.718=-0.143