Compare commits

Home / Compare 0cc769da .. 7494df9b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.696-70.697=-0.001
σ0.044-0.047=-0.003
min70.668-70.671=-0.003
max70.820-70.830=-0.010
mean414.000-413.200=0.800
σ0.000-0.422=-0.422
min414.000-413.000=1.000
max414.000
mean0.160-0.160=0.000
σ0.003-0.003=0.000
min0.157-0.155=0.001
max0.167-0.166=0.001
cache=y
dps=1
iters=10
policies=100
mean21.421-21.424=-0.003
σ0.003-0.011=-0.008
min21.415-21.416=-0.000
max21.424-21.455=-0.031
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.065=0.000
σ0.002-0.002=-0.000
min0.063-0.063=0.000
max0.070-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.371-1754.372=-0.001
σ0.361-0.361=-0.001
min1753.804-1753.802=0.002
max1754.954-1754.972=-0.018
mean1643.350-1633.300=10.050
σ617.124-588.313=28.811
min690.000-624.000=66.000
max2773.000-2416.000=357.000
mean2.841-2.759=0.083
σ0.167-0.172=-0.004
min2.263-2.259=0.004
max3.105-2.936=0.169

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.405-273.422=-0.018
σ0.010-0.003=0.008
min273.395-273.420=-0.025
max273.421-273.426=-0.005
mean2773.000-2416.000=357.000
σ0.000
min2773.000-2416.000=357.000
max2773.000-2416.000=357.000
mean0.388-0.386=0.001
σ0.008-0.009=-0.001
min0.382-0.380=0.001
max0.403-0.403=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1933.809-1933.810=-0.001
σ0.012-0.011=0.000
min1933.794-1933.793=0.002
max1933.822-1933.823=-0.001
mean2773.000-2416.000=357.000
σ0.000
min2773.000-2416.000=357.000
max2773.000-2416.000=357.000
mean2.898-2.864=0.034
σ0.128-0.189=-0.062
min2.714-2.534=0.180
max3.074-2.984=0.090
iters=5
new-facts=6402
prior-facts=1
mean4754.256-4754.547=-0.290
σ0.814-0.912=-0.098
min4753.173-4754.107=-0.934
max4755.469-4756.176=-0.707
mean2773.000-2416.000=357.000
σ0.000
min2773.000-2416.000=357.000
max2773.000-2416.000=357.000
mean8.382-8.805=-0.423
σ0.350-0.188=0.163
min7.761-8.575=-0.815
max8.583-9.014=-0.431
iters=5
new-facts=6402
prior-facts=6402
mean4945.036-4944.970=0.067
σ0.019-0.167=-0.148
min4945.014-4944.672=0.341
max4945.056-4945.063=-0.007
mean2988.800-2978.000=10.800
σ210.462-285.703=-75.241
min2773.000-2596.000=177.000
max3296.000-3321.000=-25.000
mean8.545-8.659=-0.113
σ0.116-0.248=-0.132
min8.442-8.426=0.016
max8.730-9.027=-0.296

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.056-1.818=-0.762
σ0.127-0.064=0.063
min0.930-1.764=-0.834
max1.234-1.902=-0.667

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.869-473.844=0.025
σ575.952-575.912=0.040
min185.884-185.884=0.000
max1337.797-1337.712=0.085
mean88.250
σ8.500
min84.000
max101.000
mean2773.000-2416.000=357.000
σ0.000
min2773.000-2416.000=357.000
max2773.000-2416.000=357.000
mean0.494-0.564=-0.070
σ0.407-0.543=-0.137
min0.290-0.288=0.002
max1.104-1.379=-0.275
policies=20
mean1859.134-1859.147=-0.014
σ0.369-0.363=0.006
min1858.882-1858.898=-0.016
max1859.681-1859.681=-0.001
mean840.000
σ0.000
min840.000
max840.000
mean2773.000-2416.000=357.000
σ0.000
min2773.000-2416.000=357.000
max2773.000-2416.000=357.000
mean2.873-2.877=-0.004
σ0.013-0.038=-0.025
min2.859-2.848=0.011
max2.890-2.928=-0.038
policies=200
mean18598.326-18598.316=0.010
σ0.585-0.577=0.007
min18597.936-18597.930=0.006
max18599.184-18599.166=0.019
mean8400.000
σ0.000
min8400.000
max8400.000
mean2773.000-2416.000=357.000
σ0.000
min2773.000-2416.000=357.000
max2773.000-2416.000=357.000
mean28.990-28.893=0.097
σ0.086-0.055=0.031
min28.890-28.845=0.045
max29.099-28.942=0.157