Compare commits

Home / Compare b7471a1d .. 0051fbe3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.798=0.000
σ0.107-0.108=-0.001
min35.748-35.751=-0.003
max36.102-36.104=-0.002
mean412.000
σ0.000
min412.000
max412.000
mean0.073-0.077=-0.005
σ0.004-0.003=0.001
min0.068-0.075=-0.008
max0.081-0.084=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.064-26.065=-0.001
σ0.003-0.004=-0.000
min26.058-26.058=-0.000
max26.070-26.069=0.000
mean412.000
σ0.000
min412.000
max412.000
mean0.061-0.062=-0.002
σ0.001-0.002=-0.001
min0.059-0.060=-0.001
max0.063-0.069=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.922-1755.923=-0.001
σ0.364-0.366=-0.002
min1755.350-1755.345=0.005
max1756.508-1756.513=-0.004
mean1666.400-1661.650=4.750
σ635.575-628.595=6.980
min666.000-669.000=-3.000
max2630.000-2661.000=-31.000
mean2.818-2.815=0.002
σ0.151-0.157=-0.006
min2.396-2.309=0.087
max3.036-3.011=0.025

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.195-277.196=-0.001
σ0.006-0.006=0.001
min277.187-277.187=-0.000
max277.203-277.203=0.000
mean2630.000-2661.000=-31.000
σ0.000
min2630.000-2661.000=-31.000
max2630.000-2661.000=-31.000
mean0.397-0.397=-0.000
σ0.007-0.009=-0.002
min0.391-0.389=0.002
max0.409-0.410=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2174.418-2174.402=0.016
σ0.038-0.068=-0.030
min2174.353-2174.282=0.071
max2174.452-2174.446=0.005
mean2630.000-2661.000=-31.000
σ0.000
min2630.000-2661.000=-31.000
max2630.000-2661.000=-31.000
mean3.095-3.072=0.023
σ0.313-0.258=0.055
min2.776-2.779=-0.003
max3.585-3.483=0.102
iters=5
new-facts=6402
prior-facts=1
mean5052.635-5052.379=0.256
σ0.988-0.798=0.190
min5052.041-5051.582=0.458
max5054.390-5053.709=0.681
mean2630.000-2661.000=-31.000
σ0.000
min2630.000-2661.000=-31.000
max2630.000-2661.000=-31.000
mean8.708-8.582=0.127
σ0.590-0.459=0.130
min8.260-8.146=0.114
max9.660-9.298=0.362
iters=5
new-facts=6402
prior-facts=6402
mean5188.358-5188.426=-0.068
σ0.121-0.090=0.031
min5188.174-5188.359=-0.185
max5188.515-5188.526=-0.012
mean3288.600-3221.400=67.200
σ417.183-356.709=60.474
min2706.000-2719.000=-13.000
max3675.000-3660.000=15.000
mean9.040-8.839=0.201
σ0.503-0.150=0.353
min8.711-8.658=0.053
max9.933-8.954=0.979

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.315-1.188=0.127
σ0.340-0.317=0.022
min0.944-0.948=-0.004
max1.816-1.709=0.107

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.852-464.856=-0.004
σ572.660-572.659=0.002
min178.515-178.523=-0.008
max1323.842-1323.844=-0.002
mean79.500
σ7.000
min76.000
max90.000
mean2630.000-2661.000=-31.000
σ0.000
min2630.000-2661.000=-31.000
max2630.000-2661.000=-31.000
mean0.568-0.558=0.011
σ0.570-0.535=0.035
min0.274-0.279=-0.005
max1.423-1.360=0.063
policies=20
mean1785.464-1785.481=-0.016
σ0.353-0.343=0.009
min1785.237-1785.258=-0.022
max1785.989-1785.990=-0.001
mean760.000
σ0.000
min760.000
max760.000
mean2630.000-2661.000=-31.000
σ0.000
min2630.000-2661.000=-31.000
max2630.000-2661.000=-31.000
mean2.785-2.770=0.014
σ0.025-0.019=0.006
min2.758-2.743=0.015
max2.816-2.785=0.031
policies=200
mean17861.568-17861.531=0.037
σ0.529-0.459=0.071
min17861.299-17861.283=0.016
max17862.362-17862.219=0.143
mean7600.000
σ0.000
min7600.000
max7600.000
mean2630.000-2661.000=-31.000
σ0.000
min2630.000-2661.000=-31.000
max2630.000-2661.000=-31.000
mean28.246-28.186=0.059
σ0.145-0.170=-0.026
min28.107-28.010=0.097
max28.418-28.391=0.027