Compare commits

Home / Compare 3c72a6cd .. dbc28bda

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.915=-0.001
σ0.367-0.369=-0.002
min53.779-53.787=-0.008
max54.957-54.964=-0.007
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.139-0.139=-0.000
σ0.004-0.003=0.001
min0.135-0.135=0.001
max0.146-0.144=0.002
cache=y
dps=1
iters=10
policies=100
mean43.141-43.140=0.000
σ0.007-0.005=0.002
min43.131-43.133=-0.003
max43.155-43.149=0.007
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.120-0.119=0.001
σ0.003-0.003=0.000
min0.117-0.115=0.003
max0.126-0.123=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.809-991.808=0.001
σ1.232-1.251=-0.018
min991.232-991.225=0.007
max996.989-997.070=-0.080
mean1069.200-1061.000=8.200
σ312.445-322.608=-10.163
min616.000-565.000=51.000
max1642.000-1637.000=5.000
mean1.514-1.551=-0.038
σ0.087-0.103=-0.016
min1.397-1.447=-0.051
max1.757-1.800=-0.043

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.411-285.409=0.002
σ0.011-0.015=-0.004
min285.395-285.384=0.011
max285.423-285.419=0.004
mean1642.000-1637.000=5.000
σ0.000
min1642.000-1637.000=5.000
max1642.000-1637.000=5.000
mean0.377-0.377=0.001
σ0.007-0.005=0.002
min0.373-0.374=-0.001
max0.389-0.386=0.003
iters=5
new-facts=1
prior-facts=6402
mean1285.371-1285.362=0.010
σ0.126-0.097=0.029
min1285.311-1285.315=-0.004
max1285.596-1285.535=0.062
mean1642.000-1637.000=5.000
σ0.000
min1642.000-1637.000=5.000
max1642.000-1637.000=5.000
mean1.889-1.958=-0.068
σ0.140-0.114=0.026
min1.718-1.800=-0.082
max2.074-2.098=-0.024
iters=5
new-facts=6402
prior-facts=1
mean1807.698-1807.751=-0.054
σ7.039-6.984=0.055
min1804.325-1804.412=-0.087
max1820.277-1820.231=0.046
mean1642.000-1637.000=5.000
σ0.000
min1642.000-1637.000=5.000
max1642.000-1637.000=5.000
mean4.187-4.224=-0.038
σ0.327-0.180=0.147
min3.831-3.982=-0.150
max4.626-4.404=0.222
iters=5
new-facts=6402
prior-facts=6402
mean2070.195-2070.194=0.001
σ0.016-0.004=0.012
min2070.182-2070.190=-0.008
max2070.222-2070.199=0.023
mean1852.400-1840.800=11.600
σ175.256-181.253=-5.997
min1642.000-1637.000=5.000
max2096.000-2076.000=20.000
mean4.481-4.502=-0.022
σ0.127-0.087=0.041
min4.395-4.454=-0.059
max4.701-4.657=0.045

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.087-1.202=-0.115
σ0.219-0.351=-0.133
min0.887-0.907=-0.019
max1.404-1.770=-0.366

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.786-436.789=-0.002
σ572.357-572.364=-0.007
min150.605-150.596=0.008
max1295.322-1295.335=-0.013
mean90.250
σ8.500
min86.000
max103.000
mean1642.000-1637.000=5.000
σ0.000
min1642.000-1637.000=5.000
max1642.000-1637.000=5.000
mean0.514-0.532=-0.018
σ0.526-0.567=-0.041
min0.250-0.247=0.003
max1.303-1.382=-0.079
policies=20
mean1506.274-1506.255=0.019
σ0.232-0.241=-0.009
min1506.123-1506.102=0.021
max1506.620-1506.615=0.005
mean860.000
σ0.000
min860.000
max860.000
mean1642.000-1637.000=5.000
σ0.000
min1642.000-1637.000=5.000
max1642.000-1637.000=5.000
mean2.516-2.518=-0.002
σ0.011-0.017=-0.006
min2.508-2.497=0.011
max2.532-2.538=-0.006
policies=200
mean15070.319-15070.386=-0.068
σ0.095-0.124=-0.030
min15070.244-15070.224=0.019
max15070.449-15070.518=-0.069
mean8600.000
σ0.000
min8600.000
max8600.000
mean1642.000-1637.000=5.000
σ0.000
min1642.000-1637.000=5.000
max1642.000-1637.000=5.000
mean25.556-25.483=0.073
σ0.146-0.138=0.008
min25.428-25.287=0.141
max25.757-25.611=0.147