Compare commits

Home / Compare da65969b .. a890b024

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-53.914=0.001
σ0.367-0.367=-0.000
min53.787-53.786=0.002
max54.960-54.959=0.001
mean416.800-417.000=-0.200
σ0.422-0.000=0.422
min416.000-417.000=-1.000
max417.000
mean0.139-0.140=-0.001
σ0.003-0.003=-0.000
min0.136-0.137=-0.001
max0.144-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.141-43.141=-0.001
σ0.004-0.006=-0.002
min43.135-43.132=0.003
max43.148-43.150=-0.002
mean417.000-417.400=-0.400
σ0.000-0.516=-0.516
min417.000
max417.000-418.000=-1.000
mean0.121-0.124=-0.003
σ0.004-0.008=-0.005
min0.115-0.114=0.001
max0.126-0.144=-0.017

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.806-991.799=0.007
σ1.248-1.254=-0.006
min991.252-991.254=-0.002
max997.059-997.080=-0.021
mean1068.400-1067.050=1.350
σ319.723-321.830=-2.107
min590.000-571.000=19.000
max1633.000-1642.000=-9.000
mean1.554-1.544=0.010
σ0.148-0.093=0.055
min1.404-1.446=-0.042
max1.997-1.762=0.235

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.410-285.412=-0.001
σ0.013-0.011=0.003
min285.392-285.396=-0.004
max285.429-285.421=0.008
mean1633.000-1642.000=-9.000
σ0.000
min1633.000-1642.000=-9.000
max1633.000-1642.000=-9.000
mean0.372-0.386=-0.014
σ0.005-0.009=-0.004
min0.369-0.374=-0.005
max0.381-0.396=-0.015
iters=5
new-facts=1
prior-facts=6402
mean1285.377-1285.370=0.008
σ0.137-0.120=0.016
min1285.308-1285.310=-0.002
max1285.622-1285.585=0.037
mean1633.000-1642.000=-9.000
σ0.000
min1633.000-1642.000=-9.000
max1633.000-1642.000=-9.000
mean1.921-1.995=-0.074
σ0.066-0.222=-0.156
min1.808-1.797=0.011
max1.981-2.346=-0.365
iters=5
new-facts=6402
prior-facts=1
mean1807.711-1807.735=-0.024
σ7.010-7.009=0.001
min1804.344-1804.337=0.007
max1820.235-1820.257=-0.023
mean1633.000-1642.000=-9.000
σ0.000
min1633.000-1642.000=-9.000
max1633.000-1642.000=-9.000
mean4.184-4.254=-0.070
σ0.295-0.264=0.031
min3.854-3.833=0.021
max4.568-4.478=0.090
iters=5
new-facts=6402
prior-facts=6402
mean2070.193-2070.196=-0.003
σ0.010-0.011=-0.001
min2070.179-2070.181=-0.002
max2070.207-2070.211=-0.004
mean1794.600-1839.800=-45.200
σ176.554-170.209=6.345
min1633.000-1642.000=-9.000
max2044.000-2077.000=-33.000
mean4.465-4.498=-0.033
σ0.195-0.049=0.146
min4.336-4.440=-0.105
max4.809-4.551=0.258

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.231-1.292=-0.061
σ0.359-0.347=0.012
min0.920-0.927=-0.008
max1.839-1.771=0.067

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.786-436.786=0.001
σ572.358-572.363=-0.005
min150.597-150.599=-0.002
max1295.324-1295.330=-0.006
mean90.250
σ8.500
min86.000
max103.000
mean1633.000-1642.000=-9.000
σ0.000
min1633.000-1642.000=-9.000
max1633.000-1642.000=-9.000
mean0.522-0.529=-0.007
σ0.547-0.551=-0.004
min0.248-0.249=-0.001
max1.342-1.355=-0.013
policies=20
mean1506.243-1506.263=-0.020
σ0.238-0.239=-0.001
min1506.091-1506.111=-0.020
max1506.598-1506.619=-0.021
mean860.000
σ0.000
min860.000
max860.000
mean1633.000-1642.000=-9.000
σ0.000
min1633.000-1642.000=-9.000
max1633.000-1642.000=-9.000
mean2.509-2.523=-0.014
σ0.014-0.006=0.008
min2.492-2.516=-0.025
max2.526-2.532=-0.005
policies=200
mean15070.311-15070.277=0.035
σ0.120-0.049=0.071
min15070.198-15070.205=-0.007
max15070.450-15070.318=0.132
mean8600.000
σ0.000
min8600.000
max8600.000
mean1633.000-1642.000=-9.000
σ0.000
min1633.000-1642.000=-9.000
max1633.000-1642.000=-9.000
mean25.526-25.521=0.005
σ0.091-0.217=-0.126
min25.415-25.290=0.125
max25.612-25.786=-0.174