Compare commits

Home / Compare 6204d40e .. 3c879145

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.918-53.916=0.002
σ0.368-0.369=-0.000
min53.788-53.788=-0.000
max54.965-54.964=0.001
mean415.800-415.000=0.800
σ0.422-0.000=0.422
min415.000
max416.000-415.000=1.000
mean0.147-0.140=0.007
σ0.008-0.004=0.005
min0.138-0.136=0.001
max0.158-0.146=0.012
cache=y
dps=1
iters=10
policies=100
mean43.140-43.143=-0.003
σ0.004-0.010=-0.006
min43.134-43.135=-0.001
max43.149-43.169=-0.020
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.121-0.121=-0.000
σ0.004-0.003=0.000
min0.115-0.118=-0.003
max0.127-0.126=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.814-991.808=0.006
σ1.247-1.264=-0.017
min991.231-991.250=-0.019
max997.057-997.132=-0.076
mean1069.650-1067.450=2.200
σ313.529-322.579=-9.050
min616.000-569.000=47.000
max1651.000-1642.000=9.000
mean1.531-1.549=-0.018
σ0.077-0.094=-0.017
min1.417-1.461=-0.044
max1.738-1.761=-0.023

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.413-285.411=0.002
σ0.015-0.010=0.004
min285.387-285.395=-0.008
max285.423-285.422=0.000
mean1651.000-1642.000=9.000
σ0.000
min1651.000-1642.000=9.000
max1651.000-1642.000=9.000
mean0.384-0.382=0.002
σ0.016-0.007=0.008
min0.374-0.375=-0.001
max0.412-0.392=0.019
iters=5
new-facts=1
prior-facts=6402
mean1285.374-1285.370=0.004
σ0.139-0.132=0.008
min1285.307-1285.308=-0.001
max1285.623-1285.605=0.017
mean1651.000-1642.000=9.000
σ0.000
min1651.000-1642.000=9.000
max1651.000-1642.000=9.000
mean1.927-1.890=0.037
σ0.141-0.077=0.064
min1.807-1.812=-0.005
max2.115-1.983=0.132
iters=5
new-facts=6402
prior-facts=1
mean1807.800-1807.700=0.099
σ6.976-7.021=-0.045
min1804.463-1804.337=0.126
max1820.266-1820.244=0.022
mean1651.000-1642.000=9.000
σ0.000
min1651.000-1642.000=9.000
max1651.000-1642.000=9.000
mean4.383-4.168=0.215
σ0.301-0.209=0.092
min4.081-3.834=0.247
max4.802-4.412=0.391
iters=5
new-facts=6402
prior-facts=6402
mean2070.196-2070.192=0.003
σ0.006-0.009=-0.003
min2070.187-2070.182=0.005
max2070.202-2070.205=-0.003
mean1865.800-1849.600=16.200
σ191.127-174.094=17.033
min1651.000-1642.000=9.000
max2081.000-2093.000=-12.000
mean4.513-4.460=0.053
σ0.040-0.029=0.011
min4.475-4.414=0.060
max4.573-4.489=0.084

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.193-1.182=0.011
σ0.377-0.237=0.140
min0.921-0.912=0.009
max1.830-1.536=0.294

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.785-436.783=0.002
σ572.361-572.364=-0.003
min150.596-150.597=-0.000
max1295.327-1295.329=-0.002
mean90.250
σ8.500
min86.000
max103.000
mean1651.000-1642.000=9.000
σ0.000
min1651.000-1642.000=9.000
max1651.000-1642.000=9.000
mean0.517-0.534=-0.017
σ0.531-0.563=-0.032
min0.250-0.251=-0.001
max1.313-1.379=-0.066
policies=20
mean1506.254-1506.259=-0.004
σ0.237-0.243=-0.007
min1506.102-1506.095=0.007
max1506.608-1506.621=-0.013
mean860.000
σ0.000
min860.000
max860.000
mean1651.000-1642.000=9.000
σ0.000
min1651.000-1642.000=9.000
max1651.000-1642.000=9.000
mean2.521-2.521=-0.000
σ0.025-0.020=0.005
min2.488-2.495=-0.007
max2.545-2.542=0.003
policies=200
mean15070.313-15070.394=-0.081
σ0.045-0.061=-0.017
min15070.252-15070.329=-0.078
max15070.355-15070.476=-0.121
mean8600.000
σ0.000
min8600.000
max8600.000
mean1651.000-1642.000=9.000
σ0.000
min1651.000-1642.000=9.000
max1651.000-1642.000=9.000
mean25.551-25.477=0.074
σ0.103-0.161=-0.058
min25.403-25.235=0.168
max25.643-25.575=0.068