Compare commits

Home / Compare 3d3db82d .. ad8ccaaf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.647-53.647=-0.001
σ0.366-0.366=0.001
min53.514-53.512=0.002
max54.689-54.688=0.001
mean416.100-415.000=1.100
σ0.316-0.000=0.316
min416.000-415.000=1.000
max417.000-415.000=2.000
mean0.139-0.139=0.000
σ0.004-0.004=0.000
min0.135-0.134=0.001
max0.145-0.145=0.000
cache=y
dps=1
iters=10
policies=100
mean42.946-42.941=0.005
σ0.014-0.007=0.007
min42.929-42.929=0.001
max42.981-42.953=0.028
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.121-0.121=-0.000
σ0.004-0.004=-0.000
min0.118-0.117=0.001
max0.127-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.800-991.803=-0.003
σ1.261-1.259=0.002
min991.235-991.220=0.015
max997.108-997.101=0.007
mean1065.700-1063.750=1.950
σ321.080-322.097=-1.017
min570.000-569.000=1.000
max1639.000
mean1.528-1.541=-0.013
σ0.092-0.092=-0.000
min1.419-1.461=-0.042
max1.760-1.733=0.027

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.391-285.393=-0.002
σ0.013-0.007=0.006
min285.373-285.382=-0.009
max285.405-285.399=0.006
mean1639.000
σ0.000
min1639.000
max1639.000
mean0.388-0.381=0.007
σ0.008-0.008=0.000
min0.378-0.374=0.003
max0.400-0.393=0.007
iters=5
new-facts=1
prior-facts=6402
mean1285.352-1285.355=-0.002
σ0.133-0.132=0.001
min1285.288-1285.291=-0.003
max1285.590-1285.590=-0.000
mean1639.000
σ0.000
min1639.000
max1639.000
mean1.878-1.981=-0.102
σ0.052-0.131=-0.079
min1.842-1.832=0.010
max1.969-2.140=-0.171
iters=5
new-facts=6402
prior-facts=1
mean1807.689-1807.723=-0.034
σ7.034-6.995=0.039
min1804.349-1804.340=0.008
max1820.257-1820.218=0.039
mean1639.000
σ0.000
min1639.000
max1639.000
mean4.163-4.287=-0.124
σ0.242-0.263=-0.021
min3.966-4.024=-0.058
max4.555-4.684=-0.129
iters=5
new-facts=6402
prior-facts=6402
mean2070.177-2070.180=-0.003
σ0.006-0.009=-0.003
min2070.171-2070.167=0.004
max2070.186-2070.192=-0.006
mean1833.600-1833.000=0.600
σ169.338-193.826=-24.488
min1639.000
max2069.000-2080.000=-11.000
mean4.501-4.449=0.052
σ0.064-0.055=0.010
min4.426-4.367=0.059
max4.601-4.505=0.096

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.103-1.095=0.008
σ0.236-0.197=0.040
min0.902-0.910=-0.008
max1.463-1.362=0.101

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.780-436.783=-0.003
σ572.351-572.354=-0.003
min150.595-150.596=-0.000
max1295.306-1295.314=-0.007
mean90.250
σ8.500
min86.000
max103.000
mean1639.000
σ0.000
min1639.000
max1639.000
mean0.528-0.535=-0.007
σ0.558-0.574=-0.016
min0.246-0.246=-0.000
max1.365-1.396=-0.031
policies=20
mean1506.182-1506.185=-0.003
σ0.223-0.224=-0.001
min1506.042-1506.042=-0.001
max1506.516-1506.520=-0.004
mean860.000
σ0.000
min860.000
max860.000
mean1639.000
σ0.000
min1639.000
max1639.000
mean2.512-2.510=0.002
σ0.028-0.015=0.013
min2.489-2.496=-0.007
max2.547-2.523=0.024
policies=200
mean15069.549-15069.434=0.114
σ0.038-0.110=-0.072
min15069.513-15069.316=0.196
max15069.602-15069.581=0.021
mean8600.000
σ0.000
min8600.000
max8600.000
mean1639.000
σ0.000
min1639.000
max1639.000
mean25.361-25.450=-0.089
σ0.123-0.091=0.032
min25.221-25.368=-0.148
max25.499-25.552=-0.053