Compare commits

Home / Compare 7cdf749f .. 055ee45f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.648-53.646=0.002
σ0.367-0.365=0.002
min53.508-53.509=-0.001
max54.691-54.683=0.008
mean417.100-417.300=-0.200
σ0.316-0.483=-0.167
min417.000
max418.000
mean0.138-0.134=0.003
σ0.005-0.004=0.001
min0.131-0.129=0.002
max0.144-0.141=0.004
cache=y
dps=1
iters=10
policies=100
mean42.943-42.941=0.002
σ0.006-0.007=-0.000
min42.935-42.930=0.005
max42.951-42.951=0.000
mean418.000
σ0.000
min418.000
max418.000
mean0.119-0.121=-0.002
σ0.005-0.004=0.000
min0.113-0.114=-0.001
max0.126-0.128=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.805-991.800=0.005
σ1.241-1.250=-0.009
min991.225-991.224=0.001
max997.022-997.059=-0.037
mean1072.200-1062.700=9.500
σ316.027-325.861=-9.834
min619.000-608.000=11.000
max1632.000-1639.000=-7.000
mean1.507-1.538=-0.031
σ0.073-0.102=-0.029
min1.380-1.386=-0.006
max1.650-1.747=-0.097

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.389-285.391=-0.001
σ0.012-0.012=0.000
min285.370-285.371=-0.001
max285.399-285.401=-0.002
mean1632.000-1639.000=-7.000
σ0.000
min1632.000-1639.000=-7.000
max1632.000-1639.000=-7.000
mean0.377-0.377=-0.000
σ0.009-0.006=0.003
min0.370-0.373=-0.003
max0.387-0.387=0.000
iters=5
new-facts=1
prior-facts=6402
mean1285.353-1285.358=-0.005
σ0.136-0.137=-0.000
min1285.288-1285.288=-0.000
max1285.597-1285.602=-0.006
mean1632.000-1639.000=-7.000
σ0.000
min1632.000-1639.000=-7.000
max1632.000-1639.000=-7.000
mean1.942-1.925=0.018
σ0.152-0.124=0.029
min1.823-1.807=0.017
max2.170-2.129=0.041
iters=5
new-facts=6402
prior-facts=1
mean1807.707-1807.698=0.009
σ7.037-7.001=0.036
min1804.329-1804.330=-0.000
max1820.280-1820.205=0.075
mean1632.000-1639.000=-7.000
σ0.000
min1632.000-1639.000=-7.000
max1632.000-1639.000=-7.000
mean4.288-4.195=0.092
σ0.275-0.172=0.103
min4.047-4.011=0.037
max4.719-4.388=0.331
iters=5
new-facts=6402
prior-facts=6402
mean2070.181-2070.178=0.004
σ0.009-0.013=-0.004
min2070.173-2070.167=0.006
max2070.196-2070.200=-0.004
mean1834.600-1841.000=-6.400
σ174.630-179.492=-4.862
min1632.000-1639.000=-7.000
max2069.000-2077.000=-8.000
mean4.573-4.587=-0.014
σ0.075-0.207=-0.132
min4.494-4.413=0.081
max4.697-4.942=-0.246

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.218-1.279=-0.061
σ0.336-0.322=0.014
min0.920-0.914=0.006
max1.784-1.654=0.130

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.781-436.776=0.005
σ572.363-572.362=0.001
min150.590-150.586=0.005
max1295.326-1295.319=0.007
mean90.250
σ8.500
min86.000
max103.000
mean1632.000-1639.000=-7.000
σ0.000
min1632.000-1639.000=-7.000
max1632.000-1639.000=-7.000
mean0.527-0.503=0.024
σ0.556-0.507=0.050
min0.247-0.248=-0.001
max1.361-1.262=0.099
policies=20
mean1506.180-1506.175=0.005
σ0.228-0.235=-0.007
min1506.035-1506.014=0.021
max1506.520-1506.523=-0.003
mean860.000
σ0.000
min860.000
max860.000
mean1632.000-1639.000=-7.000
σ0.000
min1632.000-1639.000=-7.000
max1632.000-1639.000=-7.000
mean2.510-2.504=0.006
σ0.020-0.007=0.013
min2.483-2.494=-0.011
max2.527-2.511=0.016
policies=200
mean15069.507-15069.460=0.048
σ0.056-0.083=-0.027
min15069.440-15069.398=0.042
max15069.575-15069.580=-0.005
mean8600.000
σ0.000
min8600.000
max8600.000
mean1632.000-1639.000=-7.000
σ0.000
min1632.000-1639.000=-7.000
max1632.000-1639.000=-7.000
mean25.530-25.503=0.028
σ0.165-0.086=0.079
min25.371-25.397=-0.026
max25.747-25.573=0.174