Compare commits

Home / Compare 8ddb970a .. e197706b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.917=-0.003
σ0.368-0.367=0.001
min53.783-53.788=-0.005
max54.961-54.962=-0.001
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.140-0.140=-0.000
σ0.004-0.005=-0.002
min0.136-0.134=0.002
max0.146-0.149=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.142-43.141=0.002
σ0.005-0.005=-0.000
min43.134-43.135=-0.002
max43.149-43.152=-0.003
mean412.000-413.800=-1.800
σ0.000-0.422=-0.422
min412.000-413.000=-1.000
max412.000-414.000=-2.000
mean0.120-0.122=-0.001
σ0.004-0.003=0.001
min0.116-0.119=-0.003
max0.127-0.127=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.804-991.805=-0.001
σ1.264-1.246=0.018
min991.248-991.238=0.009
max997.129-997.052=0.077
mean1062.450-1064.350=-1.900
σ320.937-321.939=-1.002
min570.000-568.000=2.000
max1639.000-1636.000=3.000
mean1.530-1.528=0.002
σ0.088-0.079=0.009
min1.393-1.411=-0.018
max1.759-1.726=0.033

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.407-285.414=-0.008
σ0.012-0.008=0.005
min285.385-285.402=-0.018
max285.414-285.423=-0.009
mean1639.000-1636.000=3.000
σ0.000
min1639.000-1636.000=3.000
max1639.000-1636.000=3.000
mean0.372-0.386=-0.014
σ0.006-0.012=-0.006
min0.368-0.372=-0.004
max0.382-0.400=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1285.366-1285.378=-0.012
σ0.109-0.137=-0.029
min1285.310-1285.307=0.003
max1285.560-1285.623=-0.063
mean1639.000-1636.000=3.000
σ0.000
min1639.000-1636.000=3.000
max1639.000-1636.000=3.000
mean2.072-1.979=0.094
σ0.218-0.135=0.083
min1.831-1.827=0.003
max2.425-2.155=0.270
iters=5
new-facts=6402
prior-facts=1
mean1807.719-1807.701=0.017
σ6.980-7.028=-0.048
min1804.316-1804.338=-0.021
max1820.188-1820.260=-0.072
mean1639.000-1636.000=3.000
σ0.000
min1639.000-1636.000=3.000
max1639.000-1636.000=3.000
mean4.234-4.155=0.079
σ0.278-0.234=0.044
min3.812-3.851=-0.038
max4.504-4.502=0.002
iters=5
new-facts=6402
prior-facts=6402
mean2070.200-2070.201=-0.001
σ0.022-0.014=0.008
min2070.176-2070.186=-0.010
max2070.226-2070.224=0.002
mean1836.400-1840.800=-4.400
σ185.396-180.501=4.895
min1639.000-1636.000=3.000
max2093.000-2078.000=15.000
mean4.648-4.506=0.143
σ0.349-0.030=0.319
min4.329-4.462=-0.133
max5.067-4.535=0.532

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.207-1.181=0.026
σ0.295-0.279=0.016
min0.900-0.921=-0.020
max1.504-1.587=-0.084

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.782-436.785=-0.003
σ572.362-572.364=-0.003
min150.596-150.598=-0.002
max1295.324-1295.332=-0.007
mean90.250
σ8.500
min86.000
max103.000
mean1639.000-1636.000=3.000
σ0.000
min1639.000-1636.000=3.000
max1639.000-1636.000=3.000
mean0.522-0.532=-0.010
σ0.546-0.551=-0.006
min0.247-0.250=-0.004
max1.340-1.359=-0.019
policies=20
mean1506.251-1506.277=-0.026
σ0.238-0.247=-0.009
min1506.087-1506.120=-0.033
max1506.604-1506.645=-0.041
mean860.000
σ0.000
min860.000
max860.000
mean1639.000-1636.000=3.000
σ0.000
min1639.000-1636.000=3.000
max1639.000-1636.000=3.000
mean2.514-2.530=-0.016
σ0.018-0.014=0.004
min2.488-2.515=-0.027
max2.531-2.545=-0.014
policies=200
mean15070.385-15070.282=0.104
σ0.064-0.137=-0.073
min15070.315-15070.174=0.141
max15070.465-15070.468=-0.003
mean8600.000
σ0.000
min8600.000
max8600.000
mean1639.000-1636.000=3.000
σ0.000
min1639.000-1636.000=3.000
max1639.000-1636.000=3.000
mean25.512-25.541=-0.028
σ0.097-0.093=0.004
min25.416-25.408=0.008
max25.613-25.614=-0.001