Compare commits

Home / Compare eac7f8db .. 2d0690a8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.913=0.001
σ0.367-0.366=0.001
min53.785-53.785=-0.000
max54.958-54.955=0.003
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.139-0.138=0.001
σ0.004-0.004=-0.000
min0.135-0.131=0.004
max0.147-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean43.141-43.140=0.001
σ0.006-0.007=-0.001
min43.127-43.128=-0.001
max43.150-43.154=-0.004
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.121-0.119=0.001
σ0.003-0.004=-0.000
min0.117-0.114=0.004
max0.126-0.125=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.079-992.082=-0.003
σ1.270-1.233=0.037
min991.503-991.495=0.008
max997.425-997.260=0.165
mean1066.200-1069.800=-3.600
σ315.010-319.208=-4.198
min575.000-602.000=-27.000
max1632.000-1646.000=-14.000
mean1.537-1.526=0.012
σ0.082-0.079=0.003
min1.456-1.429=0.027
max1.762-1.775=-0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.676-285.656=0.020
σ0.012-0.015=-0.004
min285.655-285.639=0.016
max285.684-285.680=0.004
mean1632.000-1646.000=-14.000
σ0.000
min1632.000-1646.000=-14.000
max1632.000-1646.000=-14.000
mean0.373-0.379=-0.007
σ0.006-0.005=0.002
min0.361-0.376=-0.014
max0.376-0.388=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1285.622-1285.636=-0.014
σ0.093-0.119=-0.026
min1285.573-1285.576=-0.003
max1285.788-1285.849=-0.061
mean1632.000-1646.000=-14.000
σ0.000
min1632.000-1646.000=-14.000
max1632.000-1646.000=-14.000
mean1.905-1.868=0.037
σ0.125-0.106=0.018
min1.768-1.720=0.048
max2.100-2.003=0.097
iters=5
new-facts=6402
prior-facts=1
mean1807.990-1807.983=0.007
σ7.021-6.992=0.029
min1804.585-1804.634=-0.049
max1820.533-1820.477=0.056
mean1632.000-1646.000=-14.000
σ0.000
min1632.000-1646.000=-14.000
max1632.000-1646.000=-14.000
mean4.253-4.271=-0.017
σ0.266-0.185=0.081
min3.896-4.008=-0.112
max4.581-4.428=0.153
iters=5
new-facts=6402
prior-facts=6402
mean2070.461-2070.466=-0.005
σ0.011-0.008=0.003
min2070.450-2070.459=-0.009
max2070.480-2070.480=-0.000
mean1842.600-1850.000=-7.400
σ184.028-172.599=11.429
min1632.000-1646.000=-14.000
max2080.000-2092.000=-12.000
mean4.494-4.581=-0.087
σ0.053-0.156=-0.103
min4.434-4.484=-0.051
max4.563-4.857=-0.294

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.169-1.201=-0.033
σ0.256-0.326=-0.070
min0.919-0.918=0.001
max1.580-1.749=-0.169

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.380-437.382=-0.002
σ572.360-572.363=-0.004
min151.194-151.194=-0.000
max1295.919-1295.927=-0.007
mean90.250
σ8.500
min86.000
max103.000
mean1632.000-1646.000=-14.000
σ0.000
min1632.000-1646.000=-14.000
max1632.000-1646.000=-14.000
mean0.526-0.524=0.003
σ0.543-0.543=-0.001
min0.252-0.248=0.005
max1.341-1.339=0.002
policies=20
mean1512.215-1512.196=0.020
σ0.250-0.238=0.012
min1512.058-1512.053=0.005
max1512.589-1512.551=0.037
mean860.000
σ0.000
min860.000
max860.000
mean1632.000-1646.000=-14.000
σ0.000
min1632.000-1646.000=-14.000
max1632.000-1646.000=-14.000
mean2.540-2.518=0.022
σ0.013-0.009=0.004
min2.528-2.507=0.021
max2.555-2.528=0.027
policies=200
mean15129.728-15129.636=0.092
σ0.052-0.109=-0.057
min15129.661-15129.494=0.167
max15129.787-15129.728=0.059
mean8600.000
σ0.000
min8600.000
max8600.000
mean1632.000-1646.000=-14.000
σ0.000
min1632.000-1646.000=-14.000
max1632.000-1646.000=-14.000
mean25.636-25.616=0.020
σ0.154-0.140=0.014
min25.490-25.462=0.028
max25.790-25.798=-0.008