Compare commits

Home / Compare 8e40bf5f .. 0f22dfc2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.910-55.029=-1.119
σ0.368-0.052=0.317
min53.781-54.989=-1.208
max54.959-55.169=-0.211
mean413.600-415.600=-2.000
σ0.966-0.843=0.123
min413.000-414.000=-1.000
max415.000-416.000=-1.000
mean0.136-0.139=-0.003
σ0.006-0.004=0.002
min0.130-0.136=-0.006
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.140-44.363=-1.223
σ0.005-0.004=0.002
min43.134-44.359=-1.226
max43.148-44.372=-1.224
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.121-0.121=-0.000
σ0.003-0.003=0.000
min0.117-0.119=-0.002
max0.125-0.127=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.061-1767.295=-775.234
σ1.237-0.364=0.873
min991.522-1766.717=-775.195
max997.270-1767.885=-770.615
mean1073.350-1649.050=-575.700
σ322.525-629.235=-306.710
min611.000-671.000=-60.000
max1642.000-2729.000=-1087.000
mean1.520-2.409=-0.889
σ0.072-0.178=-0.107
min1.429-2.264=-0.836
max1.743-3.091=-1.349

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.601-350.829=-65.228
σ0.008-0.070=-0.061
min285.590-350.705=-65.115
max285.610-350.872=-65.261
mean1642.000-2729.000=-1087.000
σ0.000
min1642.000-2729.000=-1087.000
max1642.000-2729.000=-1087.000
mean0.376-0.458=-0.082
σ0.001-0.006=-0.005
min0.375-0.452=-0.078
max0.378-0.464=-0.087
iters=5
new-facts=1
prior-facts=6402
mean1285.546-2012.904=-727.358
σ0.086-0.009=0.077
min1285.503-2012.891=-727.387
max1285.699-2012.914=-727.215
mean1642.000-2729.000=-1087.000
σ0.000
min1642.000-2729.000=-1087.000
max1642.000-2729.000=-1087.000
mean1.880-2.713=-0.833
σ0.074-0.071=0.003
min1.808-2.606=-0.798
max1.997-2.792=-0.795
iters=5
new-facts=6402
prior-facts=1
mean1807.956-4837.661=-3029.705
σ7.080-7.867=-0.787
min1804.591-4833.834=-3029.242
max1820.607-4851.725=-3031.118
mean1642.000-2729.000=-1087.000
σ0.000
min1642.000-2729.000=-1087.000
max1642.000-2729.000=-1087.000
mean4.156-8.355=-4.199
σ0.165-0.446=-0.280
min4.018-7.958=-3.940
max4.418-9.089=-4.670
iters=5
new-facts=6402
prior-facts=6402
mean2070.388-5025.397=-2955.010
σ0.006-0.015=-0.009
min2070.379-5025.372=-2954.993
max2070.394-5025.410=-2955.016
mean1866.000-3031.800=-1165.800
σ195.071-357.028=-161.957
min1642.000-2729.000=-1087.000
max2090.000-3557.000=-1467.000
mean4.505-9.737=-5.232
σ0.038-0.352=-0.315
min4.461-9.143=-4.682
max4.562-10.076=-5.514

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.199-1.027=0.173
σ0.289-0.126=0.164
min0.904-0.915=-0.012
max1.587-1.221=0.366

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.616-469.209=-31.593
σ572.839-574.769=-1.930
min151.190-181.816=-30.626
max1296.875-1331.362=-34.487
mean90.250
σ8.500
min86.000
max103.000
mean1642.000-2729.000=-1087.000
σ0.000
min1642.000-2729.000=-1087.000
max1642.000-2729.000=-1087.000
mean0.533-0.555=-0.022
σ0.553-0.529=0.024
min0.254-0.287=-0.033
max1.362-1.348=0.014
policies=20
mean1512.182-1818.486=-306.304
σ0.259-0.388=-0.129
min1512.006-1818.226=-306.220
max1512.567-1819.061=-306.494
mean860.000
σ0.000
min860.000
max860.000
mean1642.000-2729.000=-1087.000
σ0.000
min1642.000-2729.000=-1087.000
max1642.000-2729.000=-1087.000
mean2.536-2.792=-0.256
σ0.015-0.011=0.003
min2.515-2.781=-0.266
max2.548-2.805=-0.257
policies=200
mean15129.508-18192.305=-3062.798
σ0.085-0.609=-0.524
min15129.438-18191.910=-3062.472
max15129.624-18193.210=-3063.587
mean8600.000
σ0.000
min8600.000
max8600.000
mean1642.000-2729.000=-1087.000
σ0.000
min1642.000-2729.000=-1087.000
max1642.000-2729.000=-1087.000
mean25.707-28.153=-2.446
σ0.076-0.082=-0.006
min25.645-28.097=-2.452
max25.808-28.274=-2.467