Compare commits

Home / Compare 0f4c050e .. 62629a5c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.056=-0.003
σ0.370-0.369=0.001
min53.911-53.915=-0.005
max55.106-55.107=-0.001
mean419.000
σ0.000
min419.000
max419.000
mean0.140-0.140=0.000
σ0.005-0.004=0.001
min0.133-0.134=-0.002
max0.147-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=-0.000
σ0.005-0.006=-0.001
min43.387-43.385=0.002
max43.402-43.406=-0.005
mean419.000
σ0.000
min419.000
max419.000
mean0.123-0.122=0.002
σ0.004-0.004=-0.001
min0.120-0.117=0.003
max0.128-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.002-1007.004=-0.002
σ1.204-1.204=-0.000
min1006.459-1006.461=-0.002
max1012.051-1012.058=-0.008
mean1053.050-1051.550=1.500
σ310.072-315.922=-5.850
min554.000-576.000=-22.000
max1646.000-1649.000=-3.000
mean1.572-1.577=-0.005
σ0.089-0.108=-0.020
min1.485-1.412=0.072
max1.804-1.873=-0.069

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean0.424-0.416=0.008
σ0.127-0.137=-0.010
min0.351-0.319=0.032
max0.648-0.658=-0.009
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean0.887-0.880=0.008
σ0.095-0.095=0.000
min0.817-0.825=-0.008
max1.049-1.048=0.001
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean0.544-0.536=0.008
σ0.056-0.054=0.002
min0.499-0.494=0.006
max0.631-0.629=0.002
name=nested_use.art
mean2.361-2.361=-0.000
σ0.002-0.002=-0.001
min2.360
max2.364-2.365=-0.002
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean0.858-0.853=0.006
σ0.031-0.028=0.002
min0.834-0.832=0.002
max0.910-0.901=0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.839=-0.001
σ0.034-0.033=0.000
min964.811-964.811=0.000
max964.895-964.895=0.000
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean0.835-0.830=0.005
σ0.014-0.035=-0.021
min0.810-0.781=0.029
max0.843-0.858=-0.015
name=cdr_enhanced_4k_loc.art
mean885.512-885.511=0.001
σ0.008-0.007=0.000
min885.504
max885.523-885.522=0.001
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean0.686-0.706=-0.019
σ0.046-0.039=0.007
min0.627-0.664=-0.037
max0.733-0.743=-0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.720-7.721=-0.000
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean4.247-4.260=-0.012
σ0.102-0.076=0.026
min4.067-4.141=-0.074
max4.557-4.562=-0.006
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean4.173-4.246=-0.073
σ0.239-0.065=0.174
min3.442-4.132=-0.690
max4.551-4.559=-0.008
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean0.694-0.740=-0.046
σ0.102-0.019=0.083
min0.521-0.710=-0.188
max0.856-0.860=-0.003
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean0.437-0.701=-0.263
σ0.126-0.018=0.108
min0.279-0.662=-0.383
max0.899-0.783=0.116

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.030-297.062=-0.031
σ0.249-0.278=-0.029
min296.879-296.901=-0.022
max297.720-297.828=-0.108
mean1904.000-2028.000=-124.000
σ0.000
min1904.000-2028.000=-124.000
max1904.000-2028.000=-124.000
mean0.576-0.555=0.021
σ0.041-0.034=0.007
min0.511-0.505=0.006
max0.657-0.587=0.069

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.819-286.822=-0.003
σ0.038-0.038=-0.000
min286.764-286.771=-0.007
max286.855-286.866=-0.011
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean0.397-0.394=0.003
σ0.007-0.006=0.001
min0.388-0.389=-0.001
max0.403-0.401=0.002
iters=5
new-facts=1
prior-facts=6402
mean1297.280-1297.284=-0.004
σ0.083-0.085=-0.002
min1297.177-1297.180=-0.003
max1297.395-1297.403=-0.008
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean2.214-2.267=-0.053
σ0.034-0.069=-0.035
min2.169-2.162=0.006
max2.251-2.336=-0.086
iters=5
new-facts=6402
prior-facts=1
mean1541.347-1541.336=0.011
σ6.819-6.825=-0.007
min1538.151-1538.124=0.027
max1553.542-1553.542=0.000
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean2.252-2.214=0.038
σ0.129-0.107=0.021
min2.151-2.125=0.026
max2.410-2.389=0.021
iters=5
new-facts=6402
prior-facts=6402
mean1859.114-1859.117=-0.003
σ0.070-0.062=0.008
min1859.026-1859.033=-0.007
max1859.199-1859.189=0.010
mean1774.200-1789.600=-15.400
σ125.587-165.657=-40.070
min1646.000-1649.000=-3.000
max1904.000-2028.000=-124.000
mean3.065-3.058=0.007
σ0.207-0.339=-0.132
min2.849-2.832=0.017
max3.326-3.647=-0.321

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.208-1.245=-0.037
σ0.345-0.319=0.026
min0.929-0.938=-0.010
max1.727-1.644=0.083

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.822=-0.000
σ581.372-581.372=0.000
min158.133-158.134=-0.001
max1320.880-1320.880=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean0.572-0.553=0.019
σ0.602-0.576=0.026
min0.269-0.262=0.007
max1.474-1.417=0.058
policies=20
mean1581.618-1581.631=-0.013
σ0.361-0.366=-0.004
min1581.375-1581.382=-0.008
max1582.155-1582.174=-0.019
mean920.000
σ0.000
min920.000
max920.000
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean2.647-2.650=-0.004
σ0.009-0.018=-0.009
min2.633-2.631=0.003
max2.653-2.671=-0.019
policies=200
mean15824.262-15824.137=0.125
σ0.104-0.114=-0.010
min15824.188-15824.011=0.177
max15824.414-15824.279=0.135
mean9200.000
σ0.000
min9200.000
max9200.000
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean26.754-26.734=0.020
σ0.223-0.028=0.194
min26.620-26.699=-0.079
max27.087-26.764=0.323