Compare commits

Home / Compare 5f996bc2 .. dd9c77cd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.055=-0.001
σ0.370-0.369=0.001
min53.908-53.909=-0.001
max55.107-55.104=0.003
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.138-0.139=-0.001
σ0.006-0.004=0.001
min0.132-0.133=-0.001
max0.149-0.146=0.003
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.001
σ0.007-0.006=0.001
min43.385-43.386=-0.001
max43.408-43.403=0.004
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.124-0.120=0.004
σ0.004-0.005=-0.001
min0.121-0.114=0.007
max0.131-0.129=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.004-1007.004=-0.001
σ1.196-1.197=-0.001
min1006.441-1006.449=-0.008
max1012.016-1012.021=-0.005
mean1053.250-1051.750=1.500
σ322.538-308.628=13.911
min570.000-576.000=-6.000
max1634.000-1648.000=-14.000
mean1.559-1.536=0.023
σ0.145-0.084=0.062
min1.430-1.455=-0.026
max2.049-1.774=0.275

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean0.418-0.423=-0.005
σ0.140-0.138=0.002
min0.339-0.347=-0.007
max0.667-0.668=-0.001
name=error_case.art
mean2.339-2.339=0.001
σ0.002-0.003=-0.000
min2.337
max2.342
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean0.888-0.889=-0.001
σ0.103-0.093=0.010
min0.818-0.836=-0.018
max1.068-1.052=0.016
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean0.539-0.539=0.000
σ0.059-0.046=0.013
min0.494-0.500=-0.005
max0.641-0.614=0.028
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean0.858-0.856=0.002
σ0.032-0.028=0.004
min0.838-0.834=0.004
max0.914-0.902=0.012

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.839=-0.001
σ0.032-0.026=0.005
min964.811-964.814=-0.003
max964.890-964.879=0.011
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean0.848-0.829=0.020
σ0.021-0.025=-0.004
min0.813-0.798=0.015
max0.865-0.858=0.007
name=cdr_enhanced_4k_loc.art
mean885.512-885.513=-0.001
σ0.007-0.006=0.000
min885.506-885.504=0.001
max885.522-885.522=0.000
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean0.731-0.702=0.029
σ0.016-0.057=-0.041
min0.706-0.612=0.094
max0.745-0.744=0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.720=-0.001
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean4.264-3.564=0.700
σ0.094-0.071=0.022
min4.116-3.413=0.703
max4.539-3.871=0.668
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean4.253-3.560=0.693
σ0.112-0.085=0.027
min4.080-3.408=0.672
max4.914-3.835=1.079
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean0.758-0.750=0.007
σ0.026-0.017=0.008
min0.715-0.718=-0.003
max0.942-0.843=0.099
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean0.711-0.713=-0.002
σ0.025-0.015=0.010
min0.541-0.682=-0.141
max0.772-0.779=-0.006

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.064-296.902=0.161
σ0.204-0.224=-0.021
min296.863-296.759=0.103
max297.600-297.508=0.092
mean2048.000-1891.000=157.000
σ0.000
min2048.000-1891.000=157.000
max2048.000-1891.000=157.000
mean0.560-0.593=-0.033
σ0.033-0.040=-0.007
min0.511-0.527=-0.016
max0.594-0.686=-0.093

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.819-286.824=-0.005
σ0.038-0.041=-0.004
min286.772-286.780=-0.009
max286.858-286.880=-0.022
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean0.394-0.401=-0.007
σ0.007-0.014=-0.007
min0.389-0.390=-0.001
max0.402-0.422=-0.020
iters=5
new-facts=1
prior-facts=6402
mean1297.272-1297.233=0.039
σ0.088-0.062=0.026
min1297.153-1297.170=-0.017
max1297.387-1297.314=0.073
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean2.209-2.080=0.130
σ0.031-0.076=-0.045
min2.174-1.990=0.184
max2.256-2.170=0.086
iters=5
new-facts=6402
prior-facts=1
mean1541.359-1541.326=0.033
σ6.813-6.846=-0.033
min1538.165-1538.109=0.055
max1553.545-1553.569=-0.024
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean2.264-2.241=0.023
σ0.123-0.179=-0.055
min2.157-2.073=0.084
max2.416-2.503=-0.087
iters=5
new-facts=6402
prior-facts=6402
mean1859.119-1859.113=0.005
σ0.065-0.085=-0.020
min1859.031-1858.986=0.045
max1859.187-1859.194=-0.008
mean1789.800-1775.400=14.400
σ179.126-118.488=60.639
min1634.000-1648.000=-14.000
max2048.000-1891.000=157.000
mean3.005-3.125=-0.120
σ0.097-0.291=-0.194
min2.859-2.845=0.014
max3.102-3.554=-0.452

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.195-1.140=0.055
σ0.263-0.307=-0.044
min0.933-0.903=0.030
max1.616-1.634=-0.018

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.820=0.002
σ581.372-581.372=0.000
min158.134-158.133=0.002
max1320.880-1320.877=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean0.549-0.548=0.002
σ0.573-0.564=0.008
min0.260-0.261=-0.001
max1.408-1.394=0.014
policies=20
mean1581.629-1581.611=0.018
σ0.360-0.359=0.001
min1581.388-1581.371=0.017
max1582.165-1582.146=0.019
mean920.000
σ0.000
min920.000
max920.000
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean2.644-2.638=0.006
σ0.049-0.011=0.038
min2.609-2.626=-0.017
max2.714-2.648=0.066
policies=200
mean15824.260-15824.195=0.065
σ0.077-0.134=-0.057
min15824.196-15824.037=0.159
max15824.370-15824.362=0.009
mean9200.000
σ0.000
min9200.000
max9200.000
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean26.642-26.606=0.036
σ0.017-0.030=-0.014
min26.617-26.575=0.042
max26.652-26.640=0.013