Compare commits

Home / Compare a38701fd .. 99a49f39

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.053-54.055=-0.002
σ0.370-0.370=-0.000
min53.907-53.912=-0.005
max55.105-55.108=-0.003
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.137-0.140=-0.003
σ0.005-0.005=-0.000
min0.131-0.135=-0.004
max0.146-0.149=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.001
σ0.006-0.006=0.000
min43.385-43.385=-0.000
max43.404-43.404=-0.000
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.123-0.119=0.004
σ0.005-0.004=0.001
min0.114-0.114=0.000
max0.130-0.126=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.002-1007.004=-0.002
σ1.190-1.187=0.003
min1006.431-1006.435=-0.004
max1011.990-1011.980=0.010
mean1042.250-1049.600=-7.350
σ313.299-307.750=5.549
min588.000-575.000=13.000
max1636.000-1641.000=-5.000
mean1.545-1.540=0.005
σ0.074-0.075=-0.001
min1.466-1.474=-0.008
max1.784-1.768=0.017

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1636.000-1641.000=-5.000
σ0.000
min1636.000-1641.000=-5.000
max1636.000-1641.000=-5.000
mean0.415-0.423=-0.009
σ0.130-0.128=0.002
min0.327-0.348=-0.021
max0.641-0.650=-0.009
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1636.000-1641.000=-5.000
σ0.000
min1636.000-1641.000=-5.000
max1636.000-1641.000=-5.000
mean0.959-0.890=0.069
σ0.170-0.113=0.056
min0.838-0.821=0.017
max1.242-1.085=0.157
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1636.000-1641.000=-5.000
σ0.000
min1636.000-1641.000=-5.000
max1636.000-1641.000=-5.000
mean0.532-0.539=-0.007
σ0.047-0.045=0.001
min0.488-0.506=-0.018
max0.608-0.617=-0.009
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1636.000-1641.000=-5.000
σ0.000
min1636.000-1641.000=-5.000
max1636.000-1641.000=-5.000
mean0.850-0.854=-0.004
σ0.033-0.044=-0.011
min0.818-0.814=0.004
max0.902-0.925=-0.023

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.840=-0.001
σ0.025-0.036=-0.010
min964.821-964.809=0.012
max964.883-964.898=-0.015
mean1636.000-1641.000=-5.000
σ0.000
min1636.000-1641.000=-5.000
max1636.000-1641.000=-5.000
mean0.818-0.817=0.001
σ0.043-0.040=0.003
min0.750-0.765=-0.015
max0.862-0.857=0.005
name=cdr_enhanced_4k_loc.art
mean885.511-885.512=-0.000
σ0.007-0.007=-0.000
min885.504
max885.522-885.523=-0.001
mean1636.000-1641.000=-5.000
σ0.000
min1636.000-1641.000=-5.000
max1636.000-1641.000=-5.000
mean0.725-0.697=0.028
σ0.020-0.042=-0.022
min0.694-0.645=0.049
max0.747-0.739=0.008

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.002
mean1636.000-1641.000=-5.000
σ0.000
min1636.000-1641.000=-5.000
max1636.000-1641.000=-5.000
mean4.252-2.805=1.448
σ0.095-0.088=0.007
min4.109-2.680=1.429
max4.704-3.229=1.474
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.670=-0.003
mean1636.000-1641.000=-5.000
σ0.000
min1636.000-1641.000=-5.000
max1636.000-1641.000=-5.000
mean4.211-2.912=1.299
σ0.086-0.294=-0.208
min4.067-2.623=1.444
max4.494-3.741=0.754
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1636.000-1641.000=-5.000
σ0.000
min1636.000-1641.000=-5.000
max1636.000-1641.000=-5.000
mean0.740-0.533=0.207
σ0.018-0.018=-0.000
min0.696-0.511=0.185
max0.847-0.644=0.203
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1636.000-1641.000=-5.000
σ0.000
min1636.000-1641.000=-5.000
max1636.000-1641.000=-5.000
mean0.701-0.505=0.197
σ0.017-0.018=-0.001
min0.668-0.473=0.194
max0.782-0.620=0.162

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.016-296.933=0.082
σ0.201-0.225=-0.024
min296.888-296.719=0.169
max297.570-297.525=0.045
mean1895.000-1950.000=-55.000
σ0.000
min1895.000-1950.000=-55.000
max1895.000-1950.000=-55.000
mean0.592-0.583=0.009
σ0.042-0.048=-0.006
min0.499-0.525=-0.026
max0.667-0.697=-0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.819-286.820=-0.001
σ0.040-0.038=0.002
min286.774-286.767=0.006
max286.869-286.859=0.009
mean1636.000-1641.000=-5.000
σ0.000
min1636.000-1641.000=-5.000
max1636.000-1641.000=-5.000
mean0.394-0.398=-0.004
σ0.009-0.007=0.001
min0.386-0.390=-0.004
max0.405-0.405=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1297.272-1297.256=0.016
σ0.093-0.074=0.019
min1297.153-1297.172=-0.020
max1297.397-1297.332=0.064
mean1636.000-1641.000=-5.000
σ0.000
min1636.000-1641.000=-5.000
max1636.000-1641.000=-5.000
mean2.305-2.122=0.184
σ0.233-0.078=0.155
min2.172-2.025=0.146
max2.720-2.199=0.522
iters=5
new-facts=6402
prior-facts=1
mean1541.361-1541.312=0.049
σ6.807-6.846=-0.039
min1538.191-1538.055=0.136
max1553.535-1553.553=-0.018
mean1636.000-1641.000=-5.000
σ0.000
min1636.000-1641.000=-5.000
max1636.000-1641.000=-5.000
mean2.277-2.192=0.085
σ0.171-0.108=0.062
min2.159-2.114=0.045
max2.551-2.378=0.173
iters=5
new-facts=6402
prior-facts=6402
mean1859.117-1859.120=-0.003
σ0.064-0.066=-0.002
min1859.026-1859.039=-0.012
max1859.197-1859.193=0.003
mean1767.800-1789.000=-21.200
σ126.581-155.182=-28.601
min1636.000-1641.000=-5.000
max1895.000-1950.000=-55.000
mean3.092-2.980=0.112
σ0.402-0.086=0.316
min2.629-2.846=-0.218
max3.698-3.062=0.636

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.173-1.200=-0.026
σ0.265-0.353=-0.089
min0.932-0.943=-0.011
max1.571-1.788=-0.217

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.822=-0.002
σ581.370-581.372=-0.002
min158.133-158.134=-0.001
max1320.875-1320.880=-0.005
mean96.250
σ8.500
min92.000
max109.000
mean1636.000-1641.000=-5.000
σ0.000
min1636.000-1641.000=-5.000
max1636.000-1641.000=-5.000
mean0.542-0.553=-0.011
σ0.547-0.580=-0.033
min0.261-0.260=0.001
max1.362-1.423=-0.061
policies=20
mean1581.617-1581.628=-0.011
σ0.361-0.359=0.003
min1581.371-1581.383=-0.012
max1582.154-1582.161=-0.007
mean920.000
σ0.000
min920.000
max920.000
mean1636.000-1641.000=-5.000
σ0.000
min1636.000-1641.000=-5.000
max1636.000-1641.000=-5.000
mean2.639-2.637=0.002
σ0.020-0.009=0.011
min2.624-2.628=-0.004
max2.667-2.649=0.018
policies=200
mean15824.261-15824.237=0.024
σ0.105-0.084=0.021
min15824.165-15824.174=-0.009
max15824.394-15824.360=0.034
mean9200.000
σ0.000
min9200.000
max9200.000
mean1636.000-1641.000=-5.000
σ0.000
min1636.000-1641.000=-5.000
max1636.000-1641.000=-5.000
mean26.622-26.546=0.075
σ0.084-0.053=0.031
min26.557-26.484=0.073
max26.744-26.610=0.134