Compare commits

Home / Compare 15150783 .. 8f28e13b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.055=0.001
σ0.370-0.370=0.001
min53.912-53.907=0.005
max55.109-55.106=0.003
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.143-0.140=0.002
σ0.006-0.004=0.002
min0.136-0.137=-0.001
max0.156-0.147=0.009
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.001
σ0.007-0.006=0.000
min43.386-43.384=0.001
max43.405-43.404=0.001
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.126-0.123=0.003
σ0.010-0.004=0.006
min0.114-0.118=-0.004
max0.147-0.131=0.016

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.006-1006.999=0.007
σ1.209-1.264=-0.056
min1006.433-1006.461=-0.027
max1012.075-1012.312=-0.238
mean1053.800-1047.750=6.050
σ308.918-314.303=-5.385
min579.000-572.000=7.000
max1652.000-1646.000=6.000
mean1.557-1.591=-0.034
σ0.061-0.137=-0.077
min1.479-1.492=-0.014
max1.692-2.034=-0.342

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1652.000-1646.000=6.000
σ0.000
min1652.000-1646.000=6.000
max1652.000-1646.000=6.000
mean0.423-0.441=-0.019
σ0.151-0.141=0.010
min0.350-0.326=0.024
max0.692-0.683=0.009
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1652.000-1646.000=6.000
σ0.000
min1652.000-1646.000=6.000
max1652.000-1646.000=6.000
mean0.897-0.909=-0.012
σ0.097-0.177=-0.079
min0.831-0.809=0.022
max1.068-1.224=-0.156
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1652.000-1646.000=6.000
σ0.000
min1652.000-1646.000=6.000
max1652.000-1646.000=6.000
mean0.531-0.537=-0.006
σ0.049-0.045=0.004
min0.495-0.505=-0.010
max0.614-0.614=-0.000
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1652.000-1646.000=6.000
σ0.000
min1652.000-1646.000=6.000
max1652.000-1646.000=6.000
mean0.845-0.833=0.012
σ0.037-0.039=-0.002
min0.812-0.797=0.015
max0.905-0.898=0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=0.000
σ0.033-0.035=-0.002
min964.813-964.809=0.003
max964.894-964.896=-0.002
mean1652.000-1646.000=6.000
σ0.000
min1652.000-1646.000=6.000
max1652.000-1646.000=6.000
mean0.848-0.816=0.032
σ0.026-0.053=-0.026
min0.803-0.747=0.056
max0.872-0.864=0.008
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.001
σ0.007-0.008=-0.000
min885.504
max885.522-885.523=-0.001
mean1652.000-1646.000=6.000
σ0.000
min1652.000-1646.000=6.000
max1652.000-1646.000=6.000
mean0.711-0.725=-0.014
σ0.032-0.021=0.011
min0.680-0.691=-0.011
max0.746-0.742=0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1652.000-1646.000=6.000
σ0.000
min1652.000-1646.000=6.000
max1652.000-1646.000=6.000
mean4.234-3.540=0.694
σ0.075-0.076=-0.001
min4.092-3.430=0.663
max4.538-4.007=0.531
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668
mean1652.000-1646.000=6.000
σ0.000
min1652.000-1646.000=6.000
max1652.000-1646.000=6.000
mean4.242-3.543=0.699
σ0.096-0.072=0.024
min4.089-3.425=0.663
max4.524-3.826=0.698
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1652.000-1646.000=6.000
σ0.000
min1652.000-1646.000=6.000
max1652.000-1646.000=6.000
mean0.740-0.740=-0.001
σ0.039-0.019=0.020
min0.542-0.704=-0.162
max0.937-0.848=0.089
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1652.000-1646.000=6.000
σ0.000
min1652.000-1646.000=6.000
max1652.000-1646.000=6.000
mean0.697-0.703=-0.006
σ0.016-0.019=-0.003
min0.665-0.667=-0.002
max0.781-0.772=0.009

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.830-296.960=-0.130
σ0.266-0.228=0.037
min296.633-296.732=-0.099
max297.569-297.581=-0.012
mean1899.000-2064.000=-165.000
σ0.000
min1899.000-2064.000=-165.000
max1899.000-2064.000=-165.000
mean0.592-0.571=0.022
σ0.033-0.037=-0.004
min0.556-0.500=0.056
max0.673-0.603=0.071

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.821-286.821=-0.000
σ0.039-0.035=0.003
min286.770-286.772=-0.002
max286.860-286.861=-0.001
mean1652.000-1646.000=6.000
σ0.000
min1652.000-1646.000=6.000
max1652.000-1646.000=6.000
mean0.396-0.399=-0.003
σ0.007-0.007=0.000
min0.387-0.390=-0.002
max0.401-0.406=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1297.226-1297.274=-0.048
σ0.076-0.099=-0.023
min1297.131-1297.138=-0.007
max1297.300-1297.405=-0.106
mean1652.000-1646.000=6.000
σ0.000
min1652.000-1646.000=6.000
max1652.000-1646.000=6.000
mean2.039-2.263=-0.224
σ0.059-0.057=0.001
min1.993-2.176=-0.183
max2.139-2.318=-0.179
iters=5
new-facts=6402
prior-facts=1
mean1541.317-1541.362=-0.044
σ6.837-6.807=0.030
min1538.058-1538.190=-0.132
max1553.542-1553.537=0.005
mean1652.000-1646.000=6.000
σ0.000
min1652.000-1646.000=6.000
max1652.000-1646.000=6.000
mean2.247-2.293=-0.046
σ0.139-0.185=-0.046
min2.087-2.145=-0.058
max2.415-2.599=-0.184
iters=5
new-facts=6402
prior-facts=6402
mean1859.114-1859.117=-0.003
σ0.079-0.073=0.006
min1858.995-1859.031=-0.036
max1859.187-1859.195=-0.008
mean1770.600-1801.600=-31.000
σ122.680-180.717=-58.038
min1652.000-1646.000=6.000
max1899.000-2064.000=-165.000
mean3.096-2.991=0.105
σ0.265-0.103=0.162
min2.872-2.844=0.028
max3.547-3.112=0.435

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.225-1.202=0.022
σ0.340-0.277=0.063
min0.938-0.933=0.005
max1.793-1.601=0.192

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.818=0.003
σ581.372-581.373=-0.000
min158.131-158.129=0.003
max1320.879-1320.877=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1652.000-1646.000=6.000
σ0.000
min1652.000-1646.000=6.000
max1652.000-1646.000=6.000
mean0.537-0.565=-0.027
σ0.547-0.586=-0.039
min0.262-0.263=-0.001
max1.358-1.444=-0.086
policies=20
mean1581.629-1581.612=0.017
σ0.359-0.363=-0.004
min1581.387-1581.368=0.019
max1582.163-1582.152=0.011
mean920.000
σ0.000
min920.000
max920.000
mean1652.000-1646.000=6.000
σ0.000
min1652.000-1646.000=6.000
max1652.000-1646.000=6.000
mean2.638-2.646=-0.008
σ0.020-0.017=0.004
min2.625-2.635=-0.010
max2.668-2.670=-0.003
policies=200
mean15824.218-15824.089=0.130
σ0.037-0.118=-0.081
min15824.182-15824.005=0.177
max15824.263-15824.258=0.005
mean9200.000
σ0.000
min9200.000
max9200.000
mean1652.000-1646.000=6.000
σ0.000
min1652.000-1646.000=6.000
max1652.000-1646.000=6.000
mean26.637-26.686=-0.049
σ0.058-0.094=-0.036
min26.555-26.612=-0.057
max26.679-26.824=-0.145