Compare commits

Home / Compare 491e17ab .. b58a543c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.015=-0.001
σ0.371-0.368=0.002
min53.876-53.869=0.007
max55.069-55.063=0.006
mean420.000-417.000=3.000
σ0.000
min420.000-417.000=3.000
max420.000-417.000=3.000
mean0.138-0.141=-0.003
σ0.003-0.005=-0.002
min0.131-0.136=-0.005
max0.145-0.154=-0.009
cache=y
dps=1
iters=10
policies=100
mean43.321-43.322=-0.001
σ0.006-0.005=0.000
min43.312-43.314=-0.002
max43.334-43.333=0.001
mean420.000-417.000=3.000
σ0.000
min420.000-417.000=3.000
max420.000-417.000=3.000
mean0.120-0.122=-0.002
σ0.004-0.003=0.001
min0.115-0.118=-0.003
max0.128-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.304-1006.309=-0.005
σ1.185-1.175=0.010
min1005.741-1005.769=-0.028
max1011.270-1011.229=0.042
mean1048.650-1044.550=4.100
σ310.070-313.262=-3.192
min600.000-596.000=4.000
max1643.000-1638.000=5.000
mean1.544-1.555=-0.012
σ0.065-0.088=-0.023
min1.478-1.352=0.126
max1.670-1.758=-0.089

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.412-0.406=0.006
σ0.154-0.136=0.018
min0.322-0.326=-0.004
max0.684-0.647=0.037
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.884-0.873=0.010
σ0.091-0.090=0.001
min0.821-0.809=0.011
max1.041-1.026=0.015
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.553-0.531=0.022
σ0.046-0.055=-0.009
min0.522-0.489=0.033
max0.633-0.626=0.006
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.849-0.827=0.022
σ0.035-0.034=0.002
min0.804-0.799=0.004
max0.903-0.883=0.020

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114-964.114=-0.001
σ0.033-0.033=0.000
min964.088
max964.169-964.169=0.000
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.854-0.837=0.017
σ0.007-0.021=-0.015
min0.845-0.812=0.033
max0.861-0.856=0.004
name=cdr_enhanced_4k_loc.art
mean884.712-884.711=0.001
σ0.008-0.004=0.004
min884.703
max884.723-884.714=0.008
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.728-0.702=0.026
σ0.016-0.045=-0.029
min0.700-0.649=0.051
max0.743-0.737=0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=0.000
min7.714
max7.719-7.718=0.001
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean3.502-4.196=-0.694
σ0.086-0.071=0.015
min3.347-4.065=-0.718
max3.742-4.578=-0.835
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean3.478-4.182=-0.704
σ0.071-0.059=0.012
min3.348-4.078=-0.730
max3.778-4.387=-0.609
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.525-0.731=-0.206
σ0.014-0.018=-0.004
min0.494-0.696=-0.201
max0.615-0.859=-0.244
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.498-0.697=-0.199
σ0.036-0.016=0.020
min0.468-0.662=-0.194
max0.835-0.762=0.073

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.186-296.437=-0.252
σ0.184-0.255=-0.071
min295.927-296.121=-0.194
max296.638-297.073=-0.435
mean1917.000-1898.000=19.000
σ0.000
min1917.000-1898.000=19.000
max1917.000-1898.000=19.000
mean0.555-0.581=-0.026
σ0.046-0.048=-0.002
min0.504-0.515=-0.011
max0.610-0.696=-0.086

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.694-284.687=0.007
σ0.034-0.037=-0.003
min284.649-284.638=0.011
max284.731-284.724=0.007
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.396-0.395=0.001
σ0.007-0.010=-0.003
min0.388-0.383=0.005
max0.404-0.402=0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.074-1295.040=0.034
σ0.105-0.091=0.013
min1294.950-1294.961=-0.011
max1295.197-1295.185=0.012
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean1.894-1.889=0.005
σ0.052-0.148=-0.096
min1.813-1.788=0.025
max1.942-2.149=-0.208
iters=5
new-facts=6402
prior-facts=1
mean1539.208-1539.273=-0.066
σ6.856-6.772=0.084
min1535.914-1536.145=-0.231
max1551.468-1551.386=0.083
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean2.199-2.353=-0.154
σ0.234-0.260=-0.026
min2.056-2.139=-0.082
max2.614-2.749=-0.135
iters=5
new-facts=6402
prior-facts=6402
mean1856.991-1856.984=0.007
σ0.054-0.053=0.002
min1856.935-1856.934=0.001
max1857.070-1857.063=0.007
mean1777.600-1767.600=10.000
σ135.388-125.111=10.276
min1643.000-1638.000=5.000
max1917.000-1898.000=19.000
mean3.046-3.054=-0.009
σ0.288-0.276=0.012
min2.873-2.834=0.039
max3.558-3.531=0.027

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.237-1.252=-0.015
σ0.361-0.328=0.033
min0.934-0.936=-0.002
max1.714-1.793=-0.079

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.787-447.785=0.001
σ581.212-581.212=-0.000
min157.179-157.178=0.001
max1319.605-1319.604=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.535-0.544=-0.008
σ0.540-0.567=-0.027
min0.261-0.259=0.002
max1.345-1.394=-0.048
policies=20
mean1572.101-1572.113=-0.012
σ0.349-0.369=-0.020
min1571.867-1571.864=0.002
max1572.621-1572.662=-0.041
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean2.619-2.653=-0.034
σ0.026-0.022=0.004
min2.599-2.639=-0.040
max2.656-2.685=-0.029
policies=200
mean15729.083-15729.002=0.081
σ0.104-0.126=-0.022
min15728.994-15728.900=0.095
max15729.227-15729.158=0.069
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean26.521-26.598=-0.077
σ0.044-0.162=-0.118
min26.474-26.382=0.092
max26.562-26.763=-0.201