Compare commits

Home / Compare 7bd1402c .. f1d6b70c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.054=0.002
σ0.367-0.370=-0.003
min53.908-53.904=0.005
max55.101-55.107=-0.006
mean414.700-415.000=-0.300
σ0.483-0.000=0.483
min414.000-415.000=-1.000
max415.000
mean0.139-0.140=-0.001
σ0.004-0.003=0.001
min0.136-0.138=-0.001
max0.147-0.147=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.395-43.394=0.002
σ0.007-0.009=-0.002
min43.385-43.382=0.003
max43.406-43.411=-0.005
mean415.000
σ0.000
min415.000
max415.000
mean0.122-0.121=0.000
σ0.004-0.008=-0.004
min0.118-0.114=0.004
max0.129-0.140=-0.010

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.961-1007.006=-0.046
σ0.875-1.198=-0.323
min1006.462-1006.434=0.028
max1010.585-1012.030=-1.446
mean1047.250-1050.950=-3.700
σ308.257-307.406=0.851
min551.000-577.000=-26.000
max1646.000-1643.000=3.000
mean1.535-1.538=-0.003
σ0.078-0.063=0.016
min1.436-1.455=-0.018
max1.775-1.668=0.107

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1646.000-1643.000=3.000
σ0.000
min1646.000-1643.000=3.000
max1646.000-1643.000=3.000
mean0.421-0.413=0.008
σ0.135-0.128=0.006
min0.346-0.333=0.013
max0.661-0.642=0.019
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1646.000-1643.000=3.000
σ0.000
min1646.000-1643.000=3.000
max1646.000-1643.000=3.000
mean0.894-0.886=0.008
σ0.099-0.091=0.007
min0.825-0.834=-0.008
max1.067-1.049=0.018
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1646.000-1643.000=3.000
σ0.000
min1646.000-1643.000=3.000
max1646.000-1643.000=3.000
mean0.537-0.531=0.006
σ0.048-0.055=-0.007
min0.502-0.486=0.016
max0.621-0.623=-0.001
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1646.000-1643.000=3.000
σ0.000
min1646.000-1643.000=3.000
max1646.000-1643.000=3.000
mean0.851-0.841=0.010
σ0.031-0.041=-0.010
min0.828-0.816=0.012
max0.905-0.912=-0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=0.000
σ0.034-0.033=0.001
min964.809-964.812=-0.002
max964.895-964.895=-0.000
mean1646.000-1643.000=3.000
σ0.000
min1646.000-1643.000=3.000
max1646.000-1643.000=3.000
mean0.828-0.814=0.014
σ0.030-0.037=-0.007
min0.795-0.764=0.030
max0.860-0.851=0.009
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.007-0.007=-0.000
min885.504
max885.521-885.522=-0.001
mean1646.000-1643.000=3.000
σ0.000
min1646.000-1643.000=3.000
max1646.000-1643.000=3.000
mean0.739-0.719=0.020
σ0.003-0.032=-0.029
min0.734-0.665=0.070
max0.742-0.742=0.000

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.002
mean1646.000-1643.000=3.000
σ0.000
min1646.000-1643.000=3.000
max1646.000-1643.000=3.000
mean4.232-4.239=-0.006
σ0.097-0.084=0.013
min4.060-4.108=-0.049
max4.719-4.518=0.201
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1646.000-1643.000=3.000
σ0.000
min1646.000-1643.000=3.000
max1646.000-1643.000=3.000
mean4.222-4.225=-0.003
σ0.076-0.091=-0.015
min4.091-4.099=-0.008
max4.529-4.792=-0.262
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1646.000-1643.000=3.000
σ0.000
min1646.000-1643.000=3.000
max1646.000-1643.000=3.000
mean0.741-0.738=0.002
σ0.018-0.028=-0.009
min0.706-0.698=0.008
max0.852-0.925=-0.073
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1646.000-1643.000=3.000
σ0.000
min1646.000-1643.000=3.000
max1646.000-1643.000=3.000
mean0.711-0.690=0.021
σ0.026-0.020=0.007
min0.518-0.585=-0.067
max0.790-0.788=0.003

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.652-296.892=-1.239
σ0.194-0.194=0.000
min295.527-296.756=-1.230
max296.183-297.408=-1.225
mean1909.000-1921.000=-12.000
σ0.000
min1909.000-1921.000=-12.000
max1909.000-1921.000=-12.000
mean0.565-0.572=-0.007
σ0.046-0.050=-0.004
min0.502-0.503=-0.001
max0.636-0.673=-0.037

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.395-286.820=-1.425
σ0.041-0.040=0.000
min285.344-286.773=-1.429
max285.438-286.865=-1.427
mean1646.000-1643.000=3.000
σ0.000
min1646.000-1643.000=3.000
max1646.000-1643.000=3.000
mean0.391-0.399=-0.008
σ0.008-0.010=-0.002
min0.381-0.388=-0.007
max0.399-0.411=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1295.776-1297.242=-1.465
σ0.107-0.060=0.047
min1295.660-1297.167=-1.507
max1295.909-1297.301=-1.392
mean1646.000-1643.000=3.000
σ0.000
min1646.000-1643.000=3.000
max1646.000-1643.000=3.000
mean1.910-2.074=-0.165
σ0.079-0.072=0.007
min1.807-1.993=-0.186
max1.993-2.156=-0.162
iters=5
new-facts=6402
prior-facts=1
mean1539.903-1541.339=-1.436
σ6.873-6.847=0.025
min1536.576-1538.069=-1.493
max1552.191-1553.583=-1.392
mean1646.000-1643.000=3.000
σ0.000
min1646.000-1643.000=3.000
max1646.000-1643.000=3.000
mean2.284-2.294=-0.010
σ0.252-0.169=0.084
min1.972-2.107=-0.135
max2.559-2.486=0.073
iters=5
new-facts=6402
prior-facts=6402
mean1857.687-1859.118=-1.431
σ0.061-0.074=-0.014
min1857.606-1859.014=-1.408
max1857.762-1859.195=-1.433
mean1778.000-1775.600=2.400
σ130.037-139.735=-9.698
min1646.000-1643.000=3.000
max1909.000-1921.000=-12.000
mean3.065-3.092=-0.027
σ0.277-0.188=0.088
min2.858-2.851=0.007
max3.542-3.281=0.261

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.204-1.220=-0.016
σ0.368-0.328=0.039
min0.941-0.938=0.003
max1.821-1.768=0.053

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.707-448.819=-3.112
σ580.934-581.371=-0.437
min155.238-158.132=-2.894
max1317.109-1320.876=-3.767
mean96.250
σ8.500
min92.000
max109.000
mean1646.000-1643.000=3.000
σ0.000
min1646.000-1643.000=3.000
max1646.000-1643.000=3.000
mean0.550-0.548=0.003
σ0.582-0.570=0.012
min0.258-0.248=0.009
max1.423-1.403=0.020
policies=20
mean1552.658-1581.609=-28.951
σ0.332-0.355=-0.024
min1552.431-1581.371=-28.940
max1553.151-1582.138=-28.987
mean920.000
σ0.000
min920.000
max920.000
mean1646.000-1643.000=3.000
σ0.000
min1646.000-1643.000=3.000
max1646.000-1643.000=3.000
mean2.602-2.631=-0.029
σ0.005-0.012=-0.007
min2.595-2.618=-0.024
max2.607-2.647=-0.040
policies=200
mean15534.735-15824.144=-289.410
σ0.109-0.084=0.025
min15534.669-15824.034=-289.365
max15534.898-15824.230=-289.332
mean9200.000
σ0.000
min9200.000
max9200.000
mean1646.000-1643.000=3.000
σ0.000
min1646.000-1643.000=3.000
max1646.000-1643.000=3.000
mean26.181-26.570=-0.389
σ0.033-0.059=-0.027
min26.141-26.530=-0.389
max26.220-26.658=-0.438