Compare commits

Home / Compare 48b270d2 .. 6cf343eb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.967-53.965=0.002
σ0.369-0.370=-0.001
min53.827-53.821=0.006
max55.017-55.018=-0.001
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.153-0.140=0.013
σ0.008-0.004=0.004
min0.138-0.136=0.001
max0.164-0.148=0.015
cache=y
dps=1
iters=10
policies=100
mean43.323-43.321=0.001
σ0.007-0.007=0.000
min43.310-43.314=-0.003
max43.338-43.339=-0.001
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.122-0.121=0.000
σ0.006-0.005=0.001
min0.115-0.115=0.000
max0.134-0.131=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.515-1006.511=0.004
σ1.194-1.181=0.013
min1005.960-1005.973=-0.013
max1011.510-1011.466=0.044
mean1039.950-1053.050=-13.100
σ310.022-307.190=2.832
min550.000-587.000=-37.000
max1507.000-1645.000=-138.000
mean1.530-1.528=0.002
σ0.085-0.078=0.007
min1.455-1.455=0.000
max1.798-1.747=0.051

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.000
σ0.003-0.003=0.000
min0.882
max0.887
mean1507.000-1645.000=-138.000
σ0.000
min1507.000-1645.000=-138.000
max1507.000-1645.000=-138.000
mean0.417-0.419=-0.002
σ0.147-0.134=0.013
min0.328-0.329=-0.001
max0.679-0.656=0.023
name=error_case.art
mean2.339-2.339=0.000
σ0.002-0.003=-0.000
min2.337
max2.342
mean1507.000-1645.000=-138.000
σ0.000
min1507.000-1645.000=-138.000
max1507.000-1645.000=-138.000
mean0.890-0.891=-0.001
σ0.098-0.091=0.007
min0.799-0.834=-0.035
max1.055-1.051=0.004
name=heavy_item.art
mean1.524-1.524=0.001
σ0.002-0.002=0.001
min1.522
max1.528-1.526=0.002
mean1507.000-1645.000=-138.000
σ0.000
min1507.000-1645.000=-138.000
max1507.000-1645.000=-138.000
mean0.539-0.539=0.000
σ0.049-0.054=-0.005
min0.502-0.500=0.002
max0.620-0.631=-0.012
name=nested_use.art
mean2.361-2.361=-0.000
σ0.002-0.002=0.000
min2.360
max2.364
mean1507.000-1645.000=-138.000
σ0.000
min1507.000-1645.000=-138.000
max1507.000-1645.000=-138.000
mean0.845-0.846=-0.002
σ0.035-0.041=-0.006
min0.815-0.807=0.008
max0.902-0.912=-0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.824-964.838=-0.014
σ0.031-0.031=-0.001
min964.802-964.811=-0.010
max964.875-964.892=-0.016
mean1507.000-1645.000=-138.000
σ0.000
min1507.000-1645.000=-138.000
max1507.000-1645.000=-138.000
mean0.837-0.826=0.011
σ0.053-0.038=0.014
min0.743-0.771=-0.027
max0.867-0.857=0.010
name=cdr_enhanced_4k_loc.art
mean885.511-885.513=-0.002
σ0.006-0.008=-0.002
min885.504
max885.518-885.524=-0.006
mean1507.000-1645.000=-138.000
σ0.000
min1507.000-1645.000=-138.000
max1507.000-1645.000=-138.000
mean0.732-0.722=0.010
σ0.011-0.034=-0.024
min0.719-0.676=0.043
max0.743-0.757=-0.014

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.720=0.000
mean1507.000-1645.000=-138.000
σ0.000
min1507.000-1645.000=-138.000
max1507.000-1645.000=-138.000
mean4.251-4.236=0.016
σ0.112-0.087=0.025
min4.075-4.071=0.004
max4.859-4.532=0.327
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1507.000-1645.000=-138.000
σ0.000
min1507.000-1645.000=-138.000
max1507.000-1645.000=-138.000
mean4.195-4.059=0.136
σ0.075-0.320=-0.245
min4.083-3.359=0.724
max4.487-4.423=0.065
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1507.000-1645.000=-138.000
σ0.000
min1507.000-1645.000=-138.000
max1507.000-1645.000=-138.000
mean0.739-0.744=-0.005
σ0.019-0.018=0.002
min0.706-0.705=0.001
max0.861-0.832=0.029
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1507.000-1645.000=-138.000
σ0.000
min1507.000-1645.000=-138.000
max1507.000-1645.000=-138.000
mean0.701-0.703=-0.003
σ0.019-0.015=0.005
min0.669-0.670=-0.002
max0.810-0.794=0.017

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.146-296.389=-0.244
σ0.234-0.259=-0.025
min295.922-296.063=-0.141
max296.772-296.782=-0.010
mean2026.000-2027.000=-1.000
σ0.000
min2026.000-2027.000=-1.000
max2026.000-2027.000=-1.000
mean0.571-0.550=0.021
σ0.036-0.030=0.007
min0.506-0.513=-0.007
max0.606-0.583=0.023

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.023-285.031=-0.007
σ0.029-0.039=-0.010
min284.981-284.982=-0.001
max285.055-285.074=-0.019
mean1507.000-1645.000=-138.000
σ0.000
min1507.000-1645.000=-138.000
max1507.000-1645.000=-138.000
mean0.396-0.403=-0.007
σ0.010-0.008=0.002
min0.386-0.390=-0.004
max0.412-0.411=0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.432-1295.417=0.014
σ0.062-0.111=-0.049
min1295.364-1295.282=0.082
max1295.498-1295.549=-0.052
mean1507.000-1645.000=-138.000
σ0.000
min1507.000-1645.000=-138.000
max1507.000-1645.000=-138.000
mean2.079-1.875=0.204
σ0.098-0.059=0.039
min2.000-1.813=0.188
max2.198-1.952=0.246
iters=5
new-facts=6402
prior-facts=1
mean1539.562-1539.520=0.042
σ6.829-6.864=-0.035
min1536.319-1536.259=0.060
max1551.775-1551.795=-0.020
mean1507.000-1645.000=-138.000
σ0.000
min1507.000-1645.000=-138.000
max1507.000-1645.000=-138.000
mean2.315-2.230=0.084
σ0.261-0.181=0.080
min2.016-2.031=-0.015
max2.679-2.441=0.239
iters=5
new-facts=6402
prior-facts=6402
mean1857.316-1857.327=-0.011
σ0.073-0.049=0.024
min1857.206-1857.274=-0.068
max1857.385-1857.394=-0.009
mean1748.400-1777.800=-29.400
σ208.509-168.073=40.435
min1507.000-1645.000=-138.000
max2026.000-2027.000=-1.000
mean3.006-2.916=0.089
σ0.080-0.133=-0.053
min2.900-2.806=0.094
max3.096-3.130=-0.034

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.685-1.266=0.419
σ0.208-0.281=-0.073
min1.365-1.064=0.301
max1.870-1.676=0.193

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.189-448.191=-0.002
σ581.331-581.332=-0.001
min157.522-157.523=-0.001
max1320.186-1320.188=-0.003
mean96.250
σ8.500
min92.000
max109.000
mean1507.000-1645.000=-138.000
σ0.000
min1507.000-1645.000=-138.000
max1507.000-1645.000=-138.000
mean0.562-0.558=0.005
σ0.595-0.571=0.023
min0.260-0.269=-0.009
max1.455-1.415=0.040
policies=20
mean1575.556-1575.574=-0.017
σ0.362-0.362=0.001
min1575.312-1575.330=-0.018
max1576.095-1576.111=-0.016
mean920.000
σ0.000
min920.000
max920.000
mean1507.000-1645.000=-138.000
σ0.000
min1507.000-1645.000=-138.000
max1507.000-1645.000=-138.000
mean2.640-2.645=-0.005
σ0.013-0.017=-0.004
min2.629-2.621=0.008
max2.659-2.658=0.001
policies=200
mean15763.720-15763.746=-0.026
σ0.140-0.076=0.064
min15763.556-15763.694=-0.138
max15763.896-15763.856=0.040
mean9200.000
σ0.000
min9200.000
max9200.000
mean1507.000-1645.000=-138.000
σ0.000
min1507.000-1645.000=-138.000
max1507.000-1645.000=-138.000
mean26.541-26.574=-0.034
σ0.042-0.032=0.010
min26.507-26.535=-0.028
max26.594-26.609=-0.014