Compare commits

Home / Compare 2c9e2f8c .. fe2f111c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.965-53.967=-0.002
σ0.370-0.368=0.003
min53.824-53.833=-0.008
max55.018-55.014=0.005
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.138-0.151=-0.013
σ0.004-0.013=-0.009
min0.131-0.138=-0.006
max0.144-0.170=-0.026
cache=y
dps=1
iters=10
policies=100
mean43.323-43.328=-0.005
σ0.007-0.007=-0.000
min43.310-43.318=-0.009
max43.336-43.338=-0.003
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.122-0.143=-0.021
σ0.004-0.004=0.000
min0.116-0.140=-0.024
max0.127-0.149=-0.022

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.519-1006.524=-0.005
σ1.153-1.163=-0.010
min1005.948-1005.950=-0.002
max1011.340-1011.379=-0.039
mean1040.750-1034.900=5.850
σ311.050-309.947=1.103
min550.000-545.000=5.000
max1509.000-1501.000=8.000
mean1.514-1.526=-0.013
σ0.047-0.074=-0.027
min1.442-1.452=-0.010
max1.610-1.754=-0.144

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.003=-0.000
min0.882
max0.887-0.887=-0.000
mean1509.000-1501.000=8.000
σ0.000
min1509.000-1501.000=8.000
max1509.000-1501.000=8.000
mean0.438-0.436=0.002
σ0.199-0.131=0.068
min0.325-0.334=-0.009
max0.792-0.661=0.131
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1509.000-1501.000=8.000
σ0.000
min1509.000-1501.000=8.000
max1509.000-1501.000=8.000
mean0.932-0.873=0.059
σ0.177-0.095=0.082
min0.838-0.797=0.042
max1.248-1.035=0.213
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1509.000-1501.000=8.000
σ0.000
min1509.000-1501.000=8.000
max1509.000-1501.000=8.000
mean0.534-0.529=0.005
σ0.044-0.045=-0.001
min0.492-0.494=-0.002
max0.605-0.602=0.002
name=nested_use.art
mean2.361-2.361=-0.000
σ0.002-0.002=0.000
min2.360
max2.364
mean1509.000-1501.000=8.000
σ0.000
min1509.000-1501.000=8.000
max1509.000-1501.000=8.000
mean0.845-0.838=0.007
σ0.044-0.039=0.005
min0.802-0.797=0.005
max0.918-0.903=0.015

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.830-964.826=0.004
σ0.038-0.035=0.003
min964.802
max964.896-964.886=0.010
mean1509.000-1501.000=8.000
σ0.000
min1509.000-1501.000=8.000
max1509.000-1501.000=8.000
mean0.823-0.847=-0.024
σ0.031-0.018=0.013
min0.787-0.815=-0.028
max0.859-0.858=0.001
name=cdr_enhanced_4k_loc.art
mean885.511-885.509=0.001
σ0.006-0.005=0.001
min885.504
max885.517-885.513=0.004
mean1509.000-1501.000=8.000
σ0.000
min1509.000-1501.000=8.000
max1509.000-1501.000=8.000
mean0.711-0.706=0.005
σ0.029-0.039=-0.010
min0.668-0.639=0.029
max0.746-0.734=0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719
mean1509.000-1501.000=8.000
σ0.000
min1509.000-1501.000=8.000
max1509.000-1501.000=8.000
mean3.868-4.233=-0.365
σ0.361-0.108=0.253
min3.412-4.107=-0.695
max4.474-4.923=-0.449
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1509.000-1501.000=8.000
σ0.000
min1509.000-1501.000=8.000
max1509.000-1501.000=8.000
mean4.253-4.237=0.016
σ0.113-0.086=0.027
min4.086-4.083=0.004
max4.968-4.565=0.404
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1509.000-1501.000=8.000
σ0.000
min1509.000-1501.000=8.000
max1509.000-1501.000=8.000
mean0.675-0.746=-0.071
σ0.103-0.019=0.084
min0.511-0.712=-0.201
max0.868-0.865=0.003
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1509.000-1501.000=8.000
σ0.000
min1509.000-1501.000=8.000
max1509.000-1501.000=8.000
mean0.511-0.704=-0.193
σ0.040-0.015=0.025
min0.476-0.674=-0.197
max0.762-0.767=-0.005

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.308-296.507=-0.199
σ0.236-0.202=0.034
min296.148-296.337=-0.189
max296.966-297.035=-0.069
mean2032.000-2024.000=8.000
σ0.000
min2032.000-2024.000=8.000
max2032.000-2024.000=8.000
mean0.556-0.561=-0.006
σ0.031-0.036=-0.005
min0.514-0.506=0.008
max0.584-0.597=-0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.024-285.026=-0.002
σ0.035-0.038=-0.002
min284.979-284.971=0.008
max285.061-285.064=-0.003
mean1509.000-1501.000=8.000
σ0.000
min1509.000-1501.000=8.000
max1509.000-1501.000=8.000
mean0.398-0.395=0.003
σ0.006-0.006=0.000
min0.391-0.390=0.001
max0.407-0.405=0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.413-1295.428=-0.015
σ0.116-0.076=0.040
min1295.298-1295.357=-0.060
max1295.558-1295.514=0.044
mean1509.000-1501.000=8.000
σ0.000
min1509.000-1501.000=8.000
max1509.000-1501.000=8.000
mean1.921-2.077=-0.156
σ0.120-0.084=0.036
min1.806-2.002=-0.197
max2.070-2.198=-0.128
iters=5
new-facts=6402
prior-facts=1
mean1539.525-1539.563=-0.039
σ6.844-6.812=0.032
min1536.191-1536.361=-0.171
max1551.761-1551.746=0.015
mean1509.000-1501.000=8.000
σ0.000
min1509.000-1501.000=8.000
max1509.000-1501.000=8.000
mean2.289-2.324=-0.035
σ0.296-0.234=0.062
min1.898-2.138=-0.240
max2.585-2.711=-0.126
iters=5
new-facts=6402
prior-facts=6402
mean1857.309-1857.318=-0.009
σ0.062-0.070=-0.008
min1857.253-1857.210=0.043
max1857.390-1857.389=0.000
mean1738.000-1731.000=7.000
σ215.485-215.731=-0.246
min1509.000-1501.000=8.000
max2032.000-2024.000=8.000
mean2.860-2.878=-0.019
σ0.095-0.158=-0.063
min2.722-2.648=0.074
max2.954-3.060=-0.105

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.615-1.680=-0.064
σ0.292-0.137=0.155
min1.257-1.455=-0.198
max1.907-1.802=0.105

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.192-448.190=0.002
σ581.331-581.331=0.000
min157.525-157.523=0.002
max1320.188-1320.186=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1509.000-1501.000=8.000
σ0.000
min1509.000-1501.000=8.000
max1509.000-1501.000=8.000
mean0.552-0.553=-0.001
σ0.558-0.575=-0.017
min0.268-0.262=0.006
max1.389-1.415=-0.027
policies=20
mean1575.562-1575.556=0.006
σ0.345-0.354=-0.008
min1575.333-1575.315=0.018
max1576.076-1576.081=-0.005
mean920.000
σ0.000
min920.000
max920.000
mean1509.000-1501.000=8.000
σ0.000
min1509.000-1501.000=8.000
max1509.000-1501.000=8.000
mean2.633-2.631=0.002
σ0.014-0.017=-0.003
min2.619-2.614=0.005
max2.653-2.650=0.003
policies=200
mean15763.676-15763.561=0.114
σ0.174-0.204=-0.030
min15763.514-15763.282=0.232
max15763.917-15763.715=0.202
mean9200.000
σ0.000
min9200.000
max9200.000
mean1509.000-1501.000=8.000
σ0.000
min1509.000-1501.000=8.000
max1509.000-1501.000=8.000
mean26.546-26.494=0.052
σ0.020-0.117=-0.097
min26.527-26.383=0.144
max26.572-26.640=-0.069