Compare commits

Home / Compare 3fbe49fa .. b4fe94c3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.055=0.000
σ0.368-0.367=0.001
min53.910-53.909=0.001
max55.102-55.099=0.003
mean415.000
σ0.000
min415.000
max415.000
mean0.137-0.140=-0.003
σ0.004-0.004=0.001
min0.131-0.136=-0.005
max0.144-0.146=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.395-43.395=-0.000
σ0.007-0.007=-0.000
min43.386-43.384=0.002
max43.405-43.404=0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.122-0.123=-0.001
σ0.004-0.004=0.000
min0.119-0.119=-0.000
max0.129-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.959-1006.959=-0.000
σ0.876-0.882=-0.006
min1006.493-1006.492=0.001
max1010.586-1010.620=-0.034
mean1053.900-1036.350=17.550
σ316.477-301.221=15.256
min547.000-546.000=1.000
max1634.000-1583.000=51.000
mean1.533-1.523=0.009
σ0.082-0.094=-0.012
min1.452-1.351=0.101
max1.799-1.758=0.041

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.001
σ0.002-0.003=-0.000
min0.882
max0.887
mean1634.000-1583.000=51.000
σ0.000
min1634.000-1583.000=51.000
max1634.000-1583.000=51.000
mean0.421-0.442=-0.021
σ0.128-0.186=-0.058
min0.351-0.331=0.019
max0.649-0.773=-0.124
name=error_case.art
mean2.339-2.339=0.001
σ0.003-0.003=-0.000
min2.337
max2.342
mean1634.000-1583.000=51.000
σ0.000
min1634.000-1583.000=51.000
max1634.000-1583.000=51.000
mean0.894-0.903=-0.008
σ0.098-0.167=-0.069
min0.822-0.808=0.014
max1.065-1.198=-0.133
name=heavy_item.art
mean1.523-1.524=-0.001
σ0.001-0.002=-0.001
min1.522
max1.525-1.526=-0.001
mean1634.000-1583.000=51.000
σ0.000
min1634.000-1583.000=51.000
max1634.000-1583.000=51.000
mean0.538-0.528=0.010
σ0.053-0.054=-0.001
min0.499-0.484=0.015
max0.626-0.619=0.006
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=0.000
min2.360
max2.364
mean1634.000-1583.000=51.000
σ0.000
min1634.000-1583.000=51.000
max1634.000-1583.000=51.000
mean0.856-0.840=0.016
σ0.036-0.034=0.002
min0.831-0.805=0.026
max0.919-0.897=0.023

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=0.000
σ0.021-0.032=-0.011
min964.814-964.815=-0.000
max964.871-964.895=-0.024
mean1634.000-1583.000=51.000
σ0.000
min1634.000-1583.000=51.000
max1634.000-1583.000=51.000
mean0.839-0.807=0.032
σ0.023-0.055=-0.032
min0.799-0.747=0.052
max0.859-0.867=-0.008
name=cdr_enhanced_4k_loc.art
mean885.513-885.512=0.001
σ0.008-0.006=0.001
min885.505-885.504=0.001
max885.523-885.520=0.004
mean1634.000-1583.000=51.000
σ0.000
min1634.000-1583.000=51.000
max1634.000-1583.000=51.000
mean0.737-0.719=0.018
σ0.004-0.035=-0.031
min0.732-0.669=0.062
max0.742-0.745=-0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.722=0.000
mean1634.000-1583.000=51.000
σ0.000
min1634.000-1583.000=51.000
max1634.000-1583.000=51.000
mean4.258-4.257=0.001
σ0.131-0.072=0.059
min4.122-4.120=0.002
max5.141-4.491=0.650
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1634.000-1583.000=51.000
σ0.000
min1634.000-1583.000=51.000
max1634.000-1583.000=51.000
mean4.266-4.250=0.016
σ0.079-0.065=0.014
min4.130-4.131=-0.001
max4.574-4.473=0.101
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1634.000-1583.000=51.000
σ0.000
min1634.000-1583.000=51.000
max1634.000-1583.000=51.000
mean0.746-0.754=-0.008
σ0.025-0.019=0.006
min0.563-0.716=-0.154
max0.864-0.873=-0.010
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1634.000-1583.000=51.000
σ0.000
min1634.000-1583.000=51.000
max1634.000-1583.000=51.000
mean0.710-0.712=-0.002
σ0.028-0.015=0.013
min0.562-0.681=-0.119
max0.808-0.795=0.013

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.376-295.541=-0.164
σ0.251-0.251=-0.001
min295.208-295.316=-0.108
max296.071-296.229=-0.157
mean1897.000-1922.000=-25.000
σ0.000
min1897.000-1922.000=-25.000
max1897.000-1922.000=-25.000
mean0.552-0.577=-0.026
σ0.042-0.053=-0.010
min0.506-0.508=-0.001
max0.620-0.689=-0.069

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.396-285.394=0.003
σ0.033-0.037=-0.003
min285.353-285.349=0.004
max285.429-285.430=-0.001
mean1634.000-1583.000=51.000
σ0.000
min1634.000-1583.000=51.000
max1634.000-1583.000=51.000
mean0.388-0.388=-0.000
σ0.006-0.005=0.001
min0.383-0.384=-0.001
max0.395-0.396=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.777-1295.748=0.030
σ0.107-0.110=-0.003
min1295.661-1295.663=-0.002
max1295.910-1295.930=-0.020
mean1634.000-1583.000=51.000
σ0.000
min1634.000-1583.000=51.000
max1634.000-1583.000=51.000
mean1.921-1.965=-0.044
σ0.087-0.218=-0.131
min1.822-1.707=0.116
max2.010-2.263=-0.253
iters=5
new-facts=6402
prior-facts=1
mean1539.985-1539.945=0.040
σ6.806-6.826=-0.020
min1536.768-1536.743=0.025
max1552.157-1552.153=0.004
mean1634.000-1583.000=51.000
σ0.000
min1634.000-1583.000=51.000
max1634.000-1583.000=51.000
mean2.441-2.272=0.169
σ0.287-0.211=0.076
min2.116-2.091=0.025
max2.830-2.619=0.211
iters=5
new-facts=6402
prior-facts=6402
mean1857.693-1857.690=0.003
σ0.054-0.056=-0.002
min1857.642-1857.641=0.001
max1857.771-1857.772=-0.000
mean1765.400-1770.200=-4.800
σ126.859-156.066=-29.207
min1634.000-1583.000=51.000
max1897.000-1922.000=-25.000
mean3.115-3.072=0.044
σ0.368-0.305=0.063
min2.865-2.823=0.042
max3.762-3.592=0.170

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.182-1.282=-0.101
σ0.237-0.290=-0.053
min0.944-1.022=-0.078
max1.559-1.758=-0.199

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.707-445.708=-0.000
σ580.934-580.933=0.001
min155.239-155.239=-0.001
max1317.108-1317.108=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1634.000-1583.000=51.000
σ0.000
min1634.000-1583.000=51.000
max1634.000-1583.000=51.000
mean0.541-0.544=-0.002
σ0.561-0.566=-0.004
min0.260-0.260=-0.000
max1.383-1.392=-0.009
policies=20
mean1552.662-1552.662=-0.000
σ0.335-0.334=0.001
min1552.434-1552.434=0.001
max1553.160-1553.158=0.002
mean920.000
σ0.000
min920.000
max920.000
mean1634.000-1583.000=51.000
σ0.000
min1634.000-1583.000=51.000
max1634.000-1583.000=51.000
mean2.601-2.599=0.002
σ0.033-0.011=0.022
min2.571-2.588=-0.017
max2.647-2.613=0.034
policies=200
mean15534.707-15534.684=0.023
σ0.052-0.051=0.001
min15534.647-15534.619=0.028
max15534.773-15534.736=0.037
mean9200.000
σ0.000
min9200.000
max9200.000
mean1634.000-1583.000=51.000
σ0.000
min1634.000-1583.000=51.000
max1634.000-1583.000=51.000
mean26.217-26.237=-0.020
σ0.179-0.094=0.085
min26.108-26.145=-0.037
max26.483-26.369=0.114