Compare commits

Home / Compare d8b499de .. 7121d3a4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.046-54.055=-0.009
σ0.369-0.368=0.001
min53.892-53.916=-0.023
max55.096-55.103=-0.007
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.139-0.139=-0.000
σ0.004-0.004=-0.001
min0.135-0.135=0.000
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.385-43.393=-0.008
σ0.004-0.007=-0.003
min43.380-43.385=-0.005
max43.392-43.406=-0.014
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.121-0.122=-0.001
σ0.004-0.003=0.001
min0.114-0.119=-0.005
max0.130-0.128=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.984=-0.004
σ0.868-0.855=0.013
min1006.480-1006.483=-0.003
max1010.569-1010.507=0.062
mean1047.100-1047.200=-0.100
σ315.079-314.016=1.063
min577.000
max1650.000-1645.000=5.000
mean1.557-1.534=0.023
σ0.062-0.082=-0.020
min1.500-1.404=0.096
max1.727-1.798=-0.071

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.000
σ0.003-0.002=0.000
min0.882
max0.887
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.437-0.430=0.006
σ0.191-0.144=0.047
min0.332-0.326=0.006
max0.777-0.684=0.093
name=error_case.art
mean2.339-2.340=-0.002
σ0.003-0.003=-0.000
min2.337
max2.342-2.343=-0.001
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.906-0.887=0.019
σ0.153-0.091=0.061
min0.822-0.812=0.010
max1.178-1.046=0.132
name=heavy_item.art
mean1.524-1.524=0.000
σ0.002-0.001=0.001
min1.522
max1.526-1.525=0.001
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.535-0.545=-0.010
σ0.050-0.054=-0.005
min0.497-0.496=0.001
max0.616-0.632=-0.017
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.002=-0.000
min2.360
max2.364
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.839-0.865=-0.026
σ0.036-0.033=0.003
min0.803-0.843=-0.040
max0.896-0.924=-0.028

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.832=-0.001
σ0.025-0.028=-0.003
min964.802-964.810=-0.008
max964.861-964.876=-0.014
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.823-0.808=0.014
σ0.031-0.048=-0.017
min0.786-0.748=0.038
max0.856-0.864=-0.008
name=cdr_enhanced_4k_loc.art
mean885.513-885.514=-0.001
σ0.005-0.007=-0.001
min885.504
max885.516-885.520=-0.004
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.701-0.686=0.015
σ0.037-0.057=-0.020
min0.643-0.608=0.035
max0.743-0.758=-0.015

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean3.480-4.233=-0.752
σ0.105-0.099=0.006
min3.327-4.098=-0.771
max4.158-4.633=-0.475
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean3.779-4.236=-0.458
σ0.355-0.077=0.277
min3.310-4.113=-0.803
max4.323-4.536=-0.213
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.733-0.747=-0.014
σ0.019-0.019=0.000
min0.697-0.685=0.012
max0.849-0.851=-0.002
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.693-0.706=-0.012
σ0.027-0.016=0.011
min0.521-0.635=-0.113
max0.793-0.764=0.028

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.693-295.627=0.066
σ0.248-0.258=-0.010
min295.425-295.377=0.048
max296.351-296.311=0.039
mean1888.000-1913.000=-25.000
σ0.000
min1888.000-1913.000=-25.000
max1888.000-1913.000=-25.000
mean0.565-0.575=-0.010
σ0.045-0.053=-0.008
min0.497-0.513=-0.016
max0.614-0.694=-0.080

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.405-285.406=-0.001
σ0.041-0.032=0.009
min285.360-285.365=-0.005
max285.452-285.441=0.011
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.384-0.391=-0.007
σ0.005-0.009=-0.004
min0.378-0.381=-0.002
max0.391-0.401=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1295.794-1295.795=-0.001
σ0.104-0.114=-0.010
min1295.681-1295.666=0.015
max1295.923-1295.947=-0.023
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean1.923-1.978=-0.055
σ0.102-0.124=-0.022
min1.810-1.843=-0.033
max2.034-2.132=-0.098
iters=5
new-facts=6402
prior-facts=1
mean1539.916-1539.936=-0.020
σ6.854-6.890=-0.036
min1536.648-1536.634=0.014
max1552.173-1552.255=-0.083
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean2.231-2.345=-0.114
σ0.301-0.207=0.094
min1.930-2.102=-0.171
max2.685-2.618=0.066
iters=5
new-facts=6402
prior-facts=6402
mean1857.709-1857.705=0.004
σ0.054-0.059=-0.005
min1857.648-1857.642=0.005
max1857.778-1857.785=-0.008
mean1771.000-1772.800=-1.800
σ118.030-134.715=-16.686
min1650.000-1645.000=5.000
max1888.000-1913.000=-25.000
mean2.995-2.971=0.024
σ0.101-0.212=-0.111
min2.860-2.677=0.183
max3.101-3.277=-0.176

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.422-1.344=0.077
σ0.290-0.221=0.069
min1.110-1.107=0.004
max1.815-1.702=0.112

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.741=-0.001
σ580.934-580.934=-0.000
min155.272-155.272=-0.000
max1317.141-1317.142=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.525-0.534=-0.009
σ0.538-0.549=-0.012
min0.256-0.255=0.001
max1.332-1.358=-0.027
policies=20
mean1552.978-1552.990=-0.012
σ0.321-0.328=-0.007
min1552.755-1552.767=-0.012
max1553.455-1553.478=-0.023
mean920.000
σ0.000
min920.000
max920.000
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean2.579-2.590=-0.011
σ0.043-0.024=0.019
min2.551-2.569=-0.018
max2.641-2.620=0.021
policies=200
mean15537.863-15537.931=-0.068
σ0.133-0.082=0.051
min15537.773-15537.839=-0.067
max15538.060-15538.012=0.049
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean26.074-26.122=-0.048
σ0.075-0.106=-0.031
min25.963-26.029=-0.066
max26.122-26.272=-0.150