Compare commits

Home / Compare f49e32d6 .. 69481857

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.046-54.056=-0.010
σ0.369-0.367=0.003
min53.892-53.919=-0.026
max55.096-55.098=-0.002
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.139-0.139=-0.000
σ0.004-0.004=-0.000
min0.135-0.136=-0.001
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.385-43.393=-0.008
σ0.004-0.005=-0.002
min43.380-43.388=-0.008
max43.392-43.403=-0.012
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.121-0.120=0.001
σ0.004-0.005=-0.001
min0.114-0.113=0.001
max0.130-0.127=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.981=-0.001
σ0.868-0.885=-0.017
min1006.480-1006.507=-0.027
max1010.569-1010.648=-0.079
mean1047.100-1049.350=-2.250
σ315.079-319.930=-4.851
min577.000-574.000=3.000
max1650.000-1617.000=33.000
mean1.557-1.565=-0.008
σ0.062-0.099=-0.037
min1.500-1.469=0.031
max1.727-1.867=-0.140

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1650.000-1617.000=33.000
σ0.000
min1650.000-1617.000=33.000
max1650.000-1617.000=33.000
mean0.437-0.421=0.015
σ0.191-0.146=0.045
min0.332-0.339=-0.007
max0.777-0.681=0.096
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1650.000-1617.000=33.000
σ0.000
min1650.000-1617.000=33.000
max1650.000-1617.000=33.000
mean0.906-0.881=0.025
σ0.153-0.091=0.061
min0.822-0.822=-0.000
max1.178-1.042=0.136
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1650.000-1617.000=33.000
σ0.000
min1650.000-1617.000=33.000
max1650.000-1617.000=33.000
mean0.535-0.538=-0.003
σ0.050-0.047=0.003
min0.497-0.500=-0.003
max0.616-0.619=-0.003
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1650.000-1617.000=33.000
σ0.000
min1650.000-1617.000=33.000
max1650.000-1617.000=33.000
mean0.839-0.856=-0.017
σ0.036-0.042=-0.006
min0.803-0.823=-0.020
max0.896-0.928=-0.033

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.835=-0.004
σ0.025-0.031=-0.007
min964.802-964.805=-0.003
max964.861-964.888=-0.027
mean1650.000-1617.000=33.000
σ0.000
min1650.000-1617.000=33.000
max1650.000-1617.000=33.000
mean0.823-0.828=-0.005
σ0.031-0.016=0.015
min0.786-0.805=-0.020
max0.856-0.852=0.004
name=cdr_enhanced_4k_loc.art
mean885.513-885.513=-0.000
σ0.005-0.005=-0.000
min885.504
max885.516-885.517=-0.001
mean1650.000-1617.000=33.000
σ0.000
min1650.000-1617.000=33.000
max1650.000-1617.000=33.000
mean0.701-0.698=0.003
σ0.037-0.040=-0.003
min0.643-0.661=-0.018
max0.743-0.742=0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.720=0.000
mean1650.000-1617.000=33.000
σ0.000
min1650.000-1617.000=33.000
max1650.000-1617.000=33.000
mean3.480-3.529=-0.049
σ0.105-0.081=0.023
min3.327-3.402=-0.075
max4.158-3.864=0.294
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.670=-0.003
mean1650.000-1617.000=33.000
σ0.000
min1650.000-1617.000=33.000
max1650.000-1617.000=33.000
mean3.779-3.481=0.297
σ0.355-0.133=0.222
min3.310-3.249=0.060
max4.323-4.239=0.084
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1650.000-1617.000=33.000
σ0.000
min1650.000-1617.000=33.000
max1650.000-1617.000=33.000
mean0.733-0.738=-0.005
σ0.019-0.019=-0.000
min0.697-0.698=-0.001
max0.849-0.863=-0.014
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1650.000-1617.000=33.000
σ0.000
min1650.000-1617.000=33.000
max1650.000-1617.000=33.000
mean0.693-0.697=-0.004
σ0.027-0.015=0.012
min0.521-0.672=-0.151
max0.793-0.776=0.017

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.693-295.569=0.124
σ0.248-0.200=0.048
min295.425-295.416=0.009
max296.351-296.079=0.272
mean1888.000-1895.000=-7.000
σ0.000
min1888.000-1895.000=-7.000
max1888.000-1895.000=-7.000
mean0.565-0.570=-0.005
σ0.045-0.036=0.009
min0.497-0.496=0.001
max0.614-0.622=-0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.405-285.410=-0.005
σ0.041-0.034=0.007
min285.360-285.364=-0.005
max285.452-285.446=0.006
mean1650.000-1617.000=33.000
σ0.000
min1650.000-1617.000=33.000
max1650.000-1617.000=33.000
mean0.384-0.391=-0.007
σ0.005-0.011=-0.006
min0.378-0.382=-0.004
max0.391-0.406=-0.015
iters=5
new-facts=1
prior-facts=6402
mean1295.794-1295.797=-0.003
σ0.104-0.111=-0.007
min1295.681-1295.677=0.004
max1295.923-1295.934=-0.011
mean1650.000-1617.000=33.000
σ0.000
min1650.000-1617.000=33.000
max1650.000-1617.000=33.000
mean1.923-1.931=-0.008
σ0.102-0.114=-0.012
min1.810-1.794=0.016
max2.034-2.025=0.009
iters=5
new-facts=6402
prior-facts=1
mean1539.916-1539.922=-0.006
σ6.854-6.902=-0.049
min1536.648-1536.602=0.046
max1552.173-1552.263=-0.091
mean1650.000-1617.000=33.000
σ0.000
min1650.000-1617.000=33.000
max1650.000-1617.000=33.000
mean2.231-2.332=-0.100
σ0.301-0.275=0.026
min1.930-2.028=-0.098
max2.685-2.693=-0.009
iters=5
new-facts=6402
prior-facts=6402
mean1857.709-1857.702=0.007
σ0.054-0.051=0.003
min1857.648-1857.661=-0.013
max1857.778-1857.774=0.004
mean1771.000-1760.800=10.200
σ118.030-131.134=-13.105
min1650.000-1617.000=33.000
max1888.000-1895.000=-7.000
mean2.995-3.101=-0.106
σ0.101-0.348=-0.246
min2.860-2.888=-0.029
max3.101-3.719=-0.618

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.422-1.322=0.100
σ0.290-0.248=0.042
min1.110-1.103=0.008
max1.815-1.699=0.116

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.740=0.000
σ580.934-580.934=-0.000
min155.272-155.272=0.001
max1317.141-1317.141=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1650.000-1617.000=33.000
σ0.000
min1650.000-1617.000=33.000
max1650.000-1617.000=33.000
mean0.525-0.548=-0.023
σ0.538-0.584=-0.046
min0.256-0.256=0.000
max1.332-1.424=-0.092
policies=20
mean1552.978-1552.966=0.012
σ0.321-0.307=0.014
min1552.755-1552.757=-0.002
max1553.455-1553.423=0.032
mean920.000
σ0.000
min920.000
max920.000
mean1650.000-1617.000=33.000
σ0.000
min1650.000-1617.000=33.000
max1650.000-1617.000=33.000
mean2.579-2.566=0.012
σ0.043-0.017=0.026
min2.551-2.548=0.002
max2.641-2.586=0.056
policies=200
mean15537.863-15537.881=-0.017
σ0.133-0.098=0.035
min15537.773-15537.743=0.030
max15538.060-15537.957=0.103
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000-1617.000=33.000
σ0.000
min1650.000-1617.000=33.000
max1650.000-1617.000=33.000
mean26.074-26.147=-0.073
σ0.075-0.275=-0.201
min25.963-25.844=0.119
max26.122-26.485=-0.362