Compare commits

Home / Compare beb0b48a .. 851fdc57

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.056=-0.000
σ0.368-0.371=-0.002
min53.917-53.913=0.004
max55.104-55.111=-0.007
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.137-0.137=0.000
σ0.004-0.005=-0.001
min0.131-0.130=0.001
max0.147-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean43.394-43.395=-0.001
σ0.006-0.007=-0.000
min43.384-43.385=-0.001
max43.402-43.405=-0.004
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.121-0.119=0.002
σ0.004-0.005=-0.000
min0.115-0.113=0.001
max0.128-0.126=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.963-1006.959=0.004
σ0.867-0.868=-0.000
min1006.492-1006.464=0.028
max1010.554-1010.553=0.001
mean1054.600-1055.700=-1.100
σ320.001-316.342=3.659
min578.000-566.000=12.000
max1622.000-1620.000=2.000
mean1.563-1.532=0.031
σ0.125-0.050=0.075
min1.476-1.448=0.029
max2.070-1.624=0.446

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1622.000-1620.000=2.000
σ0.000
min1622.000-1620.000=2.000
max1622.000-1620.000=2.000
mean0.411-0.415=-0.004
σ0.131-0.130=0.002
min0.344-0.336=0.009
max0.646-0.644=0.002
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1622.000-1620.000=2.000
σ0.000
min1622.000-1620.000=2.000
max1622.000-1620.000=2.000
mean0.880-0.888=-0.007
σ0.098-0.103=-0.006
min0.819-0.832=-0.013
max1.053-1.072=-0.019
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1622.000-1620.000=2.000
σ0.000
min1622.000-1620.000=2.000
max1622.000-1620.000=2.000
mean0.539-0.537=0.003
σ0.050-0.048=0.001
min0.487-0.500=-0.013
max0.619-0.617=0.002
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.002=0.000
min2.360
max2.364
mean1622.000-1620.000=2.000
σ0.000
min1622.000-1620.000=2.000
max1622.000-1620.000=2.000
mean0.842-0.846=-0.005
σ0.035-0.038=-0.003
min0.800-0.819=-0.019
max0.896-0.912=-0.016

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.837=0.002
σ0.034-0.035=-0.001
min964.812-964.811=0.000
max964.896-964.897=-0.002
mean1622.000-1620.000=2.000
σ0.000
min1622.000-1620.000=2.000
max1622.000-1620.000=2.000
mean0.786-0.848=-0.062
σ0.070-0.021=0.050
min0.718-0.814=-0.095
max0.862-0.866=-0.005
name=cdr_enhanced_4k_loc.art
mean885.511-885.512=-0.001
σ0.007-0.004=0.003
min885.506-885.505=0.000
max885.522-885.516=0.006
mean1622.000-1620.000=2.000
σ0.000
min1622.000-1620.000=2.000
max1622.000-1620.000=2.000
mean0.728-0.736=-0.008
σ0.032-0.010=0.023
min0.671-0.719=-0.048
max0.746-0.743=0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.721=0.000
mean1622.000-1620.000=2.000
σ0.000
min1622.000-1620.000=2.000
max1622.000-1620.000=2.000
mean4.227-3.517=0.710
σ0.080-0.104=-0.024
min4.096-3.388=0.708
max4.567-4.156=0.411
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1622.000-1620.000=2.000
σ0.000
min1622.000-1620.000=2.000
max1622.000-1620.000=2.000
mean4.252-3.486=0.767
σ0.090-0.078=0.012
min4.107-3.365=0.742
max4.572-3.790=0.781
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1622.000-1620.000=2.000
σ0.000
min1622.000-1620.000=2.000
max1622.000-1620.000=2.000
mean0.741-0.741=-0.000
σ0.018-0.017=0.001
min0.715-0.713=0.002
max0.855-0.844=0.011
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1622.000-1620.000=2.000
σ0.000
min1622.000-1620.000=2.000
max1622.000-1620.000=2.000
mean0.672-0.694=-0.022
σ0.073-0.041=0.033
min0.486-0.512=-0.026
max0.847-0.791=0.056

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.497-295.555=-0.058
σ0.247-0.236=0.010
min295.239-295.353=-0.115
max296.083-296.195=-0.112
mean1923.000-1893.000=30.000
σ0.000
min1923.000-1893.000=30.000
max1923.000-1893.000=30.000
mean0.609-0.561=0.047
σ0.033-0.048=-0.015
min0.564-0.499=0.065
max0.691-0.643=0.047

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.397-285.394=0.002
σ0.038-0.036=0.003
min285.347-285.353=-0.006
max285.439-285.438=0.002
mean1622.000-1620.000=2.000
σ0.000
min1622.000-1620.000=2.000
max1622.000-1620.000=2.000
mean0.387-0.387=0.000
σ0.006-0.006=0.000
min0.380-0.381=-0.001
max0.394-0.395=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.776-1295.777=-0.001
σ0.114-0.112=0.002
min1295.654-1295.659=-0.005
max1295.919-1295.915=0.005
mean1622.000-1620.000=2.000
σ0.000
min1622.000-1620.000=2.000
max1622.000-1620.000=2.000
mean1.888-1.891=-0.003
σ0.076-0.088=-0.012
min1.820-1.804=0.016
max2.011-1.986=0.024
iters=5
new-facts=6402
prior-facts=1
mean1538.692-1538.641=0.051
σ3.957-4.005=-0.048
min1536.736-1536.636=0.100
max1545.762-1545.798=-0.035
mean1622.000-1620.000=2.000
σ0.000
min1622.000-1620.000=2.000
max1622.000-1620.000=2.000
mean2.392-2.323=0.069
σ0.298-0.237=0.060
min2.126-2.051=0.075
max2.888-2.652=0.236
iters=5
new-facts=6402
prior-facts=6402
mean1857.686-1857.683=0.003
σ0.063-0.067=-0.004
min1857.612-1857.601=0.011
max1857.768-1857.772=-0.004
mean1779.800-1767.800=12.000
σ144.778-128.237=16.541
min1622.000-1620.000=2.000
max1923.000-1893.000=30.000
mean3.135-2.953=0.182
σ0.317-0.124=0.193
min2.862-2.839=0.023
max3.679-3.134=0.545

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.238-1.295=-0.057
σ0.373-0.312=0.061
min0.939-1.070=-0.131
max1.802-1.833=-0.030

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.028-444.027=0.001
σ577.575-577.575=0.000
min155.239-155.238=0.001
max1310.390-1310.389=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1622.000-1620.000=2.000
σ0.000
min1622.000-1620.000=2.000
max1622.000-1620.000=2.000
mean0.547-0.550=-0.003
σ0.562-0.569=-0.007
min0.265-0.256=0.008
max1.391-1.404=-0.013
policies=20
mean1552.659-1552.662=-0.003
σ0.330-0.344=-0.014
min1552.433-1552.427=0.006
max1553.148-1553.173=-0.025
mean920.000
σ0.000
min920.000
max920.000
mean1622.000-1620.000=2.000
σ0.000
min1622.000-1620.000=2.000
max1622.000-1620.000=2.000
mean2.590-2.604=-0.014
σ0.021-0.011=0.010
min2.568-2.590=-0.022
max2.619-2.613=0.006
policies=200
mean15534.661-15534.616=0.045
σ0.050-0.170=-0.121
min15534.615-15534.466=0.149
max15534.712-15534.850=-0.138
mean9200.000
σ0.000
min9200.000
max9200.000
mean1622.000-1620.000=2.000
σ0.000
min1622.000-1620.000=2.000
max1622.000-1620.000=2.000
mean26.106-26.231=-0.125
σ0.132-0.195=-0.063
min25.945-26.049=-0.104
max26.268-26.455=-0.187