Compare commits

Home / Compare 2e816ecf .. ffc6f78d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.053=0.001
σ0.369-0.371=-0.002
min53.908-53.905=0.003
max55.103-55.108=-0.006
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.138-0.138=0.000
σ0.004-0.005=-0.002
min0.132-0.130=0.002
max0.145-0.146=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.394-43.399=-0.005
σ0.006-0.007=-0.001
min43.386-43.390=-0.004
max43.402-43.415=-0.013
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.120-0.142=-0.022
σ0.004-0.004=-0.001
min0.115-0.135=-0.020
max0.126-0.150=-0.023

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1007.005=-0.026
σ0.925-1.203=-0.278
min1006.507-1006.432=0.075
max1010.827-1012.051=-1.224
mean1055.650-1052.500=3.150
σ306.148-307.895=-1.747
min576.000-577.000=-1.000
max1457.000-1644.000=-187.000
mean1.568-1.539=0.029
σ0.135-0.076=0.059
min1.469-1.461=0.008
max2.021-1.766=0.255

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1457.000-1644.000=-187.000
σ0.000
min1457.000-1644.000=-187.000
max1457.000-1644.000=-187.000
mean0.441-0.420=0.021
σ0.126-0.126=0.000
min0.352-0.350=0.002
max0.659-0.644=0.015
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1457.000-1644.000=-187.000
σ0.000
min1457.000-1644.000=-187.000
max1457.000-1644.000=-187.000
mean0.886-0.880=0.006
σ0.097-0.089=0.008
min0.826-0.819=0.006
max1.058-1.038=0.020
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1457.000-1644.000=-187.000
σ0.000
min1457.000-1644.000=-187.000
max1457.000-1644.000=-187.000
mean0.532-0.539=-0.007
σ0.051-0.057=-0.006
min0.482-0.503=-0.021
max0.616-0.640=-0.024
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1457.000-1644.000=-187.000
σ0.000
min1457.000-1644.000=-187.000
max1457.000-1644.000=-187.000
mean0.843-0.838=0.006
σ0.040-0.040=0.000
min0.816-0.811=0.005
max0.911-0.907=0.004

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.822-964.839=-0.016
σ0.026-0.032=-0.007
min964.802-964.811=-0.009
max964.864-964.894=-0.030
mean1457.000-1644.000=-187.000
σ0.000
min1457.000-1644.000=-187.000
max1457.000-1644.000=-187.000
mean0.829-0.832=-0.002
σ0.032-0.018=0.014
min0.795-0.809=-0.014
max0.865-0.847=0.017
name=cdr_enhanced_4k_loc.art
mean885.511-885.512=-0.002
σ0.006-0.007=-0.001
min885.504
max885.518-885.522=-0.004
mean1457.000-1644.000=-187.000
σ0.000
min1457.000-1644.000=-187.000
max1457.000-1644.000=-187.000
mean0.736-0.703=0.033
σ0.008-0.046=-0.038
min0.723-0.625=0.098
max0.745-0.735=0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.001
mean1457.000-1644.000=-187.000
σ0.000
min1457.000-1644.000=-187.000
max1457.000-1644.000=-187.000
mean3.535-4.252=-0.716
σ0.084-0.092=-0.008
min3.395-4.128=-0.733
max3.894-4.655=-0.761
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1457.000-1644.000=-187.000
σ0.000
min1457.000-1644.000=-187.000
max1457.000-1644.000=-187.000
mean3.523-4.222=-0.698
σ0.064-0.061=0.003
min3.386-4.115=-0.729
max3.734-4.441=-0.708
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1457.000-1644.000=-187.000
σ0.000
min1457.000-1644.000=-187.000
max1457.000-1644.000=-187.000
mean0.540-0.751=-0.211
σ0.015-0.022=-0.006
min0.520-0.706=-0.186
max0.638-0.878=-0.240
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1457.000-1644.000=-187.000
σ0.000
min1457.000-1644.000=-187.000
max1457.000-1644.000=-187.000
mean0.506-0.708=-0.202
σ0.016-0.015=0.001
min0.475-0.675=-0.200
max0.569-0.786=-0.217

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.628-297.110=-1.482
σ0.285-0.205=0.080
min295.466-296.965=-1.498
max296.421-297.669=-1.248
mean1905.000-2033.000=-128.000
σ0.000
min1905.000-2033.000=-128.000
max1905.000-2033.000=-128.000
mean0.583-0.559=0.024
σ0.046-0.034=0.013
min0.500-0.506=-0.006
max0.645-0.591=0.054

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.398-286.827=-1.429
σ0.030-0.040=-0.009
min285.360-286.773=-1.413
max285.431-286.866=-1.435
mean1457.000-1644.000=-187.000
σ0.000
min1457.000-1644.000=-187.000
max1457.000-1644.000=-187.000
mean0.403-0.396=0.007
σ0.005-0.006=-0.001
min0.396-0.389=0.007
max0.410-0.402=0.008
iters=5
new-facts=1
prior-facts=6402
mean1295.765-1297.239=-1.473
σ0.069-0.058=0.011
min1295.676-1297.169=-1.493
max1295.838-1297.300=-1.462
mean1457.000-1644.000=-187.000
σ0.000
min1457.000-1644.000=-187.000
max1457.000-1644.000=-187.000
mean1.913-2.062=-0.149
σ0.102-0.090=0.012
min1.819-1.958=-0.139
max2.048-2.181=-0.133
iters=5
new-facts=6402
prior-facts=1
mean1539.992-1541.325=-1.332
σ6.860-6.829=0.031
min1536.776-1538.099=-1.323
max1552.261-1553.537=-1.276
mean1457.000-1644.000=-187.000
σ0.000
min1457.000-1644.000=-187.000
max1457.000-1644.000=-187.000
mean2.503-2.230=0.273
σ0.156-0.177=-0.021
min2.248-2.054=0.194
max2.645-2.505=0.140
iters=5
new-facts=6402
prior-facts=6402
mean1857.700-1859.124=-1.424
σ0.051-0.059=-0.008
min1857.654-1859.045=-1.390
max1857.774-1859.194=-1.420
mean1744.600-1782.200=-37.600
σ171.144-168.752=2.392
min1505.000-1644.000=-139.000
max1905.000-2033.000=-128.000
mean3.058-2.908=0.150
σ0.264-0.097=0.166
min2.869-2.803=0.066
max3.524-3.047=0.477

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.759-1.277=0.483
σ0.129-0.356=-0.227
min1.608-0.939=0.670
max1.917-1.756=0.161

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-448.819=-3.078
σ580.934-581.373=-0.439
min155.272-158.129=-2.857
max1317.142-1320.879=-3.736
mean96.250
σ8.500
min92.000
max109.000
mean1457.000-1644.000=-187.000
σ0.000
min1457.000-1644.000=-187.000
max1457.000-1644.000=-187.000
mean0.542-0.532=0.009
σ0.558-0.537=0.021
min0.262-0.263=-0.001
max1.378-1.337=0.041
policies=20
mean1552.986-1581.598=-28.613
σ0.317-0.349=-0.032
min1552.769-1581.369=-28.600
max1553.457-1582.117=-28.661
mean920.000
σ0.000
min920.000
max920.000
mean1457.000-1644.000=-187.000
σ0.000
min1457.000-1644.000=-187.000
max1457.000-1644.000=-187.000
mean2.572-2.626=-0.054
σ0.017-0.012=0.005
min2.557-2.616=-0.059
max2.595-2.642=-0.047
policies=200
mean15538.060-15824.090=-286.030
σ0.060-0.092=-0.032
min15538.014-15824.006=-285.991
max15538.147-15824.220=-286.073
mean9200.000
σ0.000
min9200.000
max9200.000
mean1457.000-1644.000=-187.000
σ0.000
min1457.000-1644.000=-187.000
max1457.000-1644.000=-187.000
mean26.140-26.609=-0.469
σ0.018-0.051=-0.033
min26.118-26.559=-0.441
max26.161-26.675=-0.514