Compare commits

Home / Compare d8e2b485 .. 7597f392

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.965-53.963=0.002
σ0.370-0.370=0.001
min53.823-53.818=0.005
max55.019-55.015=0.004
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.141-0.135=0.006
σ0.004-0.005=-0.001
min0.137-0.129=0.008
max0.147-0.144=0.002
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.000
σ0.007-0.005=0.002
min43.310-43.316=-0.005
max43.337-43.334=0.003
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.122-0.122=0.000
σ0.003-0.003=-0.000
min0.120-0.118=0.001
max0.128-0.127=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.515-1006.515=0.000
σ1.179-1.175=0.004
min1005.969-1005.952=0.016
max1011.448-1011.432=0.017
mean1058.600-1049.400=9.200
σ316.638-312.677=3.961
min548.000-550.000=-2.000
max1516.000-1514.000=2.000
mean1.560-1.532=0.028
σ0.084-0.077=0.007
min1.481-1.414=0.067
max1.820-1.777=0.043

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1516.000-1514.000=2.000
σ0.000
min1516.000-1514.000=2.000
max1516.000-1514.000=2.000
mean0.416-0.428=-0.012
σ0.141-0.177=-0.036
min0.331-0.335=-0.004
max0.664-0.743=-0.079
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1516.000-1514.000=2.000
σ0.000
min1516.000-1514.000=2.000
max1516.000-1514.000=2.000
mean0.870-0.902=-0.032
σ0.095-0.150=-0.055
min0.810-0.818=-0.008
max1.037-1.169=-0.132
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1516.000-1514.000=2.000
σ0.000
min1516.000-1514.000=2.000
max1516.000-1514.000=2.000
mean0.529-0.531=-0.002
σ0.061-0.055=0.007
min0.475-0.496=-0.020
max0.631-0.627=0.004
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1516.000-1514.000=2.000
σ0.000
min1516.000-1514.000=2.000
max1516.000-1514.000=2.000
mean0.836-0.838=-0.002
σ0.044-0.035=0.009
min0.799-0.812=-0.013
max0.912-0.896=0.016

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.832=-0.002
σ0.038-0.021=0.016
min964.806-964.811=-0.005
max964.896-964.860=0.037
mean1516.000-1514.000=2.000
σ0.000
min1516.000-1514.000=2.000
max1516.000-1514.000=2.000
mean0.825-0.807=0.019
σ0.020-0.040=-0.019
min0.805-0.741=0.063
max0.852-0.848=0.004
name=cdr_enhanced_4k_loc.art
mean885.510-885.510=0.000
σ0.007-0.007=-0.000
min885.504
max885.520-885.521=-0.000
mean1516.000-1514.000=2.000
σ0.000
min1516.000-1514.000=2.000
max1516.000-1514.000=2.000
mean0.695-0.701=-0.005
σ0.042-0.042=0.000
min0.654-0.633=0.021
max0.748-0.736=0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.001
mean1516.000-1514.000=2.000
σ0.000
min1516.000-1514.000=2.000
max1516.000-1514.000=2.000
mean4.264-4.218=0.046
σ0.130-0.073=0.057
min4.086-4.115=-0.029
max5.204-4.621=0.582
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.671-7.669=0.002
mean1516.000-1514.000=2.000
σ0.000
min1516.000-1514.000=2.000
max1516.000-1514.000=2.000
mean4.222-4.215=0.007
σ0.104-0.067=0.037
min4.093-4.073=0.020
max4.966-4.424=0.542
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1516.000-1514.000=2.000
σ0.000
min1516.000-1514.000=2.000
max1516.000-1514.000=2.000
mean0.697-0.751=-0.054
σ0.087-0.018=0.068
min0.513-0.712=-0.199
max0.850-0.862=-0.011
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1516.000-1514.000=2.000
σ0.000
min1516.000-1514.000=2.000
max1516.000-1514.000=2.000
mean0.504-0.708=-0.203
σ0.011-0.015=-0.004
min0.480-0.675=-0.195
max0.556-0.795=-0.239

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.306-296.383=-0.076
σ0.189-0.269=-0.080
min296.171-296.122=0.049
max296.832-297.100=-0.269
mean2026.000-1913.000=113.000
σ0.000
min2026.000-1913.000=113.000
max2026.000-1913.000=113.000
mean0.551-0.575=-0.024
σ0.040-0.037=0.003
min0.495-0.484=0.011
max0.589-0.610=-0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.032-285.032=0.000
σ0.034-0.037=-0.003
min284.988-284.980=0.008
max285.068-285.066=0.002
mean1516.000-1514.000=2.000
σ0.000
min1516.000-1514.000=2.000
max1516.000-1514.000=2.000
mean0.402-0.396=0.006
σ0.014-0.008=0.007
min0.386-0.388=-0.001
max0.424-0.407=0.017
iters=5
new-facts=1
prior-facts=6402
mean1295.376-1295.411=-0.035
σ0.092-0.113=-0.021
min1295.296-1295.286=0.011
max1295.524-1295.543=-0.018
mean1516.000-1514.000=2.000
σ0.000
min1516.000-1514.000=2.000
max1516.000-1514.000=2.000
mean1.941-1.907=0.034
σ0.214-0.057=0.158
min1.788-1.850=-0.061
max2.284-1.968=0.316
iters=5
new-facts=6402
prior-facts=1
mean1539.580-1539.530=0.051
σ6.789-6.811=-0.022
min1536.421-1536.235=0.186
max1551.723-1551.709=0.014
mean1516.000-1514.000=2.000
σ0.000
min1516.000-1514.000=2.000
max1516.000-1514.000=2.000
mean2.295-2.282=0.013
σ0.248-0.221=0.027
min2.110-2.065=0.046
max2.711-2.635=0.076
iters=5
new-facts=6402
prior-facts=6402
mean1857.328-1857.318=0.010
σ0.051-0.077=-0.025
min1857.280-1857.221=0.060
max1857.397-1857.411=-0.014
mean1734.400-1753.800=-19.400
σ212.133-173.884=38.249
min1516.000-1514.000=2.000
max2026.000-1913.000=113.000
mean2.834-3.058=-0.224
σ0.102-0.250=-0.148
min2.711-2.798=-0.087
max2.941-3.426=-0.485

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.548-1.427=0.121
σ0.208-0.338=-0.130
min1.217-0.965=0.252
max1.753-1.719=0.034

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.189-448.191=-0.002
σ581.332-581.331=0.000
min157.522-157.524=-0.002
max1320.186-1320.188=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1516.000-1514.000=2.000
σ0.000
min1516.000-1514.000=2.000
max1516.000-1514.000=2.000
mean0.548-0.556=-0.008
σ0.569-0.590=-0.022
min0.262-0.259=0.003
max1.401-1.441=-0.040
policies=20
mean1575.549-1575.568=-0.019
σ0.361-0.347=0.013
min1575.304-1575.332=-0.028
max1576.085-1576.084=0.001
mean920.000
σ0.000
min920.000
max920.000
mean1516.000-1514.000=2.000
σ0.000
min1516.000-1514.000=2.000
max1516.000-1514.000=2.000
mean2.640-2.619=0.020
σ0.018-0.015=0.003
min2.620-2.606=0.014
max2.659-2.636=0.023
policies=200
mean15763.699-15763.638=0.061
σ0.165-0.083=0.082
min15763.557-15763.551=0.006
max15763.917-15763.719=0.198
mean9200.000
σ0.000
min9200.000
max9200.000
mean1516.000-1514.000=2.000
σ0.000
min1516.000-1514.000=2.000
max1516.000-1514.000=2.000
mean26.550-26.476=0.073
σ0.034-0.040=-0.005
min26.507-26.442=0.065
max26.590-26.515=0.075