Compare commits

Home / Compare 9c0ccb76 .. aec0a21f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.963-54.013=-0.050
σ0.370-0.368=0.002
min53.816-53.877=-0.060
max55.016-55.060=-0.044
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.138-0.138=-0.000
σ0.005-0.005=0.000
min0.130-0.131=-0.001
max0.146-0.145=0.001
cache=y
dps=1
iters=10
policies=100
mean43.321-43.327=-0.006
σ0.007-0.008=-0.001
min43.311-43.314=-0.003
max43.333-43.341=-0.007
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.118-0.140=-0.022
σ0.003-0.008=-0.005
min0.112-0.120=-0.008
max0.122-0.150=-0.028

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.531-1006.335=0.195
σ1.191-1.183=0.008
min1005.997-1005.790=0.207
max1011.528-1011.293=0.235
mean1050.100-1046.550=3.550
σ310.088-313.477=-3.389
min549.000-596.000=-47.000
max1644.000
mean1.542-1.565=-0.023
σ0.081-0.076=0.005
min1.464-1.500=-0.037
max1.766-1.783=-0.017

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.866=0.018
σ0.003
min0.882-0.864=0.018
max0.887-0.869=0.018
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.417-0.417=0.000
σ0.145-0.171=-0.025
min0.328-0.323=0.005
max0.675-0.721=-0.047
name=error_case.art
mean2.339-2.337=0.001
σ0.003
min2.337-2.336=0.001
max2.342-2.341=0.001
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.882-0.931=-0.049
σ0.098-0.182=-0.084
min0.824-0.831=-0.007
max1.054-1.255=-0.201
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002
min1.522-1.522=0.001
max1.526-1.526=0.001
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.527-0.552=-0.025
σ0.047-0.050=-0.003
min0.496-0.508=-0.012
max0.609-0.639=-0.030
name=nested_use.art
mean2.361-2.360=0.001
σ0.002
min2.360-2.359=0.001
max2.364-2.363=0.001
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.852-0.846=0.006
σ0.040-0.040=-0.000
min0.818-0.816=0.002
max0.920-0.914=0.006

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.837-964.112=0.725
σ0.031-0.018=0.012
min964.810-964.097=0.713
max964.887-964.143=0.743
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.829-0.829=-0.001
σ0.022-0.027=-0.005
min0.803-0.801=0.003
max0.852-0.862=-0.011
name=cdr_enhanced_4k_loc.art
mean885.512-884.713=0.799
σ0.007-0.007=0.001
min885.505-884.703=0.802
max885.522-884.721=0.801
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.716-0.720=-0.004
σ0.046-0.033=0.014
min0.663-0.673=-0.010
max0.755-0.749=0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.714=0.002
σ0.002-0.002=0.000
min7.715-7.714=0.002
max7.722-7.718=0.004
mean1644.000
σ0.000
min1644.000
max1644.000
mean4.172-2.786=1.386
σ0.073-0.077=-0.005
min4.047-2.653=1.394
max4.555-3.157=1.398
name=record_render_large_syntax_err.art
mean7.665-7.663=0.002
σ0.002-0.002=-0.000
min7.664-7.662=0.002
max7.668-7.667=0.000
mean1644.000
σ0.000
min1644.000
max1644.000
mean4.167-2.764=1.404
σ0.087-0.067=0.019
min4.027-2.666=1.362
max4.507-2.993=1.515
name=record_render_success.art
mean2.291-2.289=0.001
σ0.002
min2.290-2.289=0.001
max2.294-2.292=0.001
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.736-0.529=0.207
σ0.019-0.014=0.005
min0.703-0.507=0.196
max0.837-0.611=0.226
name=record_render_syntax_err.art
mean2.166-2.165=0.001
σ0.002
min2.165-2.164=0.001
max2.169-2.168=0.001
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.697-0.505=0.192
σ0.015-0.018=-0.003
min0.670-0.476=0.194
max0.768-0.628=0.140

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.486-296.370=0.115
σ0.328-0.213=0.115
min296.273-296.207=0.066
max297.371-296.956=0.416
mean2024.000-1909.000=115.000
σ0.000
min2024.000-1909.000=115.000
max2024.000-1909.000=115.000
mean0.554-0.567=-0.013
σ0.027-0.040=-0.013
min0.514-0.501=0.012
max0.596-0.600=-0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.055-284.718=0.336
σ0.036-0.040=-0.004
min285.006-284.663=0.343
max285.096-284.763=0.332
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.396-0.398=-0.002
σ0.008-0.014=-0.006
min0.389-0.384=0.006
max0.407-0.418=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1295.436-1295.103=0.333
σ0.106-0.107=-0.001
min1295.321-1294.980=0.340
max1295.557-1295.230=0.326
mean1644.000
σ0.000
min1644.000
max1644.000
mean1.908-1.934=-0.027
σ0.132-0.122=0.010
min1.783-1.804=-0.021
max2.062-2.126=-0.064
iters=5
new-facts=6402
prior-facts=1
mean1539.567-1539.235=0.332
σ6.842-6.832=0.010
min1536.298-1535.946=0.352
max1551.801-1551.451=0.350
mean1644.000
σ0.000
min1644.000
max1644.000
mean2.347-2.345=0.002
σ0.202-0.275=-0.074
min2.083-1.945=0.138
max2.518-2.674=-0.156
iters=5
new-facts=6402
prior-facts=6402
mean1857.342-1857.005=0.336
σ0.058-0.051=0.007
min1857.287-1856.965=0.323
max1857.425-1857.087=0.338
mean1782.600-1770.000=12.600
σ165.105-133.109=31.996
min1644.000
max2024.000-1909.000=115.000
mean3.075-3.074=0.000
σ0.308-0.265=0.043
min2.836-2.864=-0.027
max3.598-3.535=0.063

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.179-1.148=0.032
σ0.303-0.213=0.089
min0.940-0.938=0.001
max1.664-1.476=0.188

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.236-447.830=0.405
σ581.331-581.212=0.119
min157.569-157.222=0.347
max1320.233-1319.649=0.584
mean96.250
σ8.500
min92.000
max109.000
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.539-0.549=-0.010
σ0.548-0.569=-0.020
min0.263-0.260=0.003
max1.362-1.402=-0.040
policies=20
mean1576.028-1572.555=3.473
σ0.365-0.369=-0.004
min1575.778-1572.306=3.472
max1576.570-1573.103=3.467
mean920.000
σ0.000
min920.000
max920.000
mean1644.000
σ0.000
min1644.000
max1644.000
mean2.636-2.659=-0.023
σ0.018-0.034=-0.016
min2.622-2.632=-0.010
max2.662-2.707=-0.045
policies=200
mean15768.290-15733.402=34.888
σ0.041-0.050=-0.009
min15768.258-15733.367=34.892
max15768.350-15733.476=34.874
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000
σ0.000
min1644.000
max1644.000
mean26.745-26.652=0.093
σ0.031-0.186=-0.155
min26.699-26.548=0.152
max26.763-26.931=-0.168