Compare commits

Home / Compare 79f0401b .. 5c07c46e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-53.963=0.093
σ0.368-0.370=-0.002
min53.911-53.816=0.095
max55.103-55.016=0.087
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.138-0.138=0.000
σ0.004-0.005=-0.001
min0.132-0.130=0.002
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.394-43.321=0.073
σ0.006-0.007=-0.001
min43.386-43.311=0.075
max43.401-43.333=0.068
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.121-0.118=0.002
σ0.005-0.003=0.002
min0.115-0.112=0.003
max0.129-0.122=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.029-1006.531=0.498
σ1.190-1.191=-0.002
min1006.455-1005.997=0.458
max1012.013-1011.528=0.485
mean1049.500-1050.100=-0.600
σ314.367-310.088=4.280
min594.000-549.000=45.000
max1652.000-1644.000=8.000
mean1.548-1.542=0.006
σ0.066-0.081=-0.015
min1.466-1.464=0.002
max1.729-1.766=-0.037

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1652.000-1644.000=8.000
σ0.000
min1652.000-1644.000=8.000
max1652.000-1644.000=8.000
mean0.423-0.417=0.006
σ0.139-0.145=-0.007
min0.341-0.328=0.012
max0.668-0.675=-0.007
name=error_case.art
mean2.339-2.339=0.000
σ0.002-0.003=-0.000
min2.337
max2.342
mean1652.000-1644.000=8.000
σ0.000
min1652.000-1644.000=8.000
max1652.000-1644.000=8.000
mean0.919-0.882=0.037
σ0.193-0.098=0.095
min0.815-0.824=-0.009
max1.263-1.054=0.208
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1652.000-1644.000=8.000
σ0.000
min1652.000-1644.000=8.000
max1652.000-1644.000=8.000
mean0.538-0.527=0.011
σ0.050-0.047=0.003
min0.486-0.496=-0.010
max0.616-0.609=0.007
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1652.000-1644.000=8.000
σ0.000
min1652.000-1644.000=8.000
max1652.000-1644.000=8.000
mean0.836-0.852=-0.016
σ0.037-0.040=-0.002
min0.808-0.818=-0.010
max0.901-0.920=-0.019

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.837=0.002
σ0.035-0.031=0.005
min964.809-964.810=-0.001
max964.897-964.887=0.010
mean1652.000-1644.000=8.000
σ0.000
min1652.000-1644.000=8.000
max1652.000-1644.000=8.000
mean0.804-0.829=-0.025
σ0.057-0.022=0.036
min0.707-0.803=-0.096
max0.855-0.852=0.004
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.007-0.007=-0.000
min885.506-885.505=0.000
max885.523-885.522=0.001
mean1652.000-1644.000=8.000
σ0.000
min1652.000-1644.000=8.000
max1652.000-1644.000=8.000
mean0.704-0.716=-0.012
σ0.040-0.046=-0.006
min0.663-0.663=-0.000
max0.754-0.755=-0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.722=-0.003
mean1652.000-1644.000=8.000
σ0.000
min1652.000-1644.000=8.000
max1652.000-1644.000=8.000
mean4.236-4.172=0.064
σ0.103-0.073=0.031
min4.064-4.047=0.017
max4.775-4.555=0.220
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1652.000-1644.000=8.000
σ0.000
min1652.000-1644.000=8.000
max1652.000-1644.000=8.000
mean4.238-4.167=0.071
σ0.074-0.087=-0.012
min4.088-4.027=0.061
max4.516-4.507=0.008
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1652.000-1644.000=8.000
σ0.000
min1652.000-1644.000=8.000
max1652.000-1644.000=8.000
mean0.747-0.736=0.011
σ0.018-0.019=-0.001
min0.722-0.703=0.019
max0.865-0.837=0.028
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1652.000-1644.000=8.000
σ0.000
min1652.000-1644.000=8.000
max1652.000-1644.000=8.000
mean0.710-0.697=0.012
σ0.014-0.015=-0.001
min0.675-0.670=0.006
max0.776-0.768=0.008

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.959-296.486=0.473
σ0.246-0.328=-0.082
min296.776-296.273=0.503
max297.626-297.371=0.254
mean1907.000-2024.000=-117.000
σ0.000
min1907.000-2024.000=-117.000
max1907.000-2024.000=-117.000
mean0.579-0.554=0.026
σ0.033-0.027=0.006
min0.527-0.514=0.013
max0.611-0.596=0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.860-285.055=1.806
σ0.030-0.036=-0.006
min286.831-285.006=1.825
max286.898-285.096=1.802
mean1652.000-1644.000=8.000
σ0.000
min1652.000-1644.000=8.000
max1652.000-1644.000=8.000
mean0.411-0.396=0.015
σ0.013-0.008=0.005
min0.390-0.389=0.001
max0.421-0.407=0.014
iters=5
new-facts=1
prior-facts=6402
mean1297.233-1295.436=1.797
σ0.105-0.106=-0.001
min1297.119-1295.321=1.798
max1297.362-1295.557=1.805
mean1652.000-1644.000=8.000
σ0.000
min1652.000-1644.000=8.000
max1652.000-1644.000=8.000
mean1.910-1.908=0.002
σ0.110-0.132=-0.022
min1.803-1.783=0.021
max2.048-2.062=-0.014
iters=5
new-facts=6402
prior-facts=1
mean1541.374-1539.567=1.807
σ6.850-6.842=0.008
min1538.070-1536.298=1.771
max1553.623-1551.801=1.822
mean1652.000-1644.000=8.000
σ0.000
min1652.000-1644.000=8.000
max1652.000-1644.000=8.000
mean2.359-2.347=0.012
σ0.182-0.202=-0.019
min2.041-2.083=-0.043
max2.494-2.518=-0.023
iters=5
new-facts=6402
prior-facts=6402
mean1859.144-1857.342=1.802
σ0.054-0.058=-0.004
min1859.090-1857.287=1.803
max1859.223-1857.425=1.798
mean1776.600-1782.600=-6.000
σ125.632-165.105=-39.474
min1652.000-1644.000=8.000
max1907.000-2024.000=-117.000
mean3.042-3.075=-0.033
σ0.215-0.308=-0.092
min2.852-2.836=0.016
max3.413-3.598=-0.185

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.195-1.179=0.016
σ0.369-0.303=0.066
min0.937-0.940=-0.003
max1.813-1.664=0.150

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.866-448.236=0.630
σ581.372-581.331=0.040
min158.178-157.569=0.609
max1320.923-1320.233=0.691
mean96.250
σ8.500
min92.000
max109.000
mean1652.000-1644.000=8.000
σ0.000
min1652.000-1644.000=8.000
max1652.000-1644.000=8.000
mean0.551-0.539=0.011
σ0.575-0.548=0.027
min0.262-0.263=-0.001
max1.414-1.362=0.052
policies=20
mean1582.065-1576.028=6.037
σ0.346-0.365=-0.018
min1581.831-1575.778=6.053
max1582.580-1576.570=6.010
mean920.000
σ0.000
min920.000
max920.000
mean1652.000-1644.000=8.000
σ0.000
min1652.000-1644.000=8.000
max1652.000-1644.000=8.000
mean2.618-2.636=-0.019
σ0.010-0.018=-0.009
min2.603-2.622=-0.019
max2.624-2.662=-0.039
policies=200
mean15828.784-15768.290=60.494
σ0.081-0.041=0.041
min15828.665-15768.258=60.406
max15828.848-15768.350=60.498
mean9200.000
σ0.000
min9200.000
max9200.000
mean1652.000-1644.000=8.000
σ0.000
min1652.000-1644.000=8.000
max1652.000-1644.000=8.000
mean26.578-26.745=-0.167
σ0.042-0.031=0.012
min26.550-26.699=-0.149
max26.640-26.763=-0.123