Compare commits

Home / Compare 5475dd87 .. c22867cd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.126-54.126=0.000
σ0.350-0.351=-0.001
min53.989-53.989=0.000
max55.123-55.125=-0.003
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.139-0.140=-0.001
σ0.005-0.006=-0.001
min0.133-0.132=0.001
max0.148-0.150=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.404-43.404=0.000
σ0.007-0.006=0.001
min43.396-43.396=-0.000
max43.420-43.417=0.003
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.121-0.123=-0.002
σ0.004-0.003=0.001
min0.117-0.120=-0.003
max0.132-0.128=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.335-1006.334=0.002
σ0.882-0.870=0.012
min1005.835-1005.835=-0.000
max1009.993-1009.936=0.057
mean1050.550-1051.800=-1.250
σ307.904-306.550=1.353
min574.000-577.000=-3.000
max1650.000-1645.000=5.000
mean1.547-1.547=-0.000
σ0.084-0.101=-0.018
min1.461-1.423=0.037
max1.803-1.901=-0.098

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003-0.002=0.001
min0.881
max0.887-0.886=0.001
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.434-0.428=0.007
σ0.132-0.127=0.006
min0.366-0.345=0.021
max0.670-0.652=0.019
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.895-0.908=-0.013
σ0.093-0.090=0.003
min0.847-0.849=-0.002
max1.060-1.065=-0.006
name=heavy_item.art
mean1.522-1.521=0.000
σ0.002-0.002=0.000
min1.520
max1.524-1.524=0.000
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.551-0.547=0.005
σ0.040-0.051=-0.010
min0.521-0.506=0.015
max0.621-0.634=-0.014
name=nested_use.art
mean2.356-2.355=0.001
σ0.002-0.002=-0.000
min2.355
max2.358
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.856-0.851=0.006
σ0.041-0.050=-0.009
min0.824-0.813=0.011
max0.926-0.935=-0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-963.552=-0.000
σ0.025-0.023=0.002
min963.523-963.535=-0.012
max963.582-963.590=-0.008
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.836-0.846=-0.010
σ0.027-0.010=0.017
min0.803-0.833=-0.030
max0.860-0.855=0.005
name=cdr_enhanced_4k_loc.art
mean884.856-884.854=0.003
σ0.005-0.009=-0.003
min884.848-884.847=0.001
max884.862-884.867=-0.005
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.728-0.748=-0.020
σ0.032-0.007=0.025
min0.674-0.741=-0.067
max0.757-0.760=-0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=-0.000
min7.705
max7.710-7.711=-0.000
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean3.556-4.304=-0.748
σ0.092-0.147=-0.054
min3.410-4.138=-0.728
max3.999-5.411=-1.412
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean3.530-4.292=-0.762
σ0.086-0.093=-0.007
min3.419-4.089=-0.670
max4.123-4.668=-0.545
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.544-0.757=-0.213
σ0.014-0.028=-0.014
min0.521-0.543=-0.022
max0.637-0.866=-0.228
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.444-0.714=-0.270
σ0.112-0.014=0.099
min0.276-0.682=-0.406
max0.794-0.779=0.015

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.361-295.628=-0.267
σ0.348-0.204=0.144
min295.007-295.406=-0.399
max296.248-296.158=0.089
mean1912.000-2017.000=-105.000
σ0.000
min1912.000-2017.000=-105.000
max1912.000-2017.000=-105.000
mean0.567-0.566=0.002
σ0.050-0.030=0.021
min0.515-0.518=-0.003
max0.675-0.594=0.081

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.252-285.258=-0.005
σ0.038-0.036=0.002
min285.212-285.211=0.001
max285.293-285.294=-0.002
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.406-0.405=0.001
σ0.012-0.011=0.001
min0.393-0.392=0.001
max0.419-0.416=0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.203-1295.208=-0.006
σ0.110-0.113=-0.004
min1295.082-1295.081=0.001
max1295.337-1295.358=-0.021
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean1.905-1.861=0.043
σ0.081-0.060=0.021
min1.814-1.798=0.016
max1.976-1.936=0.040
iters=5
new-facts=6402
prior-facts=1
mean1538.086-1538.098=-0.012
σ4.051-4.039=0.012
min1536.044-1536.046=-0.001
max1545.324-1545.315=0.009
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean2.266-2.315=-0.049
σ0.203-0.261=-0.058
min2.011-2.044=-0.034
max2.450-2.687=-0.236
iters=5
new-facts=6402
prior-facts=6402
mean1857.114-1857.110=0.005
σ0.054-0.049=0.005
min1857.056-1857.071=-0.015
max1857.185-1857.175=0.010
mean1780.800-1774.400=6.400
σ130.035-163.627=-33.592
min1650.000-1645.000=5.000
max1912.000-2017.000=-105.000
mean3.095-3.005=0.090
σ0.272-0.328=-0.057
min2.872-2.788=0.083
max3.562-3.580=-0.018

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.351-1.460=-0.109
σ0.250-0.310=-0.060
min1.124-1.127=-0.002
max1.780-1.832=-0.052

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.611-443.612=-0.001
σ577.065-577.065=-0.000
min155.077-155.078=-0.001
max1309.208-1309.209=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.542-0.549=-0.007
σ0.551-0.573=-0.022
min0.261-0.259=0.002
max1.369-1.408=-0.039
policies=20
mean1551.058-1551.069=-0.011
σ0.344-0.359=-0.015
min1550.829-1550.828=0.001
max1551.570-1551.603=-0.033
mean920.000
σ0.000
min920.000
max920.000
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean2.618-2.643=-0.025
σ0.014-0.063=-0.049
min2.603-2.608=-0.005
max2.636-2.738=-0.101
policies=200
mean15518.713-15518.832=-0.119
σ0.155-0.142=0.012
min15518.612-15518.672=-0.061
max15518.943-15519.018=-0.075
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean26.345-26.328=0.017
σ0.047-0.067=-0.020
min26.296-26.233=0.062
max26.405-26.385=0.020