Compare commits

Home / Compare 3e8a32a4 .. b4365f69

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.342-54.343=-0.000
σ0.369-0.369=-0.000
min54.201-54.205=-0.004
max55.392-55.394=-0.002
mean419.000-418.000=1.000
σ0.000
min419.000-418.000=1.000
max419.000-418.000=1.000
mean0.140-0.138=0.002
σ0.004-0.004=-0.000
min0.136-0.134=0.003
max0.146-0.145=0.001
cache=y
dps=1
iters=10
policies=100
mean43.628-43.629=-0.001
σ0.007-0.009=-0.002
min43.615-43.621=-0.005
max43.640-43.650=-0.010
mean419.000-418.000=1.000
σ0.000
min419.000-418.000=1.000
max419.000-418.000=1.000
mean0.121-0.124=-0.002
σ0.005-0.003=0.001
min0.115-0.121=-0.006
max0.130-0.129=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1008.334-1008.329=0.006
σ0.865-0.876=-0.011
min1007.835-1007.832=0.004
max1011.905-1011.964=-0.059
mean1053.600-1047.550=6.050
σ313.389-303.784=9.605
min579.000-558.000=21.000
max1515.000-1477.000=38.000
mean1.554-1.539=0.014
σ0.073-0.069=0.004
min1.487-1.472=0.015
max1.746-1.764=-0.018

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1515.000-1477.000=38.000
σ0.000
min1515.000-1477.000=38.000
max1515.000-1477.000=38.000
mean0.413-0.412=0.001
σ0.146-0.140=0.007
min0.335-0.335=0.000
max0.674-0.659=0.015
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1515.000-1477.000=38.000
σ0.000
min1515.000-1477.000=38.000
max1515.000-1477.000=38.000
mean0.913-0.898=0.015
σ0.097-0.094=0.003
min0.827-0.830=-0.002
max1.045-1.059=-0.014
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1515.000-1477.000=38.000
σ0.000
min1515.000-1477.000=38.000
max1515.000-1477.000=38.000
mean0.544-0.546=-0.002
σ0.053-0.056=-0.003
min0.505-0.507=-0.001
max0.636-0.640=-0.004
name=nested_use.art
mean2.361-2.361=-0.001
σ0.002-0.002=-0.000
min2.360
max2.364
mean1515.000-1477.000=38.000
σ0.000
min1515.000-1477.000=38.000
max1515.000-1477.000=38.000
mean0.871-0.872=-0.000
σ0.041-0.042=-0.001
min0.832-0.845=-0.013
max0.929-0.945=-0.016

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.822-964.822=-0.000
σ0.024-0.032=-0.008
min964.802
max964.860-964.877=-0.017
mean1515.000-1477.000=38.000
σ0.000
min1515.000-1477.000=38.000
max1515.000-1477.000=38.000
mean0.836-0.839=-0.003
σ0.037-0.029=0.008
min0.787-0.798=-0.011
max0.875-0.863=0.012
name=cdr_enhanced_4k_loc.art
mean885.511-885.511=-0.000
σ0.007-0.006=0.000
min885.504
max885.518-885.519=-0.002
mean1515.000-1477.000=38.000
σ0.000
min1515.000-1477.000=38.000
max1515.000-1477.000=38.000
mean0.740-0.728=0.012
σ0.018-0.031=-0.013
min0.716-0.675=0.041
max0.766-0.750=0.016

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1515.000-1477.000=38.000
σ0.000
min1515.000-1477.000=38.000
max1515.000-1477.000=38.000
mean4.294-4.264=0.029
σ0.098-0.081=0.017
min4.133-4.134=-0.001
max4.741-4.498=0.242
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1515.000-1477.000=38.000
σ0.000
min1515.000-1477.000=38.000
max1515.000-1477.000=38.000
mean4.279-4.238=0.041
σ0.095-0.087=0.008
min4.135-4.085=0.050
max4.559-4.641=-0.082
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1515.000-1477.000=38.000
σ0.000
min1515.000-1477.000=38.000
max1515.000-1477.000=38.000
mean0.755-0.753=0.002
σ0.030-0.023=0.008
min0.576-0.665=-0.090
max0.865-0.851=0.014
name=record_render_syntax_err.art
mean2.166-2.166=0.000
σ0.002-0.002=-0.000
min2.165
max2.169
mean1515.000-1477.000=38.000
σ0.000
min1515.000-1477.000=38.000
max1515.000-1477.000=38.000
mean0.713-0.707=0.005
σ0.025-0.026=-0.002
min0.559-0.504=0.054
max0.797-0.789=0.008

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.858-296.916=-0.058
σ0.241-0.238=0.004
min296.705-296.700=0.005
max297.518-297.484=0.034
mean1913.000-1982.000=-69.000
σ0.000
min1913.000-1982.000=-69.000
max1913.000-1982.000=-69.000
mean0.583-0.548=0.035
σ0.056-0.025=0.031
min0.513-0.519=-0.005
max0.705-0.586=0.119

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean288.981-288.981=-0.001
σ0.040-0.034=0.006
min288.933-288.936=-0.002
max289.027-289.017=0.011
mean1515.000-1477.000=38.000
σ0.000
min1515.000-1477.000=38.000
max1515.000-1477.000=38.000
mean0.400-0.403=-0.003
σ0.009-0.010=-0.001
min0.393-0.396=-0.003
max0.410-0.419=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1299.346-1299.358=-0.012
σ0.073-0.061=0.012
min1299.272-1299.287=-0.015
max1299.454-1299.425=0.029
mean1515.000-1477.000=38.000
σ0.000
min1515.000-1477.000=38.000
max1515.000-1477.000=38.000
mean2.074-2.125=-0.051
σ0.119-0.073=0.046
min1.963-2.025=-0.061
max2.212-2.208=0.004
iters=5
new-facts=6402
prior-facts=1
mean1543.520-1543.517=0.003
σ6.899-6.871=0.028
min1540.235-1540.218=0.016
max1555.857-1555.803=0.054
mean1515.000-1477.000=38.000
σ0.000
min1515.000-1477.000=38.000
max1515.000-1477.000=38.000
mean2.346-2.324=0.022
σ0.212-0.195=0.017
min2.142-2.153=-0.011
max2.687-2.621=0.066
iters=5
new-facts=6402
prior-facts=6402
mean1861.274-1861.256=0.018
σ0.063-0.084=-0.020
min1861.186-1861.125=0.061
max1861.339-1861.338=0.001
mean1750.400-1775.600=-25.200
σ172.270-215.744=-43.474
min1515.000-1493.000=22.000
max1913.000-1982.000=-69.000
mean3.105-3.283=-0.178
σ0.251-0.397=-0.147
min2.906-2.879=0.027
max3.482-3.839=-0.357

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.709-1.790=-0.081
σ0.228-0.141=0.087
min1.303-1.607=-0.304
max1.841-1.998=-0.157

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.341-447.339=0.002
σ580.935-580.935=-0.000
min156.872-156.870=0.002
max1318.743-1318.741=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1515.000-1477.000=38.000
σ0.000
min1515.000-1477.000=38.000
max1515.000-1477.000=38.000
mean0.541-0.547=-0.005
σ0.564-0.576=-0.012
min0.258-0.257=0.001
max1.387-1.411=-0.024
policies=20
mean1569.015-1568.990=0.026
σ0.345-0.339=0.006
min1568.782-1568.759=0.023
max1569.528-1569.494=0.035
mean920.000
σ0.000
min920.000
max920.000
mean1515.000-1477.000=38.000
σ0.000
min1515.000-1477.000=38.000
max1515.000-1477.000=38.000
mean2.617-2.609=0.008
σ0.016-0.020=-0.004
min2.604-2.583=0.021
max2.636-2.632=0.004
policies=200
mean15698.185-15698.132=0.053
σ0.120-0.105=0.015
min15698.101-15698.002=0.099
max15698.360-15698.232=0.128
mean9200.000
σ0.000
min9200.000
max9200.000
mean1515.000-1477.000=38.000
σ0.000
min1515.000-1477.000=38.000
max1515.000-1477.000=38.000
mean26.208-26.443=-0.234
σ0.320-0.121=0.199
min25.736-26.358=-0.622
max26.443-26.618=-0.175