Compare commits

Home / Compare a74b0e58 .. 4dedcbef

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.055=0.001
σ0.369-0.367=0.002
min53.910-53.911=-0.000
max55.107-55.100=0.007
mean420.000-415.000=5.000
σ0.000
min420.000-415.000=5.000
max420.000-415.000=5.000
mean0.141-0.141=0.000
σ0.004-0.005=-0.001
min0.138-0.137=0.001
max0.149-0.149=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.393-43.395=-0.002
σ0.005-0.006=-0.001
min43.384-43.389=-0.004
max43.400-43.405=-0.005
mean420.000-415.000=5.000
σ0.000
min420.000-415.000=5.000
max420.000-415.000=5.000
mean0.120-0.121=-0.001
σ0.002-0.004=-0.001
min0.118-0.116=0.002
max0.126-0.127=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1007.005=0.000
σ1.183-1.187=-0.004
min1006.463-1006.432=0.031
max1011.957-1011.981=-0.024
mean1056.950-1051.550=5.400
σ322.191-307.956=14.234
min574.000-576.000=-2.000
max1638.000-1644.000=-6.000
mean1.534-1.532=0.002
σ0.083-0.079=0.003
min1.451-1.461=-0.011
max1.840-1.785=0.055

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean0.434-0.427=0.007
σ0.139-0.131=0.009
min0.342-0.358=-0.017
max0.678-0.660=0.017
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean0.949-0.886=0.062
σ0.203-0.090=0.113
min0.836-0.832=0.005
max1.311-1.046=0.266
name=heavy_item.art
mean1.524-1.525=-0.001
σ0.002-0.001=0.001
min1.522-1.524=-0.001
max1.526-1.527=-0.001
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean0.539-0.535=0.004
σ0.055-0.045=0.010
min0.497-0.499=-0.001
max0.633-0.607=0.025
name=nested_use.art
mean2.361-2.361=-0.000
σ0.002-0.002=-0.001
min2.360
max2.364-2.365=-0.001
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean0.848-0.857=-0.009
σ0.042-0.040=0.003
min0.820-0.817=0.003
max0.918-0.922=-0.004

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.837=0.002
σ0.034-0.033=0.002
min964.810-964.807=0.003
max964.896-964.891=0.005
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean0.819-0.784=0.035
σ0.037-0.070=-0.033
min0.784-0.659=0.125
max0.861-0.822=0.040
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.007-0.008=-0.001
min885.505-885.504=0.001
max885.523-885.523=-0.001
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean0.701-0.721=-0.020
σ0.032-0.008=0.024
min0.667-0.711=-0.044
max0.740-0.733=0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean4.227-3.538=0.689
σ0.086-0.086=0.001
min4.080-3.416=0.665
max4.453-3.992=0.461
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean4.237-3.527=0.710
σ0.115-0.067=0.048
min4.099-3.399=0.700
max5.015-3.739=1.277
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean0.750-0.750=-0.000
σ0.028-0.015=0.013
min0.713-0.722=-0.010
max0.924-0.842=0.082
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean0.543-0.707=-0.164
σ0.076-0.016=0.060
min0.486-0.678=-0.192
max0.782-0.789=-0.007

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.237-296.862=0.375
σ0.189-0.220=-0.031
min297.094-296.647=0.447
max297.747-297.453=0.295
mean1899.000-1900.000=-1.000
σ0.000
min1899.000-1900.000=-1.000
max1899.000-1900.000=-1.000
mean0.581-0.568=0.013
σ0.041-0.044=-0.003
min0.528-0.506=0.022
max0.668-0.639=0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.823-286.825=-0.002
σ0.038-0.039=-0.001
min286.770-286.773=-0.003
max286.862-286.865=-0.003
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean0.396-0.393=0.003
σ0.007-0.006=0.001
min0.389-0.390=-0.000
max0.404-0.403=0.001
iters=5
new-facts=1
prior-facts=6402
mean1297.230-1297.248=-0.018
σ0.048-0.032=0.016
min1297.167-1297.213=-0.046
max1297.298-1297.297=0.001
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean2.094-2.149=-0.055
σ0.125-0.251=-0.127
min2.005-2.019=-0.014
max2.308-2.596=-0.289
iters=5
new-facts=6402
prior-facts=1
mean1541.371-1541.324=0.047
σ6.828-6.848=-0.020
min1538.134-1538.093=0.041
max1553.583-1553.572=0.011
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean2.371-2.278=0.093
σ0.261-0.219=0.042
min2.094-2.076=0.018
max2.709-2.538=0.171
iters=5
new-facts=6402
prior-facts=6402
mean1859.108-1859.109=-0.001
σ0.080-0.083=-0.004
min1858.990-1858.985=0.005
max1859.192-1859.194=-0.001
mean1780.400-1773.200=7.200
σ124.380-126.044=-1.665
min1638.000-1644.000=-6.000
max1899.000-1900.000=-1.000
mean3.051-3.115=-0.064
σ0.161-0.278=-0.117
min2.861-2.811=0.050
max3.260-3.535=-0.276

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.233-1.294=-0.061
σ0.346-0.335=0.011
min0.935-0.906=0.029
max1.812-1.677=0.135

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.821=0.001
σ581.371-581.372=-0.001
min158.134-158.133=0.001
max1320.878-1320.879=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean0.554-0.552=0.001
σ0.580-0.575=0.005
min0.262-0.260=0.002
max1.423-1.415=0.009
policies=20
mean1581.628-1581.611=0.017
σ0.364-0.359=0.005
min1581.387-1581.376=0.010
max1582.170-1582.146=0.024
mean920.000
σ0.000
min920.000
max920.000
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean2.645-2.647=-0.002
σ0.018-0.028=-0.011
min2.630-2.615=0.015
max2.668-2.679=-0.012
policies=200
mean15824.146-15824.171=-0.026
σ0.102-0.119=-0.017
min15824.021-15824.079=-0.058
max15824.261-15824.345=-0.085
mean9200.000
σ0.000
min9200.000
max9200.000
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean26.544-26.587=-0.043
σ0.039-0.038=0.001
min26.487-26.550=-0.063
max26.567-26.623=-0.056