Compare commits

Home / Compare 5ec1f4e3 .. 69163753

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.868-54.867=0.000
σ0.367-0.367=-0.001
min54.732-54.730=0.002
max55.910-55.913=-0.003
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.139-0.141=-0.002
σ0.005-0.005=-0.000
min0.133-0.136=-0.004
max0.146-0.149=-0.003
cache=y
dps=1
iters=10
policies=100
mean44.101-44.099=0.001
σ0.006-0.006=0.001
min44.094-44.093=0.000
max44.114-44.112=0.002
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.126-0.126=0.001
σ0.004-0.007=-0.003
min0.123-0.119=0.004
max0.133-0.142=-0.009

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1010.012-1010.008=0.004
σ0.888-0.932=-0.044
min1009.513-1009.539=-0.026
max1013.699-1013.890=-0.192
mean1051.450-1055.150=-3.700
σ309.398-316.318=-6.920
min579.000-588.000=-9.000
max1492.000-1520.000=-28.000
mean1.534-1.579=-0.045
σ0.077-0.137=-0.061
min1.452-1.473=-0.022
max1.762-2.038=-0.276

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1492.000-1520.000=-28.000
σ0.000
min1492.000-1520.000=-28.000
max1492.000-1520.000=-28.000
mean0.450-0.417=0.033
σ0.193-0.132=0.061
min0.343-0.336=0.007
max0.793-0.651=0.142
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1492.000-1520.000=-28.000
σ0.000
min1492.000-1520.000=-28.000
max1492.000-1520.000=-28.000
mean0.931-0.888=0.044
σ0.168-0.086=0.082
min0.838-0.834=0.004
max1.231-1.040=0.190
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1492.000-1520.000=-28.000
σ0.000
min1492.000-1520.000=-28.000
max1492.000-1520.000=-28.000
mean0.543-0.542=0.001
σ0.049-0.051=-0.002
min0.495-0.498=-0.003
max0.619-0.627=-0.008
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1492.000-1520.000=-28.000
σ0.000
min1492.000-1520.000=-28.000
max1492.000-1520.000=-28.000
mean0.855-0.858=-0.002
σ0.030-0.046=-0.016
min0.834-0.818=0.016
max0.906-0.933=-0.027

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.822-964.828=-0.006
σ0.024-0.036=-0.012
min964.802
max964.860-964.890=-0.030
mean1492.000-1520.000=-28.000
σ0.000
min1492.000-1520.000=-28.000
max1492.000-1520.000=-28.000
mean0.828-0.817=0.011
σ0.022-0.043=-0.021
min0.797-0.773=0.024
max0.851-0.860=-0.009
name=cdr_enhanced_4k_loc.art
mean885.511-885.511=-0.001
σ0.007-0.007=-0.000
min885.504
max885.519-885.519=-0.000
mean1492.000-1520.000=-28.000
σ0.000
min1492.000-1520.000=-28.000
max1492.000-1520.000=-28.000
mean0.715-0.727=-0.013
σ0.023-0.035=-0.012
min0.676-0.669=0.007
max0.737-0.756=-0.019

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.723-7.721=0.001
mean1492.000-1520.000=-28.000
σ0.000
min1492.000-1520.000=-28.000
max1492.000-1520.000=-28.000
mean3.473-4.229=-0.756
σ0.090-0.089=0.002
min3.263-4.103=-0.839
max3.809-4.523=-0.714
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1492.000-1520.000=-28.000
σ0.000
min1492.000-1520.000=-28.000
max1492.000-1520.000=-28.000
mean3.437-4.224=-0.787
σ0.084-0.182=-0.098
min3.257-2.881=0.376
max3.693-4.581=-0.888
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1492.000-1520.000=-28.000
σ0.000
min1492.000-1520.000=-28.000
max1492.000-1520.000=-28.000
mean0.536-0.741=-0.205
σ0.019-0.017=0.002
min0.512-0.708=-0.196
max0.662-0.858=-0.196
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1492.000-1520.000=-28.000
σ0.000
min1492.000-1520.000=-28.000
max1492.000-1520.000=-28.000
mean0.509-0.705=-0.196
σ0.034-0.022=0.012
min0.482-0.675=-0.193
max0.814-0.819=-0.005

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean298.565-298.490=0.074
σ0.188-0.246=-0.057
min298.412-298.304=0.108
max299.075-299.163=-0.088
mean1892.000-1894.000=-2.000
σ0.000
min1892.000-1894.000=-2.000
max1892.000-1894.000=-2.000
mean0.617-0.615=0.002
σ0.037-0.039=-0.002
min0.566-0.561=0.005
max0.710-0.714=-0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean293.557-293.556=0.001
σ0.040-0.040=0.000
min293.504-293.501=0.003
max293.603-293.596=0.008
mean1492.000-1520.000=-28.000
σ0.000
min1492.000-1520.000=-28.000
max1492.000-1520.000=-28.000
mean0.405-0.396=0.009
σ0.007-0.008=-0.001
min0.397-0.390=0.008
max0.413-0.405=0.008
iters=5
new-facts=1
prior-facts=6402
mean1303.839-1303.881=-0.042
σ0.067-0.101=-0.034
min1303.760-1303.741=0.019
max1303.905-1304.013=-0.108
mean1492.000-1520.000=-28.000
σ0.000
min1492.000-1520.000=-28.000
max1492.000-1520.000=-28.000
mean2.118-2.209=-0.091
σ0.140-0.067=0.072
min1.990-2.159=-0.169
max2.336-2.325=0.011
iters=5
new-facts=6402
prior-facts=1
mean1548.122-1548.083=0.038
σ6.854-6.884=-0.030
min1544.890-1544.816=0.074
max1560.379-1560.393=-0.014
mean1492.000-1520.000=-28.000
σ0.000
min1492.000-1520.000=-28.000
max1492.000-1520.000=-28.000
mean2.337-2.221=0.116
σ0.094-0.129=-0.035
min2.223-2.097=0.126
max2.459-2.435=0.024
iters=5
new-facts=6402
prior-facts=6402
mean1865.856-1865.850=0.006
σ0.072-0.066=0.006
min1865.760-1865.771=-0.011
max1865.937-1865.932=0.005
mean1735.400-1740.800=-5.400
σ169.327-160.646=8.681
min1492.000-1520.000=-28.000
max1892.000-1894.000=-2.000
mean3.077-3.028=0.049
σ0.161-0.238=-0.078
min2.907-2.721=0.187
max3.310-3.345=-0.035

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.728-1.658=0.070
σ0.169-0.240=-0.071
min1.448-1.272=0.176
max1.896-1.829=0.066

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean449.402-449.402=0.000
σ580.934-580.934=0.001
min158.934-158.934=-0.000
max1320.804-1320.802=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1492.000-1520.000=-28.000
σ0.000
min1492.000-1520.000=-28.000
max1492.000-1520.000=-28.000
mean0.539-0.539=-0.000
σ0.553-0.555=-0.002
min0.259-0.261=-0.002
max1.369-1.371=-0.003
policies=20
mean1589.621-1589.624=-0.004
σ0.347-0.362=-0.014
min1589.386-1589.383=0.003
max1590.138-1590.163=-0.026
mean920.000
σ0.000
min920.000
max920.000
mean1492.000-1520.000=-28.000
σ0.000
min1492.000-1520.000=-28.000
max1492.000-1520.000=-28.000
mean2.616-2.630=-0.014
σ0.026-0.014=0.012
min2.592-2.614=-0.022
max2.652-2.647=0.006
policies=200
mean15904.183-15904.234=-0.051
σ0.140-0.029=0.111
min15904.035-15904.207=-0.173
max15904.370-15904.266=0.104
mean9200.000
σ0.000
min9200.000
max9200.000
mean1492.000-1520.000=-28.000
σ0.000
min1492.000-1520.000=-28.000
max1492.000-1520.000=-28.000
mean26.524-26.547=-0.023
σ0.043-0.066=-0.023
min26.479-26.472=0.007
max26.579-26.628=-0.050