Compare commits

Home / Compare 93be5cfd .. 087d80aa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.015=0.000
σ0.370-0.371=-0.000
min53.869-53.869=-0.000
max55.069-55.069=-0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.140-0.140=-0.001
σ0.004-0.004=-0.001
min0.136-0.136=-0.000
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.001
σ0.006-0.007=-0.001
min43.311-43.308=0.003
max43.333
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.121-0.120=0.001
σ0.002-0.001=0.001
min0.119-0.118=0.001
max0.126-0.122=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.313-1006.311=0.002
σ1.153-1.159=-0.006
min1005.740-1005.742=-0.002
max1011.135-1011.161=-0.026
mean1053.150-1045.350=7.800
σ315.938-313.737=2.201
min564.000-595.000=-31.000
max1613.000-1642.000=-29.000
mean1.508-1.537=-0.029
σ0.057-0.078=-0.021
min1.451-1.448=0.003
max1.648-1.758=-0.110

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1613.000-1642.000=-29.000
σ0.000
min1613.000-1642.000=-29.000
max1613.000-1642.000=-29.000
mean0.417-0.391=0.026
σ0.137-0.109=0.028
min0.325-0.321=0.004
max0.657-0.583=0.074
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1613.000-1642.000=-29.000
σ0.000
min1613.000-1642.000=-29.000
max1613.000-1642.000=-29.000
mean0.895-0.882=0.012
σ0.106-0.094=0.013
min0.836-0.816=0.019
max1.082-1.045=0.037
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1613.000-1642.000=-29.000
σ0.000
min1613.000-1642.000=-29.000
max1613.000-1642.000=-29.000
mean0.559-0.540=0.019
σ0.075-0.054=0.021
min0.497-0.490=0.007
max0.682-0.632=0.050
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1613.000-1642.000=-29.000
σ0.000
min1613.000-1642.000=-29.000
max1613.000-1642.000=-29.000
mean0.844-0.834=0.010
σ0.043-0.030=0.013
min0.801-0.809=-0.008
max0.907-0.881=0.026

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.115=-0.001
σ0.034-0.034=-0.000
min964.086
max964.170-964.171=-0.001
mean1613.000-1642.000=-29.000
σ0.000
min1613.000-1642.000=-29.000
max1613.000-1642.000=-29.000
mean0.815-0.839=-0.024
σ0.035-0.032=0.003
min0.760-0.789=-0.030
max0.854-0.871=-0.018
name=cdr_enhanced_4k_loc.art
mean884.711-884.711=-0.000
σ0.008-0.008=-0.000
min884.705-884.703=0.001
max884.723-884.723=0.000
mean1613.000-1642.000=-29.000
σ0.000
min1613.000-1642.000=-29.000
max1613.000-1642.000=-29.000
mean0.719-0.721=-0.002
σ0.033-0.011=0.022
min0.666-0.708=-0.042
max0.744-0.738=0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=0.000
min7.714
max7.719-7.718=0.001
mean1613.000-1642.000=-29.000
σ0.000
min1613.000-1642.000=-29.000
max1613.000-1642.000=-29.000
mean4.269-4.254=0.015
σ0.103-0.077=0.026
min4.115-4.124=-0.010
max4.775-4.478=0.296
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1613.000-1642.000=-29.000
σ0.000
min1613.000-1642.000=-29.000
max1613.000-1642.000=-29.000
mean4.254-4.238=0.015
σ0.075-0.153=-0.078
min4.086-4.077=0.009
max4.448-5.452=-1.003
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1613.000-1642.000=-29.000
σ0.000
min1613.000-1642.000=-29.000
max1613.000-1642.000=-29.000
mean0.731-0.758=-0.027
σ0.017-0.041=-0.024
min0.704-0.542=0.162
max0.847-0.868=-0.021
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1613.000-1642.000=-29.000
σ0.000
min1613.000-1642.000=-29.000
max1613.000-1642.000=-29.000
mean0.697-0.715=-0.018
σ0.015-0.032=-0.017
min0.670-0.654=0.017
max0.765-0.815=-0.050

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.248-296.263=-0.015
σ0.193-0.253=-0.060
min296.047-296.085=-0.038
max296.765-296.961=-0.196
mean1904.000-1915.000=-11.000
σ0.000
min1904.000-1915.000=-11.000
max1904.000-1915.000=-11.000
mean0.583-0.572=0.011
σ0.052-0.038=0.014
min0.533-0.516=0.017
max0.705-0.630=0.075

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.697-284.695=0.002
σ0.030-0.033=-0.002
min284.664-284.661=0.003
max284.732-284.737=-0.005
mean1613.000-1642.000=-29.000
σ0.000
min1613.000-1642.000=-29.000
max1613.000-1642.000=-29.000
mean0.399-0.402=-0.004
σ0.012-0.017=-0.005
min0.384-0.386=-0.001
max0.410-0.428=-0.017
iters=5
new-facts=1
prior-facts=6402
mean1295.090-1295.076=0.014
σ0.130-0.106=0.024
min1294.960-1294.953=0.007
max1295.268-1295.203=0.065
mean1613.000-1642.000=-29.000
σ0.000
min1613.000-1642.000=-29.000
max1613.000-1642.000=-29.000
mean1.894-1.943=-0.049
σ0.093-0.124=-0.031
min1.786-1.805=-0.019
max2.004-2.134=-0.130
iters=5
new-facts=6402
prior-facts=1
mean1539.178-1539.230=-0.052
σ6.846-6.844=0.002
min1535.926-1535.929=-0.003
max1551.421-1551.467=-0.046
mean1613.000-1642.000=-29.000
σ0.000
min1613.000-1642.000=-29.000
max1613.000-1642.000=-29.000
mean2.238-2.367=-0.129
σ0.227-0.231=-0.003
min2.018-2.058=-0.040
max2.534-2.687=-0.153
iters=5
new-facts=6402
prior-facts=6402
mean1856.983-1856.979=0.003
σ0.063-0.060=0.003
min1856.910-1856.923=-0.013
max1857.069-1857.064=0.006
mean1765.800-1772.600=-6.800
σ137.347-137.136=0.211
min1613.000-1642.000=-29.000
max1904.000-1915.000=-11.000
mean3.049-3.068=-0.019
σ0.338-0.263=0.075
min2.818-2.861=-0.043
max3.648-3.525=0.123

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.224-1.190=0.034
σ0.348-0.360=-0.012
min0.932-0.924=0.008
max1.786-1.788=-0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.786=0.000
σ581.212-581.212=0.000
min157.179-157.178=0.000
max1319.605-1319.605=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1613.000-1642.000=-29.000
σ0.000
min1613.000-1642.000=-29.000
max1613.000-1642.000=-29.000
mean0.536-0.534=0.002
σ0.555-0.546=0.009
min0.258-0.257=0.001
max1.368-1.353=0.015
policies=20
mean1572.101-1572.102=-0.000
σ0.349-0.352=-0.003
min1571.866-1571.864=0.002
max1572.620-1572.626=-0.005
mean920.000
σ0.000
min920.000
max920.000
mean1613.000-1642.000=-29.000
σ0.000
min1613.000-1642.000=-29.000
max1613.000-1642.000=-29.000
mean2.616-2.619=-0.003
σ0.018-0.022=-0.004
min2.598-2.591=0.007
max2.635-2.646=-0.010
policies=200
mean15728.967-15729.050=-0.083
σ0.117-0.053=0.064
min15728.817-15728.977=-0.159
max15729.090-15729.103=-0.013
mean9200.000
σ0.000
min9200.000
max9200.000
mean1613.000-1642.000=-29.000
σ0.000
min1613.000-1642.000=-29.000
max1613.000-1642.000=-29.000
mean26.418-26.511=-0.093
σ0.153-0.048=0.105
min26.289-26.477=-0.188
max26.634-26.582=0.051