Compare commits

Home / Compare 82595119 .. b5409d86

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.045-54.055=-0.010
σ0.369-0.368=0.001
min53.901-53.908=-0.007
max55.094-55.101=-0.007
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.139-0.139=-0.000
σ0.004-0.004=-0.000
min0.131-0.135=-0.003
max0.144-0.144=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.384-43.394=-0.011
σ0.006-0.005=0.000
min43.377-43.388=-0.011
max43.393-43.402=-0.009
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.122-0.122=-0.000
σ0.005-0.003=0.002
min0.115-0.119=-0.004
max0.131-0.127=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.977-1006.979=-0.003
σ0.935-0.864=0.071
min1006.506-1006.480=0.026
max1010.868-1010.553=0.314
mean1057.500-1044.800=12.700
σ306.370-313.998=-7.628
min577.000-576.000=1.000
max1458.000-1638.000=-180.000
mean1.579-1.544=0.035
σ0.134-0.081=0.053
min1.480-1.378=0.102
max2.061-1.763=0.298

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.001
σ0.003-0.002=0.000
min0.882
max0.887
mean1458.000-1638.000=-180.000
σ0.000
min1458.000-1638.000=-180.000
max1458.000-1638.000=-180.000
mean0.423-0.416=0.007
σ0.132-0.126=0.006
min0.349-0.337=0.012
max0.658-0.637=0.021
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.003=0.000
min2.337
max2.342
mean1458.000-1638.000=-180.000
σ0.000
min1458.000-1638.000=-180.000
max1458.000-1638.000=-180.000
mean0.892-0.881=0.011
σ0.095-0.088=0.008
min0.804-0.818=-0.014
max1.052-1.030=0.022
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002-0.001=0.001
min1.522
max1.526-1.525=0.001
mean1458.000-1638.000=-180.000
σ0.000
min1458.000-1638.000=-180.000
max1458.000-1638.000=-180.000
mean0.564-0.540=0.024
σ0.059-0.047=0.011
min0.510-0.506=0.005
max0.636-0.621=0.015
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.002=-0.000
min2.360
max2.364
mean1458.000-1638.000=-180.000
σ0.000
min1458.000-1638.000=-180.000
max1458.000-1638.000=-180.000
mean0.855-0.864=-0.009
σ0.058-0.032=0.026
min0.816-0.829=-0.013
max0.954-0.915=0.040

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.822-964.830=-0.008
σ0.026-0.025=0.000
min964.802
max964.864-964.862=0.002
mean1458.000-1638.000=-180.000
σ0.000
min1458.000-1638.000=-180.000
max1458.000-1638.000=-180.000
mean0.828-0.816=0.012
σ0.044-0.041=0.003
min0.754-0.779=-0.025
max0.859-0.863=-0.004
name=cdr_enhanced_4k_loc.art
mean885.511-885.515=-0.003
σ0.006-0.005=0.002
min885.504-885.508=-0.004
max885.519-885.520=-0.001
mean1458.000-1638.000=-180.000
σ0.000
min1458.000-1638.000=-180.000
max1458.000-1638.000=-180.000
mean0.699-0.703=-0.004
σ0.043-0.040=0.002
min0.641-0.658=-0.017
max0.736-0.748=-0.013

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.002
mean1458.000-1638.000=-180.000
σ0.000
min1458.000-1638.000=-180.000
max1458.000-1638.000=-180.000
mean4.237-4.200=0.038
σ0.077-0.064=0.014
min4.142-4.063=0.080
max4.679-4.431=0.248
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.668-7.668=0.000
mean1458.000-1638.000=-180.000
σ0.000
min1458.000-1638.000=-180.000
max1458.000-1638.000=-180.000
mean4.231-4.204=0.027
σ0.064-0.086=-0.022
min4.093-4.076=0.017
max4.442-4.518=-0.076
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1458.000-1638.000=-180.000
σ0.000
min1458.000-1638.000=-180.000
max1458.000-1638.000=-180.000
mean0.747-0.745=0.001
σ0.022-0.019=0.004
min0.715-0.714=0.001
max0.875-0.846=0.029
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1458.000-1638.000=-180.000
σ0.000
min1458.000-1638.000=-180.000
max1458.000-1638.000=-180.000
mean0.704-0.696=0.008
σ0.016-0.016=0.000
min0.679-0.669=0.009
max0.790-0.785=0.005

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.627-295.507=0.120
σ0.187-0.188=-0.001
min295.483-295.366=0.118
max296.139-296.027=0.112
mean2021.000-2025.000=-4.000
σ0.000
min2021.000-2025.000=-4.000
max2021.000-2025.000=-4.000
mean0.541-0.551=-0.010
σ0.029-0.029=-0.000
min0.508-0.520=-0.012
max0.589-0.591=-0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.413-285.408=0.004
σ0.041-0.037=0.004
min285.355-285.361=-0.006
max285.452-285.448=0.004
mean1458.000-1638.000=-180.000
σ0.000
min1458.000-1638.000=-180.000
max1458.000-1638.000=-180.000
mean0.396-0.391=0.005
σ0.007-0.014=-0.006
min0.389-0.381=0.008
max0.404-0.408=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.824-1295.768=0.056
σ0.064-0.107=-0.043
min1295.754-1295.677=0.077
max1295.897-1295.941=-0.043
mean1458.000-1638.000=-180.000
σ0.000
min1458.000-1638.000=-180.000
max1458.000-1638.000=-180.000
mean2.103-1.979=0.124
σ0.086-0.204=-0.117
min2.007-1.800=0.207
max2.205-2.288=-0.084
iters=5
new-facts=6402
prior-facts=1
mean1540.035-1539.998=0.037
σ6.815-6.891=-0.075
min1536.857-1536.762=0.095
max1552.224-1552.322=-0.098
mean1458.000-1638.000=-180.000
σ0.000
min1458.000-1638.000=-180.000
max1458.000-1638.000=-180.000
mean2.473-2.408=0.065
σ0.272-0.307=-0.035
min2.259-2.105=0.153
max2.931-2.854=0.077
iters=5
new-facts=6402
prior-facts=6402
mean1857.689-1857.710=-0.021
σ0.100-0.053=0.047
min1857.529-1857.644=-0.114
max1857.776-1857.777=-0.001
mean1738.400-1772.800=-34.400
σ222.165-170.120=52.045
min1458.000-1638.000=-180.000
max2021.000-2025.000=-4.000
mean3.030-2.887=0.142
σ0.198-0.054=0.144
min2.818-2.837=-0.019
max3.344-2.954=0.390

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.742-1.369=0.373
σ0.152-0.295=-0.143
min1.535-1.123=0.412
max1.892-1.882=0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.739=0.002
σ580.934-580.935=-0.001
min155.271-155.270=0.001
max1317.142-1317.141=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1458.000-1638.000=-180.000
σ0.000
min1458.000-1638.000=-180.000
max1458.000-1638.000=-180.000
mean0.545-0.551=-0.006
σ0.572-0.575=-0.003
min0.259-0.261=-0.003
max1.403-1.413=-0.010
policies=20
mean1552.986-1552.991=-0.005
σ0.341-0.330=0.011
min1552.753-1552.763=-0.010
max1553.492-1553.480=0.012
mean920.000
σ0.000
min920.000
max920.000
mean1458.000-1638.000=-180.000
σ0.000
min1458.000-1638.000=-180.000
max1458.000-1638.000=-180.000
mean2.610-2.586=0.024
σ0.029-0.011=0.018
min2.584-2.579=0.005
max2.641-2.603=0.038
policies=200
mean15537.959-15538.070=-0.111
σ0.078-0.111=-0.033
min15537.896-15537.948=-0.053
max15538.072-15538.213=-0.141
mean9200.000
σ0.000
min9200.000
max9200.000
mean1458.000-1638.000=-180.000
σ0.000
min1458.000-1638.000=-180.000
max1458.000-1638.000=-180.000
mean26.243-26.149=0.094
σ0.081-0.140=-0.060
min26.152-26.021=0.131
max26.345-26.349=-0.004