Compare commits

Home / Compare ed5de2c8 .. a675794a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.045-54.056=-0.010
σ0.370-0.368=0.002
min53.900-53.910=-0.010
max55.097-55.101=-0.004
mean414.700-416.000=-1.300
σ0.483-0.000=0.483
min414.000-416.000=-2.000
max415.000-416.000=-1.000
mean0.140-0.140=0.000
σ0.003-0.004=-0.001
min0.137-0.136=0.000
max0.146-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.384-43.394=-0.010
σ0.007-0.007=0.000
min43.371-43.382=-0.011
max43.396-43.403=-0.007
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.122-0.122=-0.000
σ0.004-0.004=0.001
min0.116-0.118=-0.002
max0.129-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.981=-0.002
σ0.864-0.861=0.004
min1006.508-1006.482=0.026
max1010.554-1010.535=0.018
mean1052.700-1051.600=1.100
σ319.840-310.935=8.905
min576.000-555.000=21.000
max1620.000-1649.000=-29.000
mean1.563-1.547=0.016
σ0.129-0.071=0.058
min1.479-1.482=-0.003
max2.084-1.761=0.324

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean0.438-0.421=0.017
σ0.182-0.142=0.040
min0.337-0.344=-0.007
max0.762-0.674=0.088
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean0.913-0.875=0.038
σ0.145-0.084=0.061
min0.825-0.815=0.010
max1.169-1.022=0.147
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean0.544-0.533=0.011
σ0.042-0.052=-0.009
min0.512-0.477=0.035
max0.615-0.617=-0.002
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean0.850-0.843=0.007
σ0.029-0.039=-0.009
min0.822-0.815=0.008
max0.895-0.909=-0.014

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.836=-0.005
σ0.025-0.031=-0.006
min964.802-964.811=-0.009
max964.862-964.889=-0.027
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean0.803-0.804=-0.001
σ0.019-0.018=0.001
min0.772-0.777=-0.006
max0.821-0.826=-0.005
name=cdr_enhanced_4k_loc.art
mean885.514-885.512=0.001
σ0.005-0.004=0.001
min885.505-885.508=-0.002
max885.518-885.517=0.001
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean0.707-0.693=0.014
σ0.044-0.063=-0.019
min0.646-0.588=0.058
max0.746-0.748=-0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.720=-0.001
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean4.251-4.197=0.054
σ0.088-0.075=0.012
min4.086-4.029=0.057
max4.524-4.505=0.019
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.668
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean4.256-4.198=0.057
σ0.088-0.073=0.015
min4.096-4.059=0.037
max4.660-4.421=0.238
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean0.653-0.738=-0.085
σ0.105-0.019=0.086
min0.519-0.703=-0.184
max0.887-0.870=0.016
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean0.511-0.696=-0.186
σ0.028-0.014=0.014
min0.481-0.671=-0.190
max0.752-0.781=-0.030

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.651-295.480=0.171
σ0.231-0.259=-0.028
min295.496-295.322=0.173
max296.283-296.201=0.081
mean1924.000-2019.000=-95.000
σ0.000
min1924.000-2019.000=-95.000
max1924.000-2019.000=-95.000
mean0.586-0.532=0.055
σ0.025-0.039=-0.014
min0.538-0.495=0.043
max0.636-0.598=0.039

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.413-285.412=0.001
σ0.036-0.043=-0.007
min285.371-285.354=0.017
max285.455-285.455=-0.000
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean0.395-0.388=0.007
σ0.007-0.008=-0.001
min0.388-0.380=0.009
max0.404-0.399=0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.796-1295.806=-0.010
σ0.114-0.112=0.002
min1295.667-1295.677=-0.010
max1295.931-1295.947=-0.015
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean1.882-1.876=0.006
σ0.064-0.086=-0.023
min1.824-1.805=0.019
max1.978-2.018=-0.040
iters=5
new-facts=6402
prior-facts=1
mean1539.924-1539.916=0.008
σ6.875-6.867=0.007
min1536.635-1536.654=-0.020
max1552.218-1552.197=0.022
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean2.267-2.210=0.057
σ0.255-0.180=0.074
min2.050-2.037=0.013
max2.666-2.429=0.237
iters=5
new-facts=6402
prior-facts=6402
mean1857.710-1857.708=0.001
σ0.053-0.055=-0.002
min1857.645-1857.649=-0.004
max1857.775-1857.776=-0.001
mean1779.800-1776.000=3.800
σ145.819-162.779=-16.960
min1620.000-1649.000=-29.000
max1924.000-2019.000=-95.000
mean3.128-3.028=0.100
σ0.310-0.332=-0.022
min2.857-2.828=0.029
max3.656-3.613=0.043

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.385-1.315=0.071
σ0.200-0.320=-0.120
min1.257-1.104=0.153
max1.733-1.872=-0.140

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.741=-0.001
σ580.934-580.934=0.000
min155.271-155.272=-0.001
max1317.141-1317.142=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean0.556-0.526=0.030
σ0.597-0.529=0.068
min0.255-0.256=-0.001
max1.451-1.320=0.132
policies=20
mean1552.990-1552.986=0.004
σ0.327-0.323=0.004
min1552.763-1552.761=0.002
max1553.475-1553.465=0.010
mean920.000
σ0.000
min920.000
max920.000
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean2.583-2.586=-0.003
σ0.013-0.018=-0.006
min2.573-2.568=0.005
max2.601-2.604=-0.002
policies=200
mean15537.960-15537.947=0.014
σ0.096-0.070=0.025
min15537.859-15537.875=-0.017
max15538.051-15538.014=0.037
mean9200.000
σ0.000
min9200.000
max9200.000
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean26.286-26.096=0.190
σ0.032-0.184=-0.153
min26.248-25.939=0.309
max26.317-26.363=-0.047