Compare commits

Home / Compare f24f0508 .. a20f1634

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.045-54.056=-0.011
σ0.370-0.367=0.002
min53.897-53.913=-0.017
max55.097-55.101=-0.004
mean421.000-414.000=7.000
σ0.000
min421.000-414.000=7.000
max421.000-414.000=7.000
mean0.140-0.140=0.000
σ0.005-0.004=0.001
min0.137-0.136=0.001
max0.151-0.146=0.005
cache=y
dps=1
iters=10
policies=100
mean43.384-43.392=-0.008
σ0.006-0.006=0.000
min43.374-43.381=-0.007
max43.392-43.399=-0.008
mean421.000-414.000=7.000
σ0.000
min421.000-414.000=7.000
max421.000-414.000=7.000
mean0.123-0.120=0.003
σ0.004-0.004=-0.000
min0.119-0.114=0.005
max0.131-0.125=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.982-1006.982=-0.000
σ0.869-0.863=0.006
min1006.481-1006.479=0.002
max1010.576-1010.542=0.034
mean1047.800-1045.900=1.900
σ313.972-313.687=0.285
min578.000-577.000=1.000
max1642.000-1639.000=3.000
mean1.528-1.554=-0.026
σ0.097-0.091=0.007
min1.344-1.478=-0.134
max1.777-1.827=-0.050

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.882
max0.887
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean0.421-0.409=0.012
σ0.133-0.137=-0.005
min0.333-0.333=0.000
max0.656-0.653=0.003
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean0.890-0.879=0.011
σ0.087-0.082=0.005
min0.826-0.815=0.011
max1.036-1.020=0.016
name=heavy_item.art
mean1.523
σ0.001
min1.522
max1.525
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean0.538-0.538=-0.000
σ0.046-0.050=-0.004
min0.496-0.502=-0.006
max0.615-0.623=-0.008
name=nested_use.art
mean2.362
σ0.002
min2.360
max2.364
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean0.862-0.846=0.017
σ0.041-0.036=0.004
min0.826-0.813=0.013
max0.927-0.905=0.022

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.830=0.000
σ0.025-0.025=0.000
min964.802
max964.863-964.862=0.000
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean0.830-0.800=0.030
σ0.039-0.052=-0.014
min0.781-0.722=0.059
max0.864-0.856=0.008
name=cdr_enhanced_4k_loc.art
mean885.514-885.514=0.000
σ0.004-0.004=-0.000
min885.508
max885.518-885.517=0.000
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean0.715-0.732=-0.018
σ0.024-0.010=0.014
min0.674-0.717=-0.043
max0.733-0.745=-0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.720=0.000
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean4.249-4.209=0.040
σ0.083-0.086=-0.003
min4.145-4.052=0.092
max4.633-4.706=-0.073
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean4.232-4.177=0.054
σ0.084-0.101=-0.017
min4.070-4.034=0.036
max4.570-4.576=-0.006
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean0.739-0.603=0.136
σ0.018-0.104=-0.086
min0.708-0.512=0.195
max0.854-0.857=-0.002
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean0.698-0.509=0.190
σ0.015-0.026=-0.011
min0.664-0.478=0.186
max0.788-0.649=0.139

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.428-295.495=-0.066
σ0.301-0.232=0.070
min295.143-295.380=-0.237
max296.194-296.148=0.046
mean1912.000-2027.000=-115.000
σ0.000
min1912.000-2027.000=-115.000
max1912.000-2027.000=-115.000
mean0.579-0.552=0.026
σ0.061-0.034=0.027
min0.501-0.502=-0.001
max0.710-0.591=0.119

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.401-285.412=-0.011
σ0.041-0.033=0.008
min285.351-285.366=-0.015
max285.443-285.444=-0.002
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean0.394-0.385=0.009
σ0.009-0.007=0.003
min0.383-0.380=0.003
max0.404-0.397=0.008
iters=5
new-facts=1
prior-facts=6402
mean1295.794-1295.803=-0.009
σ0.106-0.113=-0.007
min1295.675-1295.676=-0.001
max1295.921-1295.942=-0.022
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean1.982-1.892=0.090
σ0.134-0.097=0.037
min1.829-1.813=0.016
max2.183-2.046=0.137
iters=5
new-facts=6402
prior-facts=1
mean1539.966-1539.928=0.038
σ6.846-6.898=-0.052
min1536.677-1536.576=0.101
max1552.207-1552.260=-0.052
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean2.377-2.356=0.022
σ0.214-0.315=-0.101
min2.050-2.026=0.024
max2.627-2.759=-0.132
iters=5
new-facts=6402
prior-facts=6402
mean1857.704-1857.705=-0.001
σ0.057-0.051=0.006
min1857.652-1857.655=-0.004
max1857.786-1857.772=0.014
mean1773.200-1774.000=-0.800
σ134.437-170.490=-36.054
min1642.000-1639.000=3.000
max1912.000-2027.000=-115.000
mean3.045-2.844=0.201
σ0.184-0.126=0.058
min2.858-2.641=0.216
max3.350-2.962=0.388

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.369-1.356=0.013
σ0.286-0.280=0.006
min1.118-1.105=0.013
max1.861-1.836=0.025

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.742=-0.000
σ580.934-580.935=-0.001
min155.273-155.273=0.000
max1317.142-1317.144=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean0.545-0.542=0.004
σ0.564-0.564=-0.000
min0.260-0.255=0.005
max1.391-1.388=0.003
policies=20
mean1552.999-1552.976=0.023
σ0.345-0.311=0.035
min1552.763-1552.764=-0.002
max1553.512-1553.438=0.074
mean920.000
σ0.000
min920.000
max920.000
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean2.612-2.575=0.037
σ0.013-0.026=-0.013
min2.596-2.540=0.056
max2.628-2.596=0.031
policies=200
mean15538.022-15537.668=0.354
σ0.037-0.606=-0.569
min15537.997-15536.809=1.188
max15538.077-15538.227=-0.150
mean9200.000
σ0.000
min9200.000
max9200.000
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean26.511-26.099=0.412
σ0.229-0.188=0.042
min26.264-25.899=0.365
max26.818-26.330=0.488