Compare commits

Home / Compare 6ecc5793 .. f662a385

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.963-53.965=-0.002
σ0.369-0.369=0.000
min53.820-53.824=-0.005
max55.014-55.015=-0.002
mean413.000
σ0.000
min413.000
max413.000
mean0.139-0.140=-0.001
σ0.003-0.004=-0.001
min0.135-0.136=-0.001
max0.146-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.001
σ0.007-0.006=0.000
min43.310-43.313=-0.003
max43.336-43.334=0.002
mean413.000
σ0.000
min413.000
max413.000
mean0.121-0.121=0.001
σ0.003-0.004=-0.001
min0.120-0.115=0.005
max0.130-0.129=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.514-1006.512=0.002
σ1.190-1.195=-0.004
min1005.969-1005.963=0.006
max1011.504-1011.517=-0.013
mean1048.400-1035.800=12.600
σ306.337-309.963=-3.626
min586.000-546.000=40.000
max1642.000-1502.000=140.000
mean1.565-1.556=0.009
σ0.080-0.074=0.005
min1.438-1.487=-0.048
max1.769-1.799=-0.030

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1642.000-1502.000=140.000
σ0.000
min1642.000-1502.000=140.000
max1642.000-1502.000=140.000
mean0.426-0.447=-0.020
σ0.155-0.137=0.018
min0.342-0.358=-0.015
max0.702-0.684=0.019
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1642.000-1502.000=140.000
σ0.000
min1642.000-1502.000=140.000
max1642.000-1502.000=140.000
mean0.891-0.893=-0.002
σ0.095-0.097=-0.003
min0.831-0.833=-0.002
max1.058-1.065=-0.007
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1642.000-1502.000=140.000
σ0.000
min1642.000-1502.000=140.000
max1642.000-1502.000=140.000
mean0.539-0.535=0.004
σ0.038-0.047=-0.009
min0.507-0.491=0.016
max0.600-0.608=-0.008
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1642.000-1502.000=140.000
σ0.000
min1642.000-1502.000=140.000
max1642.000-1502.000=140.000
mean0.848-0.851=-0.003
σ0.035-0.033=0.002
min0.814-0.829=-0.014
max0.906-0.909=-0.004

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.829=0.011
σ0.034-0.037=-0.003
min964.812-964.807=0.005
max964.895-964.893=0.002
mean1642.000-1502.000=140.000
σ0.000
min1642.000-1502.000=140.000
max1642.000-1502.000=140.000
mean0.830-0.841=-0.011
σ0.031-0.027=0.004
min0.785-0.809=-0.024
max0.856-0.871=-0.016
name=cdr_enhanced_4k_loc.art
mean885.512-885.510=0.002
σ0.008-0.007=0.001
min885.504
max885.523-885.521=0.003
mean1642.000-1502.000=140.000
σ0.000
min1642.000-1502.000=140.000
max1642.000-1502.000=140.000
mean0.691-0.696=-0.006
σ0.056-0.048=0.008
min0.609-0.634=-0.025
max0.745-0.745=0.000

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721
mean1642.000-1502.000=140.000
σ0.000
min1642.000-1502.000=140.000
max1642.000-1502.000=140.000
mean4.230-4.215=0.015
σ0.084-0.083=0.000
min4.097-4.087=0.010
max4.521-4.479=0.042
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1642.000-1502.000=140.000
σ0.000
min1642.000-1502.000=140.000
max1642.000-1502.000=140.000
mean4.176-4.202=-0.026
σ0.066-0.085=-0.019
min4.061-4.083=-0.023
max4.353-4.454=-0.101
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1642.000-1502.000=140.000
σ0.000
min1642.000-1502.000=140.000
max1642.000-1502.000=140.000
mean0.741-0.742=-0.001
σ0.020-0.017=0.002
min0.708-0.710=-0.002
max0.848-0.856=-0.007
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1642.000-1502.000=140.000
σ0.000
min1642.000-1502.000=140.000
max1642.000-1502.000=140.000
mean0.700-0.535=0.165
σ0.014-0.071=-0.056
min0.665-0.485=0.180
max0.775-0.791=-0.015

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.382-296.379=0.003
σ0.295-0.225=0.069
min296.023-296.195=-0.172
max297.117-296.997=0.120
mean1896.000-2023.000=-127.000
σ0.000
min1896.000-2023.000=-127.000
max1896.000-2023.000=-127.000
mean0.581-0.557=0.024
σ0.053-0.029=0.024
min0.511-0.505=0.006
max0.709-0.583=0.126

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.039-285.035=0.004
σ0.028-0.039=-0.011
min285.009-284.984=0.024
max285.071-285.076=-0.005
mean1642.000-1502.000=140.000
σ0.000
min1642.000-1502.000=140.000
max1642.000-1502.000=140.000
mean0.396-0.394=0.002
σ0.005-0.007=-0.002
min0.389-0.385=0.003
max0.401-0.403=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.411-1295.420=-0.010
σ0.102-0.040=0.062
min1295.290-1295.382=-0.093
max1295.527-1295.482=0.045
mean1642.000-1502.000=140.000
σ0.000
min1642.000-1502.000=140.000
max1642.000-1502.000=140.000
mean1.902-2.022=-0.120
σ0.100-0.104=-0.004
min1.807-1.955=-0.149
max2.017-2.205=-0.188
iters=5
new-facts=6402
prior-facts=1
mean1539.595-1539.562=0.033
σ6.775-6.839=-0.064
min1536.389-1536.337=0.052
max1551.710-1551.794=-0.083
mean1642.000-1502.000=140.000
σ0.000
min1642.000-1502.000=140.000
max1642.000-1502.000=140.000
mean2.417-2.348=0.069
σ0.290-0.309=-0.019
min2.176-1.976=0.200
max2.896-2.690=0.205
iters=5
new-facts=6402
prior-facts=6402
mean1857.328-1857.317=0.012
σ0.054-0.078=-0.024
min1857.274-1857.197=0.077
max1857.402-1857.386=0.017
mean1774.000-1728.600=45.400
σ124.153-215.080=-90.927
min1642.000-1502.000=140.000
max1896.000-2023.000=-127.000
mean3.002-2.929=0.074
σ0.104-0.071=0.033
min2.854-2.861=-0.007
max3.111-3.033=0.077

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.223-1.553=-0.330
σ0.332-0.189=0.143
min0.936-1.250=-0.314
max1.779-1.740=0.039

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.191-448.192=-0.001
σ581.332-581.331=0.001
min157.521-157.524=-0.003
max1320.189-1320.189=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1642.000-1502.000=140.000
σ0.000
min1642.000-1502.000=140.000
max1642.000-1502.000=140.000
mean0.551-0.546=0.005
σ0.567-0.564=0.003
min0.266-0.260=0.006
max1.401-1.391=0.010
policies=20
mean1575.573-1575.568=0.005
σ0.361-0.353=0.008
min1575.332-1575.331=0.001
max1576.110-1576.093=0.017
mean920.000
σ0.000
min920.000
max920.000
mean1642.000-1502.000=140.000
σ0.000
min1642.000-1502.000=140.000
max1642.000-1502.000=140.000
mean2.640-2.625=0.014
σ0.010-0.016=-0.006
min2.628-2.610=0.019
max2.650-2.645=0.005
policies=200
mean15763.638-15763.758=-0.120
σ0.143-0.078=0.065
min15763.531-15763.699=-0.169
max15763.839-15763.866=-0.027
mean9200.000
σ0.000
min9200.000
max9200.000
mean1642.000-1502.000=140.000
σ0.000
min1642.000-1502.000=140.000
max1642.000-1502.000=140.000
mean26.600-26.573=0.026
σ0.031-0.047=-0.016
min26.565-26.507=0.057
max26.639-26.613=0.026