Compare commits

Home / Compare d08dcb12 .. 27f27d30

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.015=-0.001
σ0.369-0.368=0.001
min53.869-53.866=0.003
max55.064-55.063=0.002
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.137-0.138=-0.000
σ0.004-0.005=-0.001
min0.131-0.131=0.000
max0.144-0.147=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.001
σ0.007-0.005=0.002
min43.312-43.316=-0.004
max43.337-43.331=0.006
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.120-0.120=-0.000
σ0.005-0.005=0.000
min0.114-0.113=0.000
max0.128-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1006.310=-0.001
σ1.166-1.170=-0.004
min1005.761-1005.752=0.010
max1011.190-1011.205=-0.015
mean1049.650-1049.950=-0.300
σ313.721-305.798=7.923
min598.000-587.000=11.000
max1646.000-1645.000=1.000
mean1.546-1.537=0.008
σ0.081-0.065=0.017
min1.463-1.444=0.018
max1.765-1.666=0.099

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean0.429-0.416=0.013
σ0.130-0.140=-0.010
min0.340-0.334=0.006
max0.654-0.665=-0.011
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean0.877-0.893=-0.016
σ0.084-0.093=-0.010
min0.811-0.818=-0.007
max1.023-1.053=-0.031
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean0.539-0.547=-0.008
σ0.060-0.062=-0.002
min0.488-0.495=-0.007
max0.637-0.649=-0.012
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean0.856-0.852=0.004
σ0.049-0.035=0.013
min0.814-0.824=-0.010
max0.940-0.912=0.028

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114-964.115=-0.000
σ0.021-0.033=-0.012
min964.092-964.088=0.004
max964.139-964.170=-0.031
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean0.848-0.823=0.025
σ0.018-0.028=-0.010
min0.817-0.796=0.020
max0.862-0.857=0.004
name=cdr_enhanced_4k_loc.art
mean884.713-884.711=0.002
σ0.007-0.007=-0.001
min884.703
max884.722-884.722=0.000
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean0.706-0.704=0.002
σ0.032-0.046=-0.015
min0.673-0.633=0.040
max0.741-0.738=0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.719=-0.002
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean4.223-4.224=-0.002
σ0.072-0.081=-0.008
min4.067-4.090=-0.023
max4.466-4.514=-0.048
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean4.222-4.216=0.006
σ0.061-0.091=-0.030
min4.114-4.059=0.055
max4.384-4.537=-0.153
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean0.736-0.727=0.009
σ0.021-0.052=-0.031
min0.707-0.532=0.175
max0.863-0.862=0.001
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean0.683-0.613=0.069
σ0.016-0.097=-0.081
min0.653-0.491=0.162
max0.760-0.724=0.036

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.435-296.153=0.282
σ0.269-0.241=0.029
min296.146-295.899=0.247
max297.109-296.694=0.415
mean1920.000-1910.000=10.000
σ0.000
min1920.000-1910.000=10.000
max1920.000-1910.000=10.000
mean0.588-0.568=0.020
σ0.053-0.054=-0.001
min0.510-0.509=0.001
max0.712-0.690=0.023

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.655-284.696=-0.041
σ0.047-0.035=0.012
min284.605-284.648=-0.043
max284.705-284.734=-0.029
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean0.405-0.398=0.006
σ0.002-0.011=-0.009
min0.402-0.386=0.016
max0.408-0.409=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.076-1295.076=0.000
σ0.112-0.107=0.005
min1294.962-1294.961=0.001
max1295.217-1295.207=0.010
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean1.904-1.906=-0.002
σ0.101-0.127=-0.026
min1.793-1.733=0.059
max2.013-2.030=-0.016
iters=5
new-facts=6402
prior-facts=1
mean1539.187-1539.188=-0.001
σ6.865-6.853=0.012
min1535.939-1535.955=-0.016
max1551.464-1551.443=0.021
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean2.243-2.216=0.026
σ0.239-0.167=0.072
min2.036-2.052=-0.016
max2.583-2.403=0.180
iters=5
new-facts=6402
prior-facts=6402
mean1856.980-1856.986=-0.006
σ0.064-0.056=0.008
min1856.902-1856.942=-0.040
max1857.068-1857.069=-0.002
mean1778.400-1779.000=-0.600
σ136.583-130.535=6.047
min1646.000-1645.000=1.000
max1920.000-1910.000=10.000
mean3.062-3.069=-0.006
σ0.275-0.273=0.003
min2.873-2.856=0.017
max3.546-3.542=0.004

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.111-1.222=-0.111
σ0.336-0.347=-0.011
min0.919-0.932=-0.013
max1.706-1.807=-0.101

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.784=0.002
σ581.212-581.213=-0.000
min157.179-157.176=0.003
max1319.605-1319.603=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean0.534-0.541=-0.007
σ0.549-0.557=-0.008
min0.259-0.258=0.001
max1.357-1.376=-0.019
policies=20
mean1572.104-1572.082=0.021
σ0.349-0.354=-0.005
min1571.865-1571.845=0.020
max1572.622-1572.608=0.013
mean920.000
σ0.000
min920.000
max920.000
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean2.618-2.619=-0.001
σ0.021-0.004=0.017
min2.596-2.615=-0.019
max2.636-2.625=0.012
policies=200
mean15729.002-15728.992=0.010
σ0.041-0.106=-0.065
min15728.946-15728.861=0.085
max15729.041-15729.116=-0.075
mean9200.000
σ0.000
min9200.000
max9200.000
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean26.464-26.598=-0.134
σ0.117-0.220=-0.103
min26.350-26.418=-0.068
max26.625-26.912=-0.287