Compare commits

Home / Compare 0a07d60e .. a8b62607

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.056=0.000
σ0.369-0.369=0.001
min53.916-53.910=0.006
max55.107-55.105=0.002
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.137-0.140=-0.002
σ0.005-0.005=0.000
min0.132-0.135=-0.004
max0.148-0.149=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=0.000
σ0.006-0.007=-0.001
min43.387-43.384=0.002
max43.407-43.406=0.001
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.121-0.121=0.000
σ0.004-0.005=-0.001
min0.116-0.114=0.002
max0.127-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.961-1006.963=-0.002
σ0.897-0.867=0.030
min1006.475-1006.466=0.009
max1010.684-1010.547=0.137
mean1054.350-1039.450=14.900
σ308.223-301.261=6.962
min577.000-549.000=28.000
max1619.000-1586.000=33.000
mean1.552-1.548=0.004
σ0.056-0.068=-0.012
min1.496-1.490=0.006
max1.689-1.773=-0.084

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.000
σ0.003-0.003=-0.001
min0.882
max0.887-0.889=-0.002
mean1619.000-1586.000=33.000
σ0.000
min1619.000-1586.000=33.000
max1619.000-1586.000=33.000
mean0.414-0.421=-0.006
σ0.131-0.147=-0.016
min0.330-0.325=0.005
max0.646-0.679=-0.033
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.003=-0.001
min2.337
max2.342-2.344=-0.002
mean1619.000-1586.000=33.000
σ0.000
min1619.000-1586.000=33.000
max1619.000-1586.000=33.000
mean0.882-0.908=-0.026
σ0.094-0.095=-0.001
min0.827-0.847=-0.019
max1.047-1.074=-0.026
name=heavy_item.art
mean1.524-1.524=-0.000
σ0.002-0.002=-0.000
min1.522
max1.526-1.527=-0.000
mean1619.000-1586.000=33.000
σ0.000
min1619.000-1586.000=33.000
max1619.000-1586.000=33.000
mean0.543-0.545=-0.003
σ0.052-0.050=0.003
min0.492-0.510=-0.018
max0.627-0.630=-0.003
name=nested_use.art
mean2.361-2.361=-0.000
σ0.002-0.002=-0.001
min2.360
max2.364-2.366=-0.002
mean1619.000-1586.000=33.000
σ0.000
min1619.000-1586.000=33.000
max1619.000-1586.000=33.000
mean0.840-0.849=-0.009
σ0.045-0.046=-0.000
min0.799-0.804=-0.005
max0.917-0.922=-0.005

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.832=0.007
σ0.032-0.028=0.004
min964.812-964.802=0.010
max964.894-964.870=0.024
mean1619.000-1586.000=33.000
σ0.000
min1619.000-1586.000=33.000
max1619.000-1586.000=33.000
mean0.842-0.843=-0.001
σ0.023-0.029=-0.006
min0.800-0.794=0.007
max0.859-0.869=-0.010
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.004-0.007=-0.003
min885.505-885.504=0.001
max885.515-885.521=-0.005
mean1619.000-1586.000=33.000
σ0.000
min1619.000-1586.000=33.000
max1619.000-1586.000=33.000
mean0.738-0.673=0.065
σ0.003-0.053=-0.050
min0.735-0.619=0.116
max0.742-0.738=0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716
σ0.002-0.002=0.000
min7.715
max7.722-7.722=0.000
mean1619.000-1586.000=33.000
σ0.000
min1619.000-1586.000=33.000
max1619.000-1586.000=33.000
mean4.268-4.277=-0.010
σ0.104-0.095=0.010
min4.114-4.124=-0.010
max4.959-4.551=0.408
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1619.000-1586.000=33.000
σ0.000
min1619.000-1586.000=33.000
max1619.000-1586.000=33.000
mean4.237-4.237=0.000
σ0.082-0.071=0.011
min4.095-4.122=-0.027
max4.516-4.506=0.010
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1619.000-1586.000=33.000
σ0.000
min1619.000-1586.000=33.000
max1619.000-1586.000=33.000
mean0.748-0.743=0.005
σ0.021-0.019=0.002
min0.710-0.700=0.011
max0.873-0.852=0.021
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1619.000-1586.000=33.000
σ0.000
min1619.000-1586.000=33.000
max1619.000-1586.000=33.000
mean0.713-0.706=0.006
σ0.026-0.015=0.011
min0.528-0.673=-0.144
max0.786-0.788=-0.002

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.377-295.669=-0.292
σ0.169-0.212=-0.043
min295.228-295.528=-0.301
max295.812-296.249=-0.437
mean2026.000-1907.000=119.000
σ0.000
min2026.000-1907.000=119.000
max2026.000-1907.000=119.000
mean0.534-0.582=-0.048
σ0.032-0.049=-0.016
min0.498-0.517=-0.019
max0.574-0.656=-0.082

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.393-285.399=-0.006
σ0.038-0.039=-0.001
min285.348-285.347=0.000
max285.442-285.441=0.001
mean1619.000-1586.000=33.000
σ0.000
min1619.000-1586.000=33.000
max1619.000-1586.000=33.000
mean0.388-0.390=-0.002
σ0.006-0.009=-0.003
min0.381-0.381=0.000
max0.394-0.402=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1295.739-1295.774=-0.035
σ0.119-0.112=0.007
min1295.653-1295.661=-0.008
max1295.932-1295.914=0.018
mean1619.000-1586.000=33.000
σ0.000
min1619.000-1586.000=33.000
max1619.000-1586.000=33.000
mean1.954-1.914=0.040
σ0.190-0.098=0.092
min1.800-1.810=-0.010
max2.258-2.039=0.219
iters=5
new-facts=6402
prior-facts=1
mean1539.957-1539.951=0.006
σ6.792-6.838=-0.046
min1536.804-1536.690=0.114
max1552.105-1552.178=-0.073
mean1619.000-1586.000=33.000
σ0.000
min1619.000-1586.000=33.000
max1619.000-1586.000=33.000
mean2.302-2.378=-0.076
σ0.263-0.282=-0.019
min2.096-2.024=0.072
max2.746-2.751=-0.005
iters=5
new-facts=6402
prior-facts=6402
mean1857.689-1857.682=0.007
σ0.055-0.066=-0.011
min1857.619-1857.605=0.014
max1857.759-1857.775=-0.015
mean1764.600-1763.600=1.000
σ178.071-143.930=34.141
min1619.000-1586.000=33.000
max2026.000-1907.000=119.000
mean2.927-3.083=-0.156
σ0.151-0.298=-0.147
min2.817-2.868=-0.050
max3.173-3.606=-0.433

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.287-1.347=-0.060
σ0.313-0.352=-0.039
min1.060-0.942=0.118
max1.825-1.737=0.088

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.707-445.707=-0.000
σ580.933-580.934=-0.001
min155.239-155.239=0.000
max1317.107-1317.108=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1619.000-1586.000=33.000
σ0.000
min1619.000-1586.000=33.000
max1619.000-1586.000=33.000
mean0.534-0.537=-0.002
σ0.556-0.550=0.006
min0.255-0.255=0.000
max1.368-1.362=0.007
policies=20
mean1552.659-1552.656=0.002
σ0.331-0.333=-0.002
min1552.430-1552.423=0.007
max1553.150-1553.150=-0.000
mean920.000
σ0.000
min920.000
max920.000
mean1619.000-1586.000=33.000
σ0.000
min1619.000-1586.000=33.000
max1619.000-1586.000=33.000
mean2.590-2.593=-0.003
σ0.022-0.024=-0.002
min2.561-2.572=-0.010
max2.612-2.626=-0.014
policies=200
mean15534.644-15534.642=0.002
σ0.176-0.059=0.116
min15534.463-15534.582=-0.120
max15534.884-15534.716=0.168
mean9200.000
σ0.000
min9200.000
max9200.000
mean1619.000-1586.000=33.000
σ0.000
min1619.000-1586.000=33.000
max1619.000-1586.000=33.000
mean26.123-26.075=0.048
σ0.161-0.033=0.127
min25.899-26.041=-0.141
max26.280-26.113=0.166