Compare commits

Home / Compare 7b808d5f .. 571cc8fe

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.047-54.045=0.003
σ0.371-0.368=0.003
min53.897-53.898=-0.002
max55.104-55.091=0.012
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.141-0.138=0.003
σ0.004-0.005=-0.001
min0.137-0.131=0.006
max0.147-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean43.383-43.385=-0.002
σ0.005-0.006=-0.001
min43.373-43.375=-0.002
max43.391-43.393=-0.002
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.120-0.122=-0.003
σ0.004-0.004=0.001
min0.114-0.119=-0.005
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.978-1006.978=-0.000
σ0.876-0.876=0.000
min1006.483-1006.482=0.001
max1010.610-1010.610=-0.000
mean1046.350-1053.800=-7.450
σ314.665-316.519=-1.854
min577.000-547.000=30.000
max1644.000-1634.000=10.000
mean1.550-1.550=-0.000
σ0.059-0.089=-0.029
min1.473-1.476=-0.003
max1.719-1.795=-0.077

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.001
σ0.002-0.003=-0.000
min0.882
max0.887
mean1644.000-1634.000=10.000
σ0.000
min1644.000-1634.000=10.000
max1644.000-1634.000=10.000
mean0.430-0.426=0.004
σ0.143-0.154=-0.011
min0.348-0.338=0.009
max0.683-0.696=-0.012
name=error_case.art
mean2.339-2.339=0.000
σ0.003-0.002=0.000
min2.337-2.337=-0.000
max2.342
mean1644.000-1634.000=10.000
σ0.000
min1644.000-1634.000=10.000
max1644.000-1634.000=10.000
mean0.881-0.938=-0.058
σ0.091-0.211=-0.119
min0.813-0.824=-0.011
max1.037-1.312=-0.275
name=heavy_item.art
mean1.523-1.524=-0.001
σ0.001-0.003=-0.001
min1.522
max1.525-1.528=-0.002
mean1644.000-1634.000=10.000
σ0.000
min1644.000-1634.000=10.000
max1644.000-1634.000=10.000
mean0.538-0.533=0.004
σ0.051-0.050=0.001
min0.499-0.496=0.004
max0.622-0.617=0.005
name=nested_use.art
mean2.362-2.362=0.001
σ0.002-0.002=0.000
min2.360
max2.364
mean1644.000-1634.000=10.000
σ0.000
min1644.000-1634.000=10.000
max1644.000-1634.000=10.000
mean0.849-0.845=0.004
σ0.036-0.035=0.000
min0.826-0.822=0.004
max0.909-0.905=0.004

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.835=-0.004
σ0.024-0.026=-0.002
min964.803-964.811=-0.008
max964.860-964.879=-0.019
mean1644.000-1634.000=10.000
σ0.000
min1644.000-1634.000=10.000
max1644.000-1634.000=10.000
mean0.841-0.824=0.017
σ0.027-0.044=-0.016
min0.806-0.769=0.038
max0.866-0.862=0.004
name=cdr_enhanced_4k_loc.art
mean885.514-885.513=0.001
σ0.008-0.005=0.002
min885.504
max885.524-885.518=0.006
mean1644.000-1634.000=10.000
σ0.000
min1644.000-1634.000=10.000
max1644.000-1634.000=10.000
mean0.724-0.711=0.012
σ0.034-0.025=0.009
min0.666-0.677=-0.010
max0.752-0.747=0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.720=0.001
mean1644.000-1634.000=10.000
σ0.000
min1644.000-1634.000=10.000
max1644.000-1634.000=10.000
mean4.255-4.288=-0.033
σ0.094-0.093=0.001
min4.108-4.168=-0.060
max4.687-4.669=0.018
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1644.000-1634.000=10.000
σ0.000
min1644.000-1634.000=10.000
max1644.000-1634.000=10.000
mean4.229-4.287=-0.058
σ0.082-0.086=-0.003
min4.100-4.131=-0.032
max4.527-4.620=-0.092
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1644.000-1634.000=10.000
σ0.000
min1644.000-1634.000=10.000
max1644.000-1634.000=10.000
mean0.746-0.742=0.004
σ0.024-0.017=0.007
min0.708-0.708=-0.000
max0.850-0.850=-0.000
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1644.000-1634.000=10.000
σ0.000
min1644.000-1634.000=10.000
max1644.000-1634.000=10.000
mean0.710-0.691=0.019
σ0.018-0.021=-0.003
min0.669-0.652=0.017
max0.775-0.774=0.001

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.583-295.574=0.009
σ0.268-0.228=0.041
min295.395-295.394=0.001
max296.309-296.183=0.126
mean1898.000-1913.000=-15.000
σ0.000
min1898.000-1913.000=-15.000
max1898.000-1913.000=-15.000
mean0.582-0.584=-0.002
σ0.037-0.034=0.003
min0.522-0.501=0.021
max0.668-0.615=0.053

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.417-285.408=0.009
σ0.034-0.036=-0.003
min285.371-285.359=0.013
max285.455-285.446=0.009
mean1644.000-1634.000=10.000
σ0.000
min1644.000-1634.000=10.000
max1644.000-1634.000=10.000
mean0.394-0.386=0.008
σ0.010-0.009=0.002
min0.381-0.381=0.000
max0.409-0.401=0.007
iters=5
new-facts=1
prior-facts=6402
mean1295.801-1295.792=0.009
σ0.113-0.098=0.015
min1295.679-1295.679=-0.000
max1295.940-1295.891=0.049
mean1644.000-1634.000=10.000
σ0.000
min1644.000-1634.000=10.000
max1644.000-1634.000=10.000
mean1.912-1.949=-0.037
σ0.094-0.137=-0.043
min1.808-1.812=-0.004
max2.024-2.131=-0.107
iters=5
new-facts=6402
prior-facts=1
mean1538.634-1538.655=-0.021
σ4.014-4.058=-0.044
min1536.620-1536.582=0.037
max1545.806-1545.905=-0.098
mean1644.000-1634.000=10.000
σ0.000
min1644.000-1634.000=10.000
max1644.000-1634.000=10.000
mean2.253-2.283=-0.030
σ0.192-0.353=-0.161
min2.026-2.028=-0.002
max2.437-2.891=-0.453
iters=5
new-facts=6402
prior-facts=6402
mean1857.702-1857.703=-0.001
σ0.056-0.054=0.002
min1857.638-1857.648=-0.010
max1857.780-1857.770=0.010
mean1772.600-1768.800=3.800
σ124.566-139.895=-15.329
min1644.000-1634.000=10.000
max1898.000-1913.000=-15.000
mean3.112-3.046=0.066
σ0.327-0.126=0.201
min2.881-2.862=0.019
max3.684-3.146=0.537

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.390-1.298=0.092
σ0.275-0.342=-0.067
min1.112-1.000=0.112
max1.840-1.880=-0.040

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.060-444.061=-0.001
σ577.574-577.575=-0.001
min155.271-155.273=-0.001
max1310.422-1310.424=-0.003
mean96.250
σ8.500
min92.000
max109.000
mean1644.000-1634.000=10.000
σ0.000
min1644.000-1634.000=10.000
max1644.000-1634.000=10.000
mean0.561-0.541=0.020
σ0.600-0.560=0.040
min0.256-0.260=-0.004
max1.461-1.381=0.080
policies=20
mean1552.985-1552.990=-0.005
σ0.325-0.324=0.001
min1552.755-1552.767=-0.012
max1553.467-1553.471=-0.003
mean920.000
σ0.000
min920.000
max920.000
mean1644.000-1634.000=10.000
σ0.000
min1644.000-1634.000=10.000
max1644.000-1634.000=10.000
mean2.587-2.590=-0.003
σ0.019-0.017=0.002
min2.564-2.572=-0.007
max2.605-2.610=-0.005
policies=200
mean15537.956-15538.053=-0.097
σ0.070-0.103=-0.034
min15537.887-15537.958=-0.071
max15538.030-15538.193=-0.162
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000-1634.000=10.000
σ0.000
min1644.000-1634.000=10.000
max1644.000-1634.000=10.000
mean26.142-26.132=0.010
σ0.120-0.073=0.046
min26.047-26.063=-0.016
max26.315-26.236=0.079