Compare commits

Home / Compare aa4e39b7 .. fb28ab51

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.056=-0.001
σ0.367-0.368=-0.002
min53.912-53.913=-0.001
max55.098-55.104=-0.007
mean417.000
σ0.000
min417.000
max417.000
mean0.138-0.139=-0.001
σ0.004-0.004=0.000
min0.132-0.136=-0.004
max0.144-0.146=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=-0.000
σ0.007-0.006=0.000
min43.384-43.384=0.000
max43.403-43.406=-0.003
mean417.000
σ0.000
min417.000
max417.000
mean0.122-0.121=0.000
σ0.004-0.005=-0.001
min0.116-0.114=0.001
max0.128-0.130=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.978-1006.982=-0.004
σ0.873-0.859=0.014
min1006.482-1006.481=0.001
max1010.595-1010.530=0.065
mean1047.200-1046.650=0.550
σ314.257-306.025=8.232
min577.000-578.000=-1.000
max1644.000-1663.000=-19.000
mean1.528-1.528=0.000
σ0.055-0.081=-0.026
min1.460-1.423=0.036
max1.650-1.791=-0.141

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.001
σ0.002-0.003=-0.000
min0.882
max0.887
mean1644.000-1663.000=-19.000
σ0.000
min1644.000-1663.000=-19.000
max1644.000-1663.000=-19.000
mean0.399-0.402=-0.004
σ0.095-0.105=-0.010
min0.342-0.346=-0.004
max0.564-0.590=-0.025
name=error_case.art
mean2.339-2.339=0.001
σ0.003-0.003=-0.000
min2.337
max2.342
mean1644.000-1663.000=-19.000
σ0.000
min1644.000-1663.000=-19.000
max1644.000-1663.000=-19.000
mean0.885-0.892=-0.007
σ0.088-0.087=0.001
min0.821-0.827=-0.006
max1.039-1.042=-0.003
name=heavy_item.art
mean1.523-1.524=-0.001
σ0.001-0.002=-0.001
min1.522
max1.525-1.526=-0.001
mean1644.000-1663.000=-19.000
σ0.000
min1644.000-1663.000=-19.000
max1644.000-1663.000=-19.000
mean0.531-0.541=-0.010
σ0.058-0.044=0.014
min0.483-0.498=-0.015
max0.624-0.612=0.012
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=0.000
min2.360
max2.364
mean1644.000-1663.000=-19.000
σ0.000
min1644.000-1663.000=-19.000
max1644.000-1663.000=-19.000
mean0.844-0.877=-0.033
σ0.038-0.042=-0.004
min0.801-0.853=-0.052
max0.904-0.949=-0.045

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.835-964.833=0.002
σ0.031-0.022=0.009
min964.811-964.810=0.001
max964.888-964.862=0.026
mean1644.000-1663.000=-19.000
σ0.000
min1644.000-1663.000=-19.000
max1644.000-1663.000=-19.000
mean0.785-0.828=-0.043
σ0.032-0.031=0.002
min0.738-0.782=-0.043
max0.815-0.855=-0.040
name=cdr_enhanced_4k_loc.art
mean885.514-885.511=0.004
σ0.007-0.009=-0.002
min885.504
max885.521-885.524=-0.004
mean1644.000-1663.000=-19.000
σ0.000
min1644.000-1663.000=-19.000
max1644.000-1663.000=-19.000
mean0.697-0.718=-0.021
σ0.071-0.046=0.025
min0.603-0.636=-0.034
max0.752-0.745=0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716
σ0.002
min7.715
max7.719
mean1644.000-1663.000=-19.000
σ0.000
min1644.000-1663.000=-19.000
max1644.000-1663.000=-19.000
mean4.279-4.224=0.056
σ0.079-0.079=0.000
min4.160-4.094=0.066
max4.554-4.529=0.026
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=-0.000
min7.664
max7.669-7.669=-0.000
mean1644.000-1663.000=-19.000
σ0.000
min1644.000-1663.000=-19.000
max1644.000-1663.000=-19.000
mean4.238-4.257=-0.019
σ0.056-0.085=-0.029
min4.110-4.052=0.057
max4.393-4.485=-0.092
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1644.000-1663.000=-19.000
σ0.000
min1644.000-1663.000=-19.000
max1644.000-1663.000=-19.000
mean0.753-0.748=0.005
σ0.017-0.022=-0.006
min0.724-0.619=0.105
max0.850-0.849=0.001
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1644.000-1663.000=-19.000
σ0.000
min1644.000-1663.000=-19.000
max1644.000-1663.000=-19.000
mean0.713-0.711=0.002
σ0.015-0.016=-0.001
min0.683-0.682=0.001
max0.777-0.808=-0.031

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.655-295.627=0.028
σ0.205-0.214=-0.009
min295.506-295.426=0.081
max296.216-296.182=0.034
mean1930.000-1893.000=37.000
σ0.000
min1930.000-1893.000=37.000
max1930.000-1893.000=37.000
mean0.574-0.577=-0.003
σ0.052-0.040=0.013
min0.499-0.509=-0.010
max0.694-0.623=0.071

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.410-285.405=0.005
σ0.034-0.038=-0.005
min285.367-285.355=0.012
max285.446-285.445=0.001
mean1644.000-1663.000=-19.000
σ0.000
min1644.000-1663.000=-19.000
max1644.000-1663.000=-19.000
mean0.387-0.388=-0.001
σ0.010-0.005=0.005
min0.378-0.381=-0.003
max0.398-0.393=0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.795-1295.781=0.014
σ0.102-0.115=-0.013
min1295.678-1295.672=0.006
max1295.912-1295.974=-0.063
mean1644.000-1663.000=-19.000
σ0.000
min1644.000-1663.000=-19.000
max1644.000-1663.000=-19.000
mean1.892-2.028=-0.136
σ0.085-0.200=-0.115
min1.789-1.804=-0.015
max1.977-2.234=-0.257
iters=5
new-facts=6402
prior-facts=1
mean1539.984-1540.019=-0.036
σ6.841-6.812=0.028
min1536.742-1536.855=-0.114
max1552.216-1552.204=0.012
mean1644.000-1663.000=-19.000
σ0.000
min1644.000-1663.000=-19.000
max1644.000-1663.000=-19.000
mean2.432-2.409=0.023
σ0.277-0.195=0.082
min2.160-2.146=0.014
max2.829-2.589=0.240
iters=5
new-facts=6402
prior-facts=6402
mean1857.709-1857.693=0.016
σ0.051-0.052=-0.001
min1857.660-1857.650=0.010
max1857.779-1857.771=0.008
mean1780.800-1778.200=2.600
σ143.670-115.001=28.670
min1644.000-1663.000=-19.000
max1930.000-1893.000=37.000
mean3.005-3.041=-0.036
σ0.126-0.246=-0.120
min2.853-2.856=-0.003
max3.168-3.449=-0.280

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.325-1.427=-0.102
σ0.216-0.123=0.092
min1.105-1.296=-0.191
max1.686-1.625=0.061

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.741=-0.000
σ580.934-580.934=-0.000
min155.272-155.273=-0.000
max1317.142-1317.142=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1644.000-1663.000=-19.000
σ0.000
min1644.000-1663.000=-19.000
max1644.000-1663.000=-19.000
mean0.564-0.547=0.016
σ0.603-0.574=0.029
min0.262-0.258=0.004
max1.468-1.408=0.060
policies=20
mean1552.979-1552.981=-0.002
σ0.333-0.324=0.009
min1552.750-1552.765=-0.015
max1553.473-1553.462=0.011
mean920.000
σ0.000
min920.000
max920.000
mean1644.000-1663.000=-19.000
σ0.000
min1644.000-1663.000=-19.000
max1644.000-1663.000=-19.000
mean2.592-2.583=0.009
σ0.011-0.019=-0.009
min2.579-2.561=0.017
max2.601-2.608=-0.006
policies=200
mean15537.969-15537.997=-0.028
σ0.053-0.102=-0.049
min15537.891-15537.851=0.039
max15538.003-15538.089=-0.086
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000-1663.000=-19.000
σ0.000
min1644.000-1663.000=-19.000
max1644.000-1663.000=-19.000
mean26.116-26.146=-0.030
σ0.163-0.091=0.072
min25.921-26.047=-0.126
max26.319-26.263=0.056