Compare commits

Home / Compare 7442ccaa .. 59c94a78

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.054=0.002
σ0.370-0.369=0.001
min53.905-53.910=-0.005
max55.107-55.102=0.005
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.141-0.140=0.002
σ0.004-0.005=-0.001
min0.138-0.133=0.005
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=-0.001
σ0.005-0.006=-0.001
min43.388-43.386=0.002
max43.404-43.405=-0.000
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.123-0.122=0.001
σ0.004-0.004=-0.000
min0.120-0.118=0.001
max0.129-0.129=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1007.003=0.002
σ1.189-1.235=-0.047
min1006.432-1006.464=-0.032
max1011.987-1012.189=-0.202
mean1051.300-1038.950=12.350
σ308.476-298.309=10.167
min577.000-581.000=-4.000
max1639.000-1584.000=55.000
mean1.531-1.579=-0.048
σ0.069-0.115=-0.046
min1.473-1.487=-0.014
max1.740-1.940=-0.200

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1639.000-1584.000=55.000
σ0.000
min1639.000-1584.000=55.000
max1639.000-1584.000=55.000
mean0.428-0.412=0.017
σ0.138-0.123=0.014
min0.345-0.342=0.003
max0.672-0.631=0.041
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1639.000-1584.000=55.000
σ0.000
min1639.000-1584.000=55.000
max1639.000-1584.000=55.000
mean0.896-0.879=0.017
σ0.098-0.084=0.015
min0.831-0.829=0.002
max1.069-1.026=0.042
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1639.000-1584.000=55.000
σ0.000
min1639.000-1584.000=55.000
max1639.000-1584.000=55.000
mean0.548-0.527=0.021
σ0.054-0.051=0.003
min0.502-0.489=0.013
max0.641-0.616=0.025
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1639.000-1584.000=55.000
σ0.000
min1639.000-1584.000=55.000
max1639.000-1584.000=55.000
mean0.864-0.835=0.028
σ0.041-0.041=0.000
min0.840-0.801=0.039
max0.937-0.904=0.033

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.837-964.840=-0.003
σ0.036-0.034=0.001
min964.811-964.812=-0.001
max964.896-964.896=0.001
mean1639.000-1584.000=55.000
σ0.000
min1639.000-1584.000=55.000
max1639.000-1584.000=55.000
mean0.847-0.824=0.024
σ0.016-0.036=-0.019
min0.820-0.769=0.051
max0.862-0.860=0.002
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.007-0.008=-0.001
min885.504
max885.521-885.522=-0.001
mean1639.000-1584.000=55.000
σ0.000
min1639.000-1584.000=55.000
max1639.000-1584.000=55.000
mean0.715-0.692=0.023
σ0.058-0.058=-0.000
min0.612-0.600=0.011
max0.742-0.742=0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.720=0.002
mean1639.000-1584.000=55.000
σ0.000
min1639.000-1584.000=55.000
max1639.000-1584.000=55.000
mean4.216-4.234=-0.017
σ0.078-0.086=-0.008
min4.080-4.083=-0.004
max4.524-4.519=0.005
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1639.000-1584.000=55.000
σ0.000
min1639.000-1584.000=55.000
max1639.000-1584.000=55.000
mean4.256-4.244=0.012
σ0.087-0.080=0.007
min4.138-4.069=0.069
max4.556-4.642=-0.086
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1639.000-1584.000=55.000
σ0.000
min1639.000-1584.000=55.000
max1639.000-1584.000=55.000
mean0.739-0.730=0.009
σ0.049-0.026=0.024
min0.531-0.548=-0.017
max0.869-0.852=0.018
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1639.000-1584.000=55.000
σ0.000
min1639.000-1584.000=55.000
max1639.000-1584.000=55.000
mean0.709-0.693=0.017
σ0.014-0.014=-0.001
min0.685-0.662=0.023
max0.777-0.756=0.021

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.969-297.063=-0.094
σ0.214-0.222=-0.008
min296.765-296.924=-0.159
max297.508-297.671=-0.163
mean1924.000-1898.000=26.000
σ0.000
min1924.000-1898.000=26.000
max1924.000-1898.000=26.000
mean0.593-0.574=0.019
σ0.026-0.044=-0.018
min0.560-0.486=0.074
max0.657-0.619=0.038

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.819-286.821=-0.002
σ0.036-0.038=-0.002
min286.769-286.776=-0.007
max286.858-286.862=-0.003
mean1639.000-1584.000=55.000
σ0.000
min1639.000-1584.000=55.000
max1639.000-1584.000=55.000
mean0.396-0.395=0.002
σ0.007-0.007=-0.000
min0.388-0.389=-0.001
max0.401-0.402=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1297.266-1297.247=0.020
σ0.084-0.135=-0.050
min1297.142-1297.046=0.097
max1297.367-1297.408=-0.041
mean1639.000-1584.000=55.000
σ0.000
min1639.000-1584.000=55.000
max1639.000-1584.000=55.000
mean2.214-2.215=-0.001
σ0.071-0.056=0.015
min2.141-2.138=0.003
max2.324-2.274=0.051
iters=5
new-facts=6402
prior-facts=1
mean1541.425-1541.394=0.031
σ6.775-6.790=-0.015
min1538.282-1538.234=0.047
max1553.542-1553.539=0.003
mean1639.000-1584.000=55.000
σ0.000
min1639.000-1584.000=55.000
max1639.000-1584.000=55.000
mean2.440-2.350=0.090
σ0.148-0.266=-0.118
min2.272-2.078=0.195
max2.630-2.770=-0.140
iters=5
new-facts=6402
prior-facts=6402
mean1859.119-1859.114=0.006
σ0.069-0.067=0.002
min1859.036-1859.025=0.012
max1859.193-1859.193=0.000
mean1776.600-1756.400=20.200
σ142.921-140.969=1.951
min1639.000-1584.000=55.000
max1924.000-1898.000=26.000
mean2.959-3.072=-0.113
σ0.122-0.316=-0.194
min2.834-2.761=0.073
max3.111-3.549=-0.438

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.248-1.257=-0.009
σ0.327-0.347=-0.020
min0.930-0.932=-0.002
max1.788-1.768=0.021

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.822=-0.000
σ581.372-581.372=-0.000
min158.132-158.135=-0.003
max1320.879-1320.880=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1639.000-1584.000=55.000
σ0.000
min1639.000-1584.000=55.000
max1639.000-1584.000=55.000
mean0.549-0.546=0.003
σ0.561-0.571=-0.011
min0.264-0.253=0.012
max1.390-1.403=-0.013
policies=20
mean1581.626-1581.636=-0.009
σ0.355-0.372=-0.017
min1581.389-1581.388=0.001
max1582.154-1582.189=-0.035
mean920.000
σ0.000
min920.000
max920.000
mean1639.000-1584.000=55.000
σ0.000
min1639.000-1584.000=55.000
max1639.000-1584.000=55.000
mean2.639-2.663=-0.024
σ0.013-0.007=0.005
min2.632-2.654=-0.023
max2.658-2.670=-0.013
policies=200
mean15824.266-15824.191=0.075
σ0.142-0.069=0.073
min15824.145-15824.125=0.020
max15824.455-15824.276=0.178
mean9200.000
σ0.000
min9200.000
max9200.000
mean1639.000-1584.000=55.000
σ0.000
min1639.000-1584.000=55.000
max1639.000-1584.000=55.000
mean26.640-26.769=-0.130
σ0.061-0.068=-0.007
min26.551-26.690=-0.140
max26.685-26.855=-0.170