Compare commits

Home / Compare f3c99d2b .. 7442ccaa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.054=-0.000
σ0.369-0.369=-0.000
min53.910-53.905=0.005
max55.102-55.102=-0.000
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.140-0.139=0.000
σ0.005-0.003=0.001
min0.133-0.137=-0.003
max0.146-0.146=0.000
cache=y
dps=1
iters=10
policies=100
mean43.393-43.397=-0.003
σ0.006-0.005=0.000
min43.386-43.389=-0.003
max43.405-43.408=-0.003
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.122-0.137=-0.016
σ0.004-0.008=-0.004
min0.118-0.124=-0.006
max0.129-0.148=-0.019

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.003-1007.000=0.003
σ1.235-1.237=-0.001
min1006.464-1006.464=-0.000
max1012.189-1012.194=-0.005
mean1038.950-1051.000=-12.050
σ298.309-307.658=-9.350
min581.000-576.000=5.000
max1584.000-1643.000=-59.000
mean1.579-1.572=0.007
σ0.115-0.078=0.037
min1.487-1.500=-0.014
max1.940-1.796=0.144

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1584.000-1643.000=-59.000
σ0.000
min1584.000-1643.000=-59.000
max1584.000-1643.000=-59.000
mean0.412-0.413=-0.002
σ0.123-0.140=-0.017
min0.342-0.331=0.011
max0.631-0.661=-0.030
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1584.000-1643.000=-59.000
σ0.000
min1584.000-1643.000=-59.000
max1584.000-1643.000=-59.000
mean0.879-0.888=-0.009
σ0.084-0.099=-0.015
min0.829-0.820=0.009
max1.026-1.060=-0.034
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1584.000-1643.000=-59.000
σ0.000
min1584.000-1643.000=-59.000
max1584.000-1643.000=-59.000
mean0.527-0.533=-0.006
σ0.051-0.056=-0.004
min0.489-0.487=0.003
max0.616-0.622=-0.006
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1584.000-1643.000=-59.000
σ0.000
min1584.000-1643.000=-59.000
max1584.000-1643.000=-59.000
mean0.835-0.864=-0.028
σ0.041-0.033=0.008
min0.801-0.826=-0.024
max0.904-0.915=-0.011

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.836=0.004
σ0.034-0.027=0.007
min964.812-964.816=-0.004
max964.896-964.881=0.014
mean1584.000-1643.000=-59.000
σ0.000
min1584.000-1643.000=-59.000
max1584.000-1643.000=-59.000
mean0.824-0.812=0.012
σ0.036-0.048=-0.013
min0.769-0.738=0.030
max0.860-0.856=0.004
name=cdr_enhanced_4k_loc.art
mean885.512-885.514=-0.001
σ0.008-0.006=0.002
min885.504-885.505=-0.001
max885.522-885.522=0.000
mean1584.000-1643.000=-59.000
σ0.000
min1584.000-1643.000=-59.000
max1584.000-1643.000=-59.000
mean0.692-0.717=-0.025
σ0.058-0.028=0.030
min0.600-0.668=-0.068
max0.742-0.737=0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.721=-0.000
mean1584.000-1643.000=-59.000
σ0.000
min1584.000-1643.000=-59.000
max1584.000-1643.000=-59.000
mean4.234-4.202=0.032
σ0.086-0.093=-0.007
min4.083-4.060=0.023
max4.519-4.559=-0.040
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1584.000-1643.000=-59.000
σ0.000
min1584.000-1643.000=-59.000
max1584.000-1643.000=-59.000
mean4.244-4.212=0.032
σ0.080-0.081=-0.000
min4.069-4.087=-0.018
max4.642-4.525=0.118
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1584.000-1643.000=-59.000
σ0.000
min1584.000-1643.000=-59.000
max1584.000-1643.000=-59.000
mean0.730-0.738=-0.007
σ0.026-0.023=0.003
min0.548-0.704=-0.156
max0.852-0.864=-0.012
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1584.000-1643.000=-59.000
σ0.000
min1584.000-1643.000=-59.000
max1584.000-1643.000=-59.000
mean0.693-0.698=-0.005
σ0.014-0.016=-0.002
min0.662-0.664=-0.002
max0.756-0.783=-0.027

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.063-296.937=0.126
σ0.222-0.208=0.014
min296.924-296.775=0.150
max297.671-297.501=0.170
mean1898.000-1902.000=-4.000
σ0.000
min1898.000-1902.000=-4.000
max1898.000-1902.000=-4.000
mean0.574-0.573=0.001
σ0.044-0.030=0.014
min0.486-0.507=-0.021
max0.619-0.616=0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.821-286.820=0.000
σ0.038-0.036=0.002
min286.776-286.772=0.004
max286.862-286.857=0.005
mean1584.000-1643.000=-59.000
σ0.000
min1584.000-1643.000=-59.000
max1584.000-1643.000=-59.000
mean0.395-0.401=-0.006
σ0.007-0.006=0.001
min0.389-0.391=-0.002
max0.402-0.406=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1297.247-1297.278=-0.031
σ0.135-0.093=0.042
min1297.046-1297.162=-0.116
max1297.408-1297.408=0.000
mean1584.000-1643.000=-59.000
σ0.000
min1584.000-1643.000=-59.000
max1584.000-1643.000=-59.000
mean2.215-2.269=-0.054
σ0.056-0.066=-0.010
min2.138-2.203=-0.065
max2.274-2.367=-0.093
iters=5
new-facts=6402
prior-facts=1
mean1541.394-1541.376=0.018
σ6.790-6.822=-0.032
min1538.234-1538.184=0.050
max1553.539-1553.578=-0.039
mean1584.000-1643.000=-59.000
σ0.000
min1584.000-1643.000=-59.000
max1584.000-1643.000=-59.000
mean2.350-2.295=0.054
σ0.266-0.152=0.115
min2.078-2.119=-0.041
max2.770-2.465=0.306
iters=5
new-facts=6402
prior-facts=6402
mean1859.114-1859.113=0.001
σ0.067-0.069=-0.002
min1859.025-1859.022=0.003
max1859.193-1859.197=-0.004
mean1756.400-1771.200=-14.800
σ140.969-125.494=15.475
min1584.000-1643.000=-59.000
max1898.000-1902.000=-4.000
mean3.072-3.105=-0.033
σ0.316-0.291=0.025
min2.761-2.859=-0.098
max3.549-3.600=-0.051

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.257-1.168=0.089
σ0.347-0.314=0.034
min0.932-0.934=-0.002
max1.768-1.689=0.079

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.820=0.002
σ581.372-581.373=-0.001
min158.135-158.130=0.005
max1320.880-1320.879=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1584.000-1643.000=-59.000
σ0.000
min1584.000-1643.000=-59.000
max1584.000-1643.000=-59.000
mean0.546-0.549=-0.003
σ0.571-0.565=0.007
min0.253-0.265=-0.012
max1.403-1.396=0.007
policies=20
mean1581.636-1581.625=0.010
σ0.372-0.378=-0.006
min1581.388-1581.372=0.016
max1582.189-1582.188=0.002
mean920.000
σ0.000
min920.000
max920.000
mean1584.000-1643.000=-59.000
σ0.000
min1584.000-1643.000=-59.000
max1584.000-1643.000=-59.000
mean2.663-2.663=0.000
σ0.007-0.025=-0.017
min2.654-2.638=0.016
max2.670-2.694=-0.024
policies=200
mean15824.191-15824.261=-0.070
σ0.069-0.116=-0.047
min15824.125-15824.153=-0.028
max15824.276-15824.411=-0.135
mean9200.000
σ0.000
min9200.000
max9200.000
mean1584.000-1643.000=-59.000
σ0.000
min1584.000-1643.000=-59.000
max1584.000-1643.000=-59.000
mean26.769-26.798=-0.029
σ0.068-0.057=0.011
min26.690-26.752=-0.062
max26.855-26.870=-0.014