Compare commits

Home / Compare 4dedcbef .. d57817d2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.056=-0.002
σ0.369-0.369=-0.000
min53.901-53.910=-0.010
max55.103-55.107=-0.003
mean416.000-420.000=-4.000
σ0.000
min416.000-420.000=-4.000
max416.000-420.000=-4.000
mean0.136-0.141=-0.004
σ0.008-0.004=0.004
min0.121-0.138=-0.017
max0.149-0.149=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=-0.000
σ0.006-0.005=0.000
min43.385-43.384=0.001
max43.405-43.400=0.005
mean416.000-420.000=-4.000
σ0.000
min416.000-420.000=-4.000
max416.000-420.000=-4.000
mean0.119-0.120=-0.001
σ0.004-0.002=0.002
min0.114-0.118=-0.004
max0.127-0.126=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1007.005=-0.000
σ1.191-1.183=0.008
min1006.434-1006.463=-0.029
max1011.997-1011.957=0.040
mean1050.350-1056.950=-6.600
σ307.622-322.191=-14.568
min575.000-574.000=1.000
max1642.000-1638.000=4.000
mean1.534-1.534=-0.000
σ0.074-0.083=-0.008
min1.463-1.451=0.012
max1.761-1.840=-0.079

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1642.000-1638.000=4.000
σ0.000
min1642.000-1638.000=4.000
max1642.000-1638.000=4.000
mean0.417-0.434=-0.018
σ0.137-0.139=-0.002
min0.337-0.342=-0.005
max0.660-0.678=-0.017
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1642.000-1638.000=4.000
σ0.000
min1642.000-1638.000=4.000
max1642.000-1638.000=4.000
mean0.883-0.949=-0.065
σ0.088-0.203=-0.115
min0.833-0.836=-0.003
max1.037-1.311=-0.275
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1642.000-1638.000=4.000
σ0.000
min1642.000-1638.000=4.000
max1642.000-1638.000=4.000
mean0.542-0.539=0.002
σ0.052-0.055=-0.003
min0.498-0.497=0.001
max0.631-0.633=-0.002
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1642.000-1638.000=4.000
σ0.000
min1642.000-1638.000=4.000
max1642.000-1638.000=4.000
mean0.848-0.848=-0.000
σ0.054-0.042=0.012
min0.802-0.820=-0.018
max0.930-0.918=0.012

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.839=-0.001
σ0.035-0.034=0.000
min964.811-964.810=0.002
max964.896-964.896=0.000
mean1642.000-1638.000=4.000
σ0.000
min1642.000-1638.000=4.000
max1642.000-1638.000=4.000
mean0.828-0.819=0.009
σ0.029-0.037=-0.008
min0.790-0.784=0.006
max0.852-0.861=-0.009
name=cdr_enhanced_4k_loc.art
mean885.513-885.512=0.001
σ0.008-0.007=0.001
min885.505
max885.524-885.523=0.001
mean1642.000-1638.000=4.000
σ0.000
min1642.000-1638.000=4.000
max1642.000-1638.000=4.000
mean0.681-0.701=-0.019
σ0.032-0.032=-0.001
min0.655-0.667=-0.012
max0.736-0.740=-0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.720=-0.001
mean1642.000-1638.000=4.000
σ0.000
min1642.000-1638.000=4.000
max1642.000-1638.000=4.000
mean4.214-4.227=-0.013
σ0.074-0.086=-0.012
min4.097-4.080=0.017
max4.459-4.453=0.006
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1642.000-1638.000=4.000
σ0.000
min1642.000-1638.000=4.000
max1642.000-1638.000=4.000
mean4.210-4.237=-0.028
σ0.088-0.115=-0.027
min4.084-4.099=-0.015
max4.479-5.015=-0.537
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1642.000-1638.000=4.000
σ0.000
min1642.000-1638.000=4.000
max1642.000-1638.000=4.000
mean0.754-0.750=0.004
σ0.015-0.028=-0.013
min0.723-0.713=0.010
max0.846-0.924=-0.078
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1642.000-1638.000=4.000
σ0.000
min1642.000-1638.000=4.000
max1642.000-1638.000=4.000
mean0.712-0.543=0.168
σ0.015-0.076=-0.061
min0.684-0.486=0.198
max0.790-0.782=0.007

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.900-297.237=-0.337
σ0.216-0.189=0.027
min296.761-297.094=-0.333
max297.498-297.747=-0.250
mean1936.000-1899.000=37.000
σ0.000
min1936.000-1899.000=37.000
max1936.000-1899.000=37.000
mean0.578-0.581=-0.002
σ0.052-0.041=0.011
min0.501-0.528=-0.027
max0.692-0.668=0.023

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.815-286.823=-0.008
σ0.036-0.038=-0.002
min286.769-286.770=-0.001
max286.856-286.862=-0.006
mean1642.000-1638.000=4.000
σ0.000
min1642.000-1638.000=4.000
max1642.000-1638.000=4.000
mean0.393-0.396=-0.003
σ0.005-0.007=-0.001
min0.389-0.389=-0.001
max0.402-0.404=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1297.265-1297.230=0.035
σ0.040-0.048=-0.008
min1297.211-1297.167=0.044
max1297.304-1297.298=0.006
mean1642.000-1638.000=4.000
σ0.000
min1642.000-1638.000=4.000
max1642.000-1638.000=4.000
mean2.199-2.094=0.105
σ0.148-0.125=0.023
min2.041-2.005=0.036
max2.436-2.308=0.128
iters=5
new-facts=6402
prior-facts=1
mean1541.315-1541.371=-0.056
σ6.837-6.828=0.008
min1538.080-1538.134=-0.054
max1553.541-1553.583=-0.042
mean1642.000-1638.000=4.000
σ0.000
min1642.000-1638.000=4.000
max1642.000-1638.000=4.000
mean2.230-2.371=-0.141
σ0.152-0.261=-0.109
min2.102-2.094=0.008
max2.395-2.709=-0.314
iters=5
new-facts=6402
prior-facts=6402
mean1859.113-1859.108=0.005
σ0.080-0.080=0.000
min1858.998-1858.990=0.008
max1859.192-1859.192=-0.000
mean1785.400-1780.400=5.000
σ147.003-124.380=22.623
min1642.000-1638.000=4.000
max1936.000-1899.000=37.000
mean3.029-3.051=-0.022
σ0.169-0.161=0.008
min2.846-2.861=-0.015
max3.298-3.260=0.038

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.267-1.233=0.035
σ0.318-0.346=-0.027
min0.929-0.935=-0.006
max1.738-1.812=-0.074

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.817-448.821=-0.005
σ581.374-581.371=0.003
min158.128-158.134=-0.005
max1320.878-1320.878=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1642.000-1638.000=4.000
σ0.000
min1642.000-1638.000=4.000
max1642.000-1638.000=4.000
mean0.526-0.554=-0.028
σ0.516-0.580=-0.064
min0.264-0.262=0.002
max1.300-1.423=-0.124
policies=20
mean1581.607-1581.628=-0.021
σ0.368-0.364=0.004
min1581.357-1581.387=-0.029
max1582.154-1582.170=-0.016
mean920.000
σ0.000
min920.000
max920.000
mean1642.000-1638.000=4.000
σ0.000
min1642.000-1638.000=4.000
max1642.000-1638.000=4.000
mean2.640-2.645=-0.006
σ0.014-0.018=-0.004
min2.623-2.630=-0.006
max2.656-2.668=-0.011
policies=200
mean15824.190-15824.146=0.044
σ0.167-0.102=0.065
min15824.018-15824.021=-0.003
max15824.414-15824.261=0.153
mean9200.000
σ0.000
min9200.000
max9200.000
mean1642.000-1638.000=4.000
σ0.000
min1642.000-1638.000=4.000
max1642.000-1638.000=4.000
mean26.600-26.544=0.055
σ0.087-0.039=0.048
min26.472-26.487=-0.015
max26.661-26.567=0.094