Compare commits

Home / Compare 23ec27ee .. 85b38027

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.056=-0.000
σ0.370-0.368=0.002
min53.910-53.919=-0.009
max55.108-55.102=0.006
mean421.000-415.000=6.000
σ0.000
min421.000-415.000=6.000
max421.000-415.000=6.000
mean0.137-0.136=0.000
σ0.005-0.004=0.001
min0.129-0.131=-0.002
max0.145-0.144=0.001
cache=y
dps=1
iters=10
policies=100
mean43.395-43.395=0.001
σ0.008-0.006=0.002
min43.383-43.388=-0.004
max43.411-43.408=0.003
mean421.000-415.000=6.000
σ0.000
min421.000-415.000=6.000
max421.000-415.000=6.000
mean0.125-0.122=0.003
σ0.006-0.003=0.003
min0.120-0.120=-0.000
max0.140-0.128=0.012

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.957-1006.962=-0.005
σ0.890-0.868=0.021
min1006.488-1006.461=0.027
max1010.648-1010.556=0.091
mean1054.900-1047.900=7.000
σ317.749-307.343=10.406
min552.000-554.000=-2.000
max1655.000-1643.000=12.000
mean1.569-1.535=0.034
σ0.106-0.088=0.018
min1.470-1.456=0.013
max1.827-1.769=0.057

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1655.000-1643.000=12.000
σ0.000
min1655.000-1643.000=12.000
max1655.000-1643.000=12.000
mean0.403-0.397=0.006
σ0.111-0.093=0.018
min0.328-0.332=-0.004
max0.597-0.561=0.036
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1655.000-1643.000=12.000
σ0.000
min1655.000-1643.000=12.000
max1655.000-1643.000=12.000
mean0.882-0.881=0.001
σ0.090-0.084=0.005
min0.827-0.827=0.000
max1.038-1.026=0.013
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1655.000-1643.000=12.000
σ0.000
min1655.000-1643.000=12.000
max1655.000-1643.000=12.000
mean0.530-0.537=-0.007
σ0.044-0.055=-0.011
min0.494-0.487=0.007
max0.601-0.630=-0.030
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1655.000-1643.000=12.000
σ0.000
min1655.000-1643.000=12.000
max1655.000-1643.000=12.000
mean0.850-0.853=-0.003
σ0.039-0.033=0.006
min0.819-0.815=0.004
max0.917-0.903=0.014

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.836=0.002
σ0.034-0.017=0.018
min964.811-964.815=-0.004
max964.895-964.857=0.038
mean1655.000-1643.000=12.000
σ0.000
min1655.000-1643.000=12.000
max1655.000-1643.000=12.000
mean0.805-0.817=-0.013
σ0.051-0.019=0.032
min0.735-0.786=-0.051
max0.850-0.838=0.013
name=cdr_enhanced_4k_loc.art
mean885.512-885.514=-0.002
σ0.007-0.007=-0.000
min885.506-885.504=0.001
max885.522-885.523=-0.002
mean1655.000-1643.000=12.000
σ0.000
min1655.000-1643.000=12.000
max1655.000-1643.000=12.000
mean0.668-0.720=-0.052
σ0.050-0.030=0.020
min0.607-0.670=-0.064
max0.730-0.746=-0.016

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.719
mean1655.000-1643.000=12.000
σ0.000
min1655.000-1643.000=12.000
max1655.000-1643.000=12.000
mean4.222-4.245=-0.024
σ0.109-0.145=-0.036
min4.097-4.084=0.013
max4.893-5.411=-0.519
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.671=-0.003
mean1655.000-1643.000=12.000
σ0.000
min1655.000-1643.000=12.000
max1655.000-1643.000=12.000
mean4.236-4.203=0.033
σ0.111-0.079=0.033
min4.109-4.064=0.045
max5.085-4.539=0.546
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1655.000-1643.000=12.000
σ0.000
min1655.000-1643.000=12.000
max1655.000-1643.000=12.000
mean0.747-0.750=-0.003
σ0.019-0.024=-0.004
min0.692-0.612=0.080
max0.863-0.864=-0.000
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1655.000-1643.000=12.000
σ0.000
min1655.000-1643.000=12.000
max1655.000-1643.000=12.000
mean0.709-0.712=-0.003
σ0.014-0.015=-0.000
min0.682-0.683=-0.001
max0.788-0.795=-0.008

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.577-295.537=0.040
σ0.209-0.227=-0.018
min295.408-295.354=0.055
max296.132-296.157=-0.025
mean2039.000-1907.000=132.000
σ0.000
min2039.000-1907.000=132.000
max2039.000-1907.000=132.000
mean0.545-0.574=-0.028
σ0.039-0.039=-0.001
min0.498-0.504=-0.005
max0.602-0.613=-0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.393-285.402=-0.009
σ0.037-0.037=0.000
min285.342-285.354=-0.012
max285.429-285.440=-0.010
mean1655.000-1643.000=12.000
σ0.000
min1655.000-1643.000=12.000
max1655.000-1643.000=12.000
mean0.392-0.390=0.002
σ0.009-0.007=0.002
min0.381-0.382=-0.001
max0.405-0.398=0.007
iters=5
new-facts=1
prior-facts=6402
mean1295.780-1295.775=0.005
σ0.110-0.109=0.001
min1295.651-1295.661=-0.010
max1295.903-1295.903=0.000
mean1655.000-1643.000=12.000
σ0.000
min1655.000-1643.000=12.000
max1655.000-1643.000=12.000
mean1.900-1.893=0.007
σ0.106-0.076=0.030
min1.804-1.806=-0.002
max2.062-1.986=0.077
iters=5
new-facts=6402
prior-facts=1
mean1539.961-1539.947=0.014
σ6.852-6.841=0.011
min1536.688-1536.691=-0.004
max1552.214-1552.181=0.033
mean1655.000-1643.000=12.000
σ0.000
min1655.000-1643.000=12.000
max1655.000-1643.000=12.000
mean2.408-2.391=0.018
σ0.277-0.238=0.040
min2.119-2.064=0.055
max2.836-2.627=0.209
iters=5
new-facts=6402
prior-facts=6402
mean1857.685-1857.689=-0.004
σ0.056-0.063=-0.007
min1857.636-1857.617=0.020
max1857.769-1857.770=-0.001
mean1794.200-1776.000=18.200
σ166.893-130.050=36.843
min1655.000-1643.000=12.000
max2039.000-1907.000=132.000
mean3.090-3.054=0.036
σ0.253-0.398=-0.145
min2.836-2.657=0.179
max3.454-3.720=-0.266

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.236-1.117=0.119
σ0.363-0.238=0.125
min0.936-0.937=-0.002
max1.851-1.528=0.323

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.706-445.706=0.000
σ580.933-580.934=-0.001
min155.237-155.237=0.000
max1317.106-1317.107=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1655.000-1643.000=12.000
σ0.000
min1655.000-1643.000=12.000
max1655.000-1643.000=12.000
mean0.550-0.539=0.011
σ0.569-0.559=0.010
min0.256-0.258=-0.002
max1.404-1.377=0.027
policies=20
mean1552.641-1552.647=-0.006
σ0.326-0.333=-0.007
min1552.417-1552.417=0.000
max1553.125-1553.140=-0.015
mean920.000
σ0.000
min920.000
max920.000
mean1655.000-1643.000=12.000
σ0.000
min1655.000-1643.000=12.000
max1655.000-1643.000=12.000
mean2.591-2.589=0.002
σ0.013-0.021=-0.008
min2.577-2.561=0.017
max2.605-2.611=-0.006
policies=200
mean15534.635-15534.633=0.003
σ0.175-0.093=0.082
min15534.477-15534.503=-0.025
max15534.886-15534.719=0.166
mean9200.000
σ0.000
min9200.000
max9200.000
mean1655.000-1643.000=12.000
σ0.000
min1655.000-1643.000=12.000
max1655.000-1643.000=12.000
mean26.189-26.164=0.025
σ0.059-0.066=-0.007
min26.102-26.081=0.021
max26.231-26.233=-0.002