Compare commits

Home / Compare 8a9c7f9c .. cae61ea7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.055=0.001
σ0.370-0.371=-0.001
min53.912-53.903=0.009
max55.108-55.109=-0.002
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.142-0.139=0.003
σ0.004-0.004=0.000
min0.137-0.131=0.007
max0.150-0.145=0.005
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.000
σ0.006-0.005=0.002
min43.386-43.388=-0.002
max43.406-43.402=0.004
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.122-0.121=0.001
σ0.004-0.004=0.000
min0.119-0.115=0.004
max0.129-0.127=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.003-1007.006=-0.003
σ1.188-1.193=-0.005
min1006.436-1006.444=-0.007
max1011.983-1012.004=-0.021
mean1052.550-1051.150=1.400
σ307.696-305.605=2.091
min578.000
max1644.000-1645.000=-1.000
mean1.527-1.553=-0.027
σ0.093-0.080=0.013
min1.344-1.461=-0.117
max1.789-1.735=0.054

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1644.000-1645.000=-1.000
σ0.000
min1644.000-1645.000=-1.000
max1644.000-1645.000=-1.000
mean0.431-0.422=0.010
σ0.149-0.148=0.001
min0.339-0.336=0.003
max0.696-0.685=0.011
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1644.000-1645.000=-1.000
σ0.000
min1644.000-1645.000=-1.000
max1644.000-1645.000=-1.000
mean0.894-0.896=-0.002
σ0.095-0.103=-0.008
min0.834-0.829=0.005
max1.063-1.078=-0.015
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1644.000-1645.000=-1.000
σ0.000
min1644.000-1645.000=-1.000
max1644.000-1645.000=-1.000
mean0.539-0.528=0.011
σ0.057-0.058=-0.001
min0.493-0.476=0.017
max0.638-0.626=0.012
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1644.000-1645.000=-1.000
σ0.000
min1644.000-1645.000=-1.000
max1644.000-1645.000=-1.000
mean0.850-0.852=-0.002
σ0.046-0.039=0.006
min0.822-0.824=-0.002
max0.930-0.919=0.010

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=0.000
σ0.032-0.033=-0.001
min964.811-964.813=-0.002
max964.895-964.895=0.000
mean1644.000-1645.000=-1.000
σ0.000
min1644.000-1645.000=-1.000
max1644.000-1645.000=-1.000
mean0.831-0.800=0.031
σ0.038-0.060=-0.021
min0.773-0.729=0.043
max0.866-0.863=0.003
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.004-0.007=-0.003
min885.505
max885.516-885.523=-0.007
mean1644.000-1645.000=-1.000
σ0.000
min1644.000-1645.000=-1.000
max1644.000-1645.000=-1.000
mean0.680-0.742=-0.062
σ0.049-0.007=0.042
min0.603-0.730=-0.127
max0.727-0.750=-0.023

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.002
mean1644.000-1645.000=-1.000
σ0.000
min1644.000-1645.000=-1.000
max1644.000-1645.000=-1.000
mean3.477-4.247=-0.770
σ0.107-0.092=0.015
min3.340-4.094=-0.754
max4.023-4.593=-0.570
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=-0.000
min7.664
max7.668
mean1644.000-1645.000=-1.000
σ0.000
min1644.000-1645.000=-1.000
max1644.000-1645.000=-1.000
mean4.189-4.220=-0.031
σ0.077-0.071=0.005
min4.047-4.058=-0.010
max4.484-4.468=0.015
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1644.000-1645.000=-1.000
σ0.000
min1644.000-1645.000=-1.000
max1644.000-1645.000=-1.000
mean0.737-0.744=-0.007
σ0.024-0.027=-0.003
min0.617-0.711=-0.093
max0.861-0.931=-0.070
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1644.000-1645.000=-1.000
σ0.000
min1644.000-1645.000=-1.000
max1644.000-1645.000=-1.000
mean0.707-0.693=0.014
σ0.029-0.028=0.000
min0.670-0.495=0.175
max0.846-0.790=0.056

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.072-296.931=0.141
σ0.252-0.226=0.026
min296.913-296.801=0.112
max297.764-297.559=0.205
mean1934.000-1937.000=-3.000
σ0.000
min1934.000-1937.000=-3.000
max1934.000-1937.000=-3.000
mean0.590-0.593=-0.002
σ0.043-0.026=0.017
min0.511-0.547=-0.036
max0.678-0.640=0.038

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.819-286.825=-0.007
σ0.037-0.037=-0.001
min286.767-286.772=-0.005
max286.856-286.862=-0.007
mean1644.000-1645.000=-1.000
σ0.000
min1644.000-1645.000=-1.000
max1644.000-1645.000=-1.000
mean0.398-0.395=0.002
σ0.008-0.006=0.002
min0.389-0.388=0.001
max0.405-0.401=0.004
iters=5
new-facts=1
prior-facts=6402
mean1297.236-1297.253=-0.017
σ0.069-0.073=-0.004
min1297.152-1297.169=-0.017
max1297.307-1297.331=-0.024
mean1644.000-1645.000=-1.000
σ0.000
min1644.000-1645.000=-1.000
max1644.000-1645.000=-1.000
mean2.088-2.100=-0.012
σ0.067-0.082=-0.015
min2.014-2.010=0.004
max2.177-2.166=0.012
iters=5
new-facts=6402
prior-facts=1
mean1541.319-1541.299=0.020
σ6.834-6.842=-0.008
min1538.095-1538.044=0.050
max1553.539-1553.534=0.006
mean1644.000-1645.000=-1.000
σ0.000
min1644.000-1645.000=-1.000
max1644.000-1645.000=-1.000
mean2.239-2.188=0.051
σ0.172-0.119=0.053
min2.054-2.088=-0.034
max2.476-2.392=0.084
iters=5
new-facts=6402
prior-facts=6402
mean1859.110-1859.114=-0.004
σ0.080-0.082=-0.002
min1858.997-1859.003=-0.006
max1859.185-1859.204=-0.020
mean1782.800-1784.600=-1.800
σ145.661-146.700=-1.038
min1644.000-1645.000=-1.000
max1934.000-1937.000=-3.000
mean3.034-2.950=0.084
σ0.173-0.076=0.096
min2.862-2.857=0.005
max3.321-3.046=0.274

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.273-1.243=0.031
σ0.302-0.310=-0.008
min1.062-1.058=0.004
max1.791-1.776=0.016

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.819-448.819=0.000
σ581.372-581.372=0.000
min158.132-158.132=0.000
max1320.877-1320.876=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1644.000-1645.000=-1.000
σ0.000
min1644.000-1645.000=-1.000
max1644.000-1645.000=-1.000
mean0.555-0.539=0.016
σ0.575-0.553=0.022
min0.264-0.259=0.005
max1.418-1.368=0.049
policies=20
mean1581.603-1581.600=0.003
σ0.370-0.356=0.014
min1581.356-1581.357=-0.001
max1582.153-1582.128=0.025
mean920.000
σ0.000
min920.000
max920.000
mean1644.000-1645.000=-1.000
σ0.000
min1644.000-1645.000=-1.000
max1644.000-1645.000=-1.000
mean2.641-2.626=0.014
σ0.019-0.008=0.011
min2.617-2.615=0.002
max2.657-2.634=0.023
policies=200
mean15824.200-15824.186=0.014
σ0.165-0.175=-0.011
min15824.047-15824.018=0.029
max15824.430-15824.431=-0.001
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000-1645.000=-1.000
σ0.000
min1644.000-1645.000=-1.000
max1644.000-1645.000=-1.000
mean26.621-26.549=0.072
σ0.034-0.110=-0.076
min26.592-26.424=0.167
max26.656-26.692=-0.035