Compare commits

Home / Compare 46bebcfa .. c74ac811

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.055=0.001
σ0.367-0.367=-0.000
min53.911-53.915=-0.004
max55.099-55.100=-0.001
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.141-0.142=-0.001
σ0.004-0.004=0.000
min0.136-0.137=-0.002
max0.148-0.148=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=0.000
σ0.006-0.006=-0.000
min43.385-43.387=-0.002
max43.405-43.406=-0.001
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.122-0.119=0.003
σ0.005-0.003=0.002
min0.117-0.116=0.001
max0.130-0.126=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.006-1007.005=0.001
σ1.191-1.189=0.003
min1006.434-1006.431=0.003
max1011.999-1011.991=0.008
mean1053.350-1055.500=-2.150
σ307.644-307.822=-0.178
min579.000-580.000=-1.000
max1645.000-1649.000=-4.000
mean1.540-1.517=0.024
σ0.091-0.099=-0.008
min1.467-1.354=0.113
max1.770-1.820=-0.050

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.000
σ0.003-0.002=0.000
min0.882
max0.887
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean0.413-0.417=-0.004
σ0.137-0.143=-0.006
min0.326-0.329=-0.003
max0.654-0.670=-0.016
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean0.881-0.884=-0.002
σ0.090-0.094=-0.004
min0.805-0.836=-0.032
max1.034-1.052=-0.018
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean0.549-0.536=0.013
σ0.049-0.051=-0.002
min0.501-0.492=0.009
max0.632-0.622=0.010
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean0.849-0.846=0.003
σ0.039-0.048=-0.009
min0.826-0.810=0.016
max0.919-0.928=-0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=0.000
σ0.034-0.034=-0.001
min964.811-964.810=0.000
max964.894-964.895=-0.001
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean0.834-0.802=0.032
σ0.017-0.046=-0.029
min0.814-0.751=0.063
max0.848-0.857=-0.009
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.008-0.007=0.001
min885.504-885.505=-0.001
max885.523-885.523=0.000
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean0.712-0.723=-0.011
σ0.029-0.028=0.001
min0.665-0.683=-0.018
max0.736-0.748=-0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.002
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean4.251-4.249=0.002
σ0.085-0.085=-0.000
min4.128-4.096=0.033
max4.601-4.573=0.027
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean4.242-4.229=0.013
σ0.093-0.067=0.026
min4.112-4.116=-0.003
max4.531-4.484=0.047
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean0.750-0.754=-0.004
σ0.035-0.018=0.017
min0.551-0.723=-0.172
max0.862-0.878=-0.017
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean0.716-0.710=0.006
σ0.018-0.017=0.001
min0.604-0.681=-0.077
max0.760-0.819=-0.059

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.024-297.033=-0.010
σ0.270-0.147=0.124
min296.776-296.852=-0.077
max297.742-297.400=0.342
mean1920.000-1902.000=18.000
σ0.000
min1920.000-1902.000=18.000
max1920.000-1902.000=18.000
mean0.590-0.583=0.007
σ0.036-0.024=0.012
min0.537-0.533=0.004
max0.669-0.616=0.053

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.825-286.823=0.002
σ0.036-0.039=-0.003
min286.774-286.773=0.002
max286.859-286.863=-0.003
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean0.401-0.392=0.008
σ0.007-0.006=0.001
min0.388-0.387=0.001
max0.406-0.403=0.003
iters=5
new-facts=1
prior-facts=6402
mean1297.229-1297.236=-0.006
σ0.074-0.080=-0.006
min1297.140-1297.137=0.004
max1297.292-1297.327=-0.036
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean2.066-2.084=-0.018
σ0.056-0.073=-0.017
min1.999-2.000=-0.001
max2.146-2.161=-0.015
iters=5
new-facts=6402
prior-facts=1
mean1541.326-1541.373=-0.047
σ6.848-6.811=0.037
min1538.107-1538.136=-0.029
max1553.573-1553.553=0.020
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean2.273-2.338=-0.065
σ0.187-0.151=0.036
min2.115-2.093=0.022
max2.484-2.455=0.029
iters=5
new-facts=6402
prior-facts=6402
mean1859.116-1859.109=0.007
σ0.078-0.083=-0.005
min1859.007-1858.987=0.021
max1859.199-1859.193=0.005
mean1786.400-1785.400=1.000
σ135.083-121.648=13.434
min1645.000-1649.000=-4.000
max1920.000-1902.000=18.000
mean3.171-3.085=0.086
σ0.278-0.233=0.045
min2.863-2.899=-0.036
max3.569-3.425=0.143

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.226-1.198=0.028
σ0.344-0.342=0.002
min0.932-0.920=0.012
max1.772-1.727=0.045

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.822=-0.000
σ581.372-581.372=-0.000
min158.135-158.134=0.000
max1320.880-1320.880=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean0.559-0.554=0.005
σ0.596-0.576=0.020
min0.258-0.262=-0.004
max1.453-1.419=0.035
policies=20
mean1581.628-1581.628=-0.000
σ0.354-0.351=0.003
min1581.388-1581.392=-0.004
max1582.154-1582.150=0.004
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean2.631-2.624=0.008
σ0.008-0.010=-0.002
min2.623-2.613=0.009
max2.642-2.637=0.006
policies=200
mean15824.240-15824.232=0.008
σ0.027-0.071=-0.044
min15824.218-15824.147=0.071
max15824.274-15824.305=-0.031
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean26.598-26.617=-0.019
σ0.067-0.050=0.018
min26.542-26.564=-0.022
max26.693-26.684=0.009