Compare commits

Home / Compare 24368d92 .. 9af05d9d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.053=0.001
σ0.371-0.370=0.001
min53.907-53.912=-0.006
max55.109-55.105=0.004
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.139-0.138=0.000
σ0.005-0.006=-0.001
min0.131-0.131=0.001
max0.146-0.148=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.392-43.392=-0.000
σ0.006-0.006=-0.000
min43.384-43.383=0.000
max43.402-43.405=-0.003
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.123-0.120=0.002
σ0.004-0.005=-0.001
min0.119-0.114=0.004
max0.129-0.129=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.006-1007.002=0.004
σ1.189-1.206=-0.017
min1006.433-1006.434=-0.001
max1011.987-1012.062=-0.075
mean1053.400-1054.650=-1.250
σ308.037-307.812=0.226
min578.000-580.000=-2.000
max1645.000-1647.000=-2.000
mean1.534-1.531=0.003
σ0.077-0.082=-0.005
min1.474-1.453=0.021
max1.791-1.769=0.022

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.420-0.422=-0.002
σ0.141-0.135=0.005
min0.339-0.347=-0.007
max0.671-0.661=0.010
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.936-0.878=0.058
σ0.202-0.097=0.105
min0.841-0.809=0.031
max1.297-1.043=0.254
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.552-0.531=0.021
σ0.043-0.044=-0.002
min0.527-0.498=0.029
max0.628-0.607=0.021
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.859-0.852=0.007
σ0.043-0.044=-0.002
min0.818-0.816=0.001
max0.930-0.922=0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.836=0.004
σ0.034-0.032=0.002
min964.809-964.802=0.008
max964.895-964.889=0.006
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.828-0.829=-0.001
σ0.028-0.054=-0.026
min0.789-0.733=0.056
max0.854-0.856=-0.002
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.007-0.007=-0.000
min885.505-885.504=0.001
max885.523-885.522=0.001
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.710-0.697=0.013
σ0.020-0.050=-0.030
min0.685-0.637=0.048
max0.738-0.740=-0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.720=0.000
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean3.548-4.205=-0.656
σ0.072-0.086=-0.014
min3.428-4.069=-0.640
max3.849-4.592=-0.743
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean3.530-4.199=-0.669
σ0.074-0.066=0.009
min3.392-4.061=-0.669
max3.797-4.481=-0.684
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.538-0.751=-0.213
σ0.013-0.018=-0.005
min0.511-0.719=-0.208
max0.620-0.863=-0.243
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.510-0.710=-0.199
σ0.012-0.015=-0.002
min0.489-0.672=-0.183
max0.562-0.784=-0.223

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.015-297.006=0.009
σ0.215-0.289=-0.074
min296.845-296.801=0.044
max297.599-297.787=-0.189
mean1943.000-1927.000=16.000
σ0.000
min1943.000-1927.000=16.000
max1943.000-1927.000=16.000
mean0.596-0.574=0.021
σ0.031-0.048=-0.018
min0.555-0.503=0.052
max0.666-0.687=-0.022

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.819-286.818=0.001
σ0.038-0.037=0.001
min286.767-286.767=-0.000
max286.856-286.856=0.001
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.396-0.393=0.003
σ0.009-0.006=0.003
min0.385-0.388=-0.002
max0.404-0.401=0.003
iters=5
new-facts=1
prior-facts=6402
mean1297.238-1297.233=0.005
σ0.084-0.074=0.009
min1297.145-1297.139=0.006
max1297.305-1297.310=-0.004
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean2.057-2.083=-0.026
σ0.093-0.082=0.011
min1.983-1.986=-0.003
max2.206-2.153=0.053
iters=5
new-facts=6402
prior-facts=1
mean1541.301-1541.318=-0.016
σ6.832-6.841=-0.009
min1538.049-1538.074=-0.025
max1553.518-1553.550=-0.033
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean2.184-2.256=-0.071
σ0.108-0.181=-0.073
min2.101-2.076=0.025
max2.367-2.468=-0.101
iters=5
new-facts=6402
prior-facts=6402
mean1859.116-1859.108=0.007
σ0.076-0.080=-0.004
min1859.002-1858.990=0.012
max1859.186-1859.186=-0.000
mean1788.200-1780.400=7.800
σ149.563-140.776=8.788
min1645.000-1647.000=-2.000
max1943.000-1927.000=16.000
mean2.966-3.040=-0.074
σ0.084-0.136=-0.052
min2.852-2.864=-0.012
max3.075-3.191=-0.116

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.205-1.310=-0.105
σ0.271-0.343=-0.071
min0.933-1.062=-0.129
max1.650-1.809=-0.159

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.820=0.000
σ581.372-581.372=-0.000
min158.132-158.133=-0.000
max1320.878-1320.878=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.557-0.540=0.017
σ0.583-0.557=0.026
min0.262-0.259=0.002
max1.431-1.375=0.056
policies=20
mean1581.612-1581.610=0.002
σ0.356-0.363=-0.006
min1581.373-1581.366=0.007
max1582.142-1582.149=-0.007
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean2.631-2.639=-0.009
σ0.007-0.012=-0.004
min2.621-2.626=-0.005
max2.639-2.652=-0.014
policies=200
mean15824.173-15824.253=-0.080
σ0.109-0.119=-0.011
min15824.017-15824.147=-0.129
max15824.263-15824.418=-0.155
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean26.636-26.599=0.038
σ0.031-0.035=-0.004
min26.594-26.547=0.047
max26.666-26.625=0.041