Compare commits

Home / Compare 808baf0d .. 6542d56e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.014=0.001
σ0.368-0.369=-0.000
min53.866-53.867=-0.001
max55.063-55.062=0.000
mean417.000-414.700=2.300
σ0.000-0.483=-0.483
min417.000-414.000=3.000
max417.000-415.000=2.000
mean0.139-0.140=-0.000
σ0.004-0.004=-0.000
min0.135-0.136=-0.001
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.000
σ0.006-0.006=-0.000
min43.315-43.313=0.002
max43.331-43.332=-0.001
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.121-0.117=0.003
σ0.004-0.003=0.001
min0.115-0.114=0.001
max0.128-0.121=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.310-1006.305=0.005
σ1.192-1.170=0.022
min1005.771-1005.769=0.002
max1011.302-1011.208=0.094
mean1047.850-1054.200=-6.350
σ315.273-303.029=12.243
min549.000-595.000=-46.000
max1529.000-1451.000=78.000
mean1.573-1.556=0.017
σ0.089-0.080=0.009
min1.482-1.484=-0.003
max1.813-1.747=0.067

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1529.000-1451.000=78.000
σ0.000
min1529.000-1451.000=78.000
max1529.000-1451.000=78.000
mean0.409-0.413=-0.005
σ0.131-0.125=0.006
min0.328-0.340=-0.011
max0.640-0.635=0.005
name=error_case.art
mean2.339-2.337=0.001
σ0.003-0.003=0.001
min2.336
max2.343-2.341=0.002
mean1529.000-1451.000=78.000
σ0.000
min1529.000-1451.000=78.000
max1529.000-1451.000=78.000
mean0.881-0.907=-0.026
σ0.092-0.113=-0.021
min0.818-0.839=-0.021
max1.042-1.105=-0.063
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1529.000-1451.000=78.000
σ0.000
min1529.000-1451.000=78.000
max1529.000-1451.000=78.000
mean0.542-0.541=0.001
σ0.056-0.062=-0.006
min0.497-0.484=0.013
max0.635-0.647=-0.012
name=nested_use.art
mean2.361-2.360=0.001
σ0.002-0.002=0.001
min2.359
max2.365-2.363=0.002
mean1529.000-1451.000=78.000
σ0.000
min1529.000-1451.000=78.000
max1529.000-1451.000=78.000
mean0.847-0.837=0.010
σ0.033-0.030=0.003
min0.823-0.814=0.009
max0.901-0.889=0.013

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.102-964.097=0.005
σ0.034-0.025=0.009
min964.077
max964.162-964.138=0.024
mean1529.000-1451.000=78.000
σ0.000
min1529.000-1451.000=78.000
max1529.000-1451.000=78.000
mean0.838-0.829=0.008
σ0.024-0.023=0.001
min0.811-0.798=0.013
max0.859-0.853=0.005
name=cdr_enhanced_4k_loc.art
mean884.710-884.710=-0.000
σ0.006-0.006=-0.000
min884.703
max884.717-884.716=0.001
mean1529.000-1451.000=78.000
σ0.000
min1529.000-1451.000=78.000
max1529.000-1451.000=78.000
mean0.706-0.724=-0.018
σ0.032-0.037=-0.005
min0.666-0.659=0.006
max0.740-0.750=-0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715
σ0.002-0.002=0.000
min7.714
max7.720-7.719=0.002
mean1529.000-1451.000=78.000
σ0.000
min1529.000-1451.000=78.000
max1529.000-1451.000=78.000
mean4.238-4.247=-0.009
σ0.081-0.094=-0.013
min4.036-4.088=-0.052
max4.462-4.587=-0.125
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1529.000-1451.000=78.000
σ0.000
min1529.000-1451.000=78.000
max1529.000-1451.000=78.000
mean3.580-4.228=-0.648
σ0.159-0.073=0.086
min3.345-4.072=-0.727
max4.289-4.464=-0.176
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1529.000-1451.000=78.000
σ0.000
min1529.000-1451.000=78.000
max1529.000-1451.000=78.000
mean0.734-0.729=0.005
σ0.016-0.019=-0.003
min0.701-0.697=0.004
max0.835-0.859=-0.025
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1529.000-1451.000=78.000
σ0.000
min1529.000-1451.000=78.000
max1529.000-1451.000=78.000
mean0.698-0.694=0.005
σ0.016-0.025=-0.009
min0.669-0.497=0.172
max0.771-0.779=-0.008

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.238-296.304=-0.067
σ0.225-0.230=-0.005
min296.059-296.136=-0.078
max296.822-296.936=-0.114
mean1922.000-1908.000=14.000
σ0.000
min1922.000-1908.000=14.000
max1922.000-1908.000=14.000
mean0.572-0.576=-0.004
σ0.056-0.048=0.009
min0.500-0.514=-0.014
max0.688-0.677=0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.701-284.697=0.004
σ0.025-0.035=-0.011
min284.671-284.652=0.019
max284.727-284.739=-0.011
mean1529.000-1451.000=78.000
σ0.000
min1529.000-1451.000=78.000
max1529.000-1451.000=78.000
mean0.396-0.397=-0.001
σ0.010-0.010=0.000
min0.385-0.386=-0.001
max0.405-0.405=0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.092-1295.089=0.003
σ0.121-0.064=0.057
min1294.963-1295.011=-0.048
max1295.258-1295.170=0.088
mean1529.000-1451.000=78.000
σ0.000
min1529.000-1451.000=78.000
max1529.000-1451.000=78.000
mean1.893-2.067=-0.174
σ0.081-0.053=0.028
min1.810-2.005=-0.195
max1.993-2.140=-0.147
iters=5
new-facts=6402
prior-facts=1
mean1539.183-1539.174=0.010
σ6.837-6.859=-0.022
min1535.863-1535.937=-0.074
max1551.407-1551.439=-0.032
mean1529.000-1451.000=78.000
σ0.000
min1529.000-1451.000=78.000
max1529.000-1451.000=78.000
mean2.270-2.206=0.064
σ0.209-0.170=0.039
min2.030-1.969=0.060
max2.515-2.377=0.139
iters=5
new-facts=6402
prior-facts=6402
mean1856.985-1856.980=0.005
σ0.059-0.080=-0.021
min1856.929-1856.865=0.064
max1857.069-1857.067=0.002
mean1756.800-1746.800=10.000
σ171.522-175.252=-3.730
min1529.000-1498.000=31.000
max1922.000-1908.000=14.000
mean3.059-3.126=-0.067
σ0.306-0.253=0.053
min2.834-2.856=-0.022
max3.594-3.497=0.097

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.629-1.757=-0.128
σ0.265-0.091=0.174
min1.261-1.609=-0.348
max1.911-1.851=0.060

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-447.786=-0.000
σ581.213-581.213=-0.000
min157.175-157.176=-0.000
max1319.604-1319.605=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1529.000-1451.000=78.000
σ0.000
min1529.000-1451.000=78.000
max1529.000-1451.000=78.000
mean0.529-0.550=-0.020
σ0.538-0.579=-0.041
min0.258-0.259=-0.002
max1.337-1.418=-0.082
policies=20
mean1572.107-1572.099=0.008
σ0.364-0.355=0.009
min1571.859-1571.857=0.002
max1572.648-1572.626=0.022
mean920.000
σ0.000
min920.000
max920.000
mean1529.000-1451.000=78.000
σ0.000
min1529.000-1451.000=78.000
max1529.000-1451.000=78.000
mean2.641-2.623=0.019
σ0.036-0.015=0.022
min2.610-2.607=0.003
max2.680-2.640=0.040
policies=200
mean15729.022-15729.041=-0.019
σ0.070-0.020=0.050
min15728.960-15729.015=-0.055
max15729.122-15729.063=0.059
mean9200.000
σ0.000
min9200.000
max9200.000
mean1529.000-1451.000=78.000
σ0.000
min1529.000-1451.000=78.000
max1529.000-1451.000=78.000
mean26.444-26.519=-0.075
σ0.076-0.049=0.027
min26.334-26.461=-0.127
max26.505-26.564=-0.058