Compare commits

Home / Compare 47bee893 .. 24182d08

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.055=-0.000
σ0.369-0.368=0.002
min53.911-53.919=-0.008
max55.106-55.101=0.004
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.141-0.139=0.002
σ0.004-0.003=0.001
min0.136-0.136=-0.000
max0.148-0.145=0.003
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=0.000
σ0.006-0.006=0.000
min43.386-43.385=0.001
max43.404-43.403=0.002
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.123-0.119=0.004
σ0.004-0.004=0.000
min0.117-0.114=0.003
max0.128-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.006-1007.004=0.002
σ1.188-1.188=0.001
min1006.434-1006.460=-0.027
max1011.986-1011.982=0.004
mean1052.400-1050.900=1.500
σ308.002-311.518=-3.515
min578.000-591.000=-13.000
max1645.000-1652.000=-7.000
mean1.562-1.569=-0.007
σ0.081-0.082=-0.000
min1.409-1.426=-0.018
max1.803-1.812=-0.008

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.415-0.420=-0.004
σ0.141-0.140=0.001
min0.332-0.329=0.004
max0.666-0.667=-0.001
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.880-0.891=-0.012
σ0.097-0.097=-0.001
min0.820-0.821=-0.002
max1.051-1.062=-0.011
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.528-0.529=-0.000
σ0.050-0.053=-0.004
min0.492-0.482=0.010
max0.614-0.619=-0.005
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.844-0.840=0.004
σ0.043-0.035=0.008
min0.816-0.812=0.005
max0.919-0.901=0.018

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.839=-0.001
σ0.034-0.035=-0.001
min964.810-964.807=0.003
max964.893-964.896=-0.004
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.842-0.808=0.035
σ0.015-0.062=-0.047
min0.824-0.703=0.121
max0.859-0.858=0.001
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.004-0.008=-0.004
min885.505-885.504=0.001
max885.515-885.523=-0.009
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.735-0.723=0.012
σ0.016-0.025=-0.010
min0.712-0.680=0.033
max0.756-0.739=0.016

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.720=0.001
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean4.274-4.231=0.043
σ0.125-0.098=0.027
min4.131-4.071=0.060
max5.131-4.808=0.323
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean4.191-4.219=-0.028
σ0.070-0.083=-0.013
min4.067-4.090=-0.023
max4.467-4.528=-0.061
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.734-0.738=-0.004
σ0.019-0.021=-0.002
min0.695-0.701=-0.006
max0.848-0.855=-0.007
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.694-0.704=-0.009
σ0.017-0.015=0.001
min0.659-0.669=-0.010
max0.770-0.762=0.008

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.806-296.972=-0.165
σ0.271-0.206=0.064
min296.583-296.849=-0.266
max297.519-297.539=-0.021
mean1923.000-1929.000=-6.000
σ0.000
min1923.000-1929.000=-6.000
max1923.000-1929.000=-6.000
mean0.605-0.595=0.011
σ0.037-0.040=-0.003
min0.565-0.513=0.052
max0.698-0.672=0.026

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.827-286.824=0.004
σ0.038-0.036=0.001
min286.777-286.779=-0.002
max286.864-286.861=0.003
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.394-0.392=0.002
σ0.008-0.008=-0.000
min0.385-0.386=-0.001
max0.401-0.405=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1297.268-1297.243=0.026
σ0.099-0.063=0.036
min1297.134-1297.168=-0.034
max1297.401-1297.294=0.107
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean2.233-2.097=0.136
σ0.047-0.087=-0.040
min2.170-1.997=0.172
max2.280-2.201=0.079
iters=5
new-facts=6402
prior-facts=1
mean1541.371-1541.347=0.024
σ6.808-6.810=-0.002
min1538.192-1538.138=0.054
max1553.547-1553.525=0.022
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean2.331-2.308=0.023
σ0.211-0.132=0.079
min2.166-2.137=0.029
max2.647-2.471=0.176
iters=5
new-facts=6402
prior-facts=6402
mean1859.115-1859.102=0.013
σ0.067-0.091=-0.024
min1859.029-1858.959=0.070
max1859.192-1859.193=-0.001
mean1777.400-1786.000=-8.600
σ139.781-138.865=0.916
min1645.000-1652.000=-7.000
max1923.000-1929.000=-6.000
mean3.051-3.145=-0.094
σ0.155-0.361=-0.206
min2.852-2.859=-0.007
max3.214-3.767=-0.553

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.250-1.212=0.039
σ0.333-0.329=0.004
min0.928-0.942=-0.014
max1.796-1.762=0.034

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.821=0.001
σ581.372-581.370=0.002
min158.135-158.135=-0.001
max1320.880-1320.877=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.564-0.564=0.001
σ0.601-0.597=0.004
min0.261-0.263=-0.002
max1.466-1.459=0.007
policies=20
mean1581.631-1581.622=0.009
σ0.367-0.344=0.023
min1581.384-1581.389=-0.005
max1582.177-1582.134=0.043
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean2.643-2.615=0.027
σ0.009-0.012=-0.003
min2.630-2.599=0.032
max2.652-2.625=0.026
policies=200
mean15824.131-15824.232=-0.101
σ0.173-0.019=0.153
min15824.012-15824.206=-0.193
max15824.386-15824.252=0.134
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean26.645-26.671=-0.027
σ0.022-0.042=-0.020
min26.624-26.628=-0.004
max26.669-26.710=-0.041