Compare commits

Home / Compare 4a6ec7b3 .. 8ab9d161

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.051-54.045=0.005
σ0.368-0.369=-0.001
min53.907-53.900=0.008
max55.097-55.094=0.003
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.155-0.138=0.016
σ0.010-0.004=0.005
min0.135-0.131=0.004
max0.166-0.147=0.019
cache=y
dps=1
iters=10
policies=100
mean43.385-43.385=0.001
σ0.008-0.007=0.001
min43.375-43.373=0.002
max43.400-43.396=0.004
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.129-0.121=0.008
σ0.011-0.005=0.006
min0.119-0.114=0.005
max0.148-0.130=0.018

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.987-1006.978=0.009
σ0.865-0.876=-0.011
min1006.473-1006.514=-0.041
max1010.552-1010.612=-0.060
mean1056.800-1051.500=5.300
σ319.502-319.918=-0.416
min581.000-575.000=6.000
max1624.000-1620.000=4.000
mean1.538-1.558=-0.020
σ0.076-0.115=-0.039
min1.387-1.476=-0.089
max1.745-2.005=-0.259

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1624.000-1620.000=4.000
σ0.000
min1624.000-1620.000=4.000
max1624.000-1620.000=4.000
mean0.412-0.435=-0.022
σ0.134-0.183=-0.048
min0.336-0.331=0.005
max0.651-0.758=-0.107
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1624.000-1620.000=4.000
σ0.000
min1624.000-1620.000=4.000
max1624.000-1620.000=4.000
mean0.877-0.900=-0.023
σ0.088-0.143=-0.055
min0.815-0.811=0.004
max1.030-1.153=-0.123
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1624.000-1620.000=4.000
σ0.000
min1624.000-1620.000=4.000
max1624.000-1620.000=4.000
mean0.533-0.541=-0.008
σ0.044-0.050=-0.005
min0.487-0.494=-0.007
max0.607-0.624=-0.017
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1624.000-1620.000=4.000
σ0.000
min1624.000-1620.000=4.000
max1624.000-1620.000=4.000
mean0.846-0.852=-0.006
σ0.040-0.041=-0.000
min0.816-0.811=0.004
max0.914-0.915=-0.001

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.835=-0.004
σ0.024-0.030=-0.006
min964.803-964.810=-0.007
max964.859-964.884=-0.025
mean1624.000-1620.000=4.000
σ0.000
min1624.000-1620.000=4.000
max1624.000-1620.000=4.000
mean0.838-0.795=0.042
σ0.034-0.079=-0.045
min0.777-0.704=0.072
max0.857-0.855=0.003
name=cdr_enhanced_4k_loc.art
mean885.513-885.513=-0.000
σ0.009-0.004=0.005
min885.504-885.508=-0.004
max885.524-885.518=0.007
mean1624.000-1620.000=4.000
σ0.000
min1624.000-1620.000=4.000
max1624.000-1620.000=4.000
mean0.647-0.712=-0.066
σ0.098-0.029=0.069
min0.530-0.669=-0.139
max0.728-0.747=-0.019

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719
mean1624.000-1620.000=4.000
σ0.000
min1624.000-1620.000=4.000
max1624.000-1620.000=4.000
mean2.615-4.217=-1.602
σ0.100-0.091=0.010
min2.432-4.087=-1.655
max3.011-4.691=-1.680
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1624.000-1620.000=4.000
σ0.000
min1624.000-1620.000=4.000
max1624.000-1620.000=4.000
mean2.599-4.211=-1.612
σ0.100-0.078=0.022
min2.438-4.069=-1.631
max3.172-4.442=-1.269
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1624.000-1620.000=4.000
σ0.000
min1624.000-1620.000=4.000
max1624.000-1620.000=4.000
mean0.303-0.735=-0.433
σ0.008-0.017=-0.009
min0.289-0.705=-0.416
max0.344-0.846=-0.502
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1624.000-1620.000=4.000
σ0.000
min1624.000-1620.000=4.000
max1624.000-1620.000=4.000
mean0.288-0.698=-0.410
σ0.011-0.014=-0.004
min0.275-0.664=-0.389
max0.362-0.766=-0.403

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.628-295.573=0.055
σ0.184-0.218=-0.034
min295.463-295.439=0.024
max296.128-296.173=-0.044
mean1914.000-2033.000=-119.000
σ0.000
min1914.000-2033.000=-119.000
max1914.000-2033.000=-119.000
mean0.562-0.538=0.025
σ0.068-0.035=0.033
min0.448-0.496=-0.048
max0.646-0.575=0.071

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.409-285.410=-0.001
σ0.038-0.036=0.002
min285.358-285.365=-0.007
max285.447-285.445=0.002
mean1624.000-1620.000=4.000
σ0.000
min1624.000-1620.000=4.000
max1624.000-1620.000=4.000
mean0.387-0.389=-0.001
σ0.006-0.008=-0.002
min0.383-0.382=0.001
max0.397-0.401=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.809-1295.795=0.014
σ0.121-0.107=0.014
min1295.680-1295.677=0.003
max1295.983-1295.919=0.063
mean1624.000-1620.000=4.000
σ0.000
min1624.000-1620.000=4.000
max1624.000-1620.000=4.000
mean1.882-1.911=-0.029
σ0.086-0.126=-0.040
min1.799-1.800=-0.001
max2.013-2.062=-0.049
iters=5
new-facts=6402
prior-facts=1
mean1539.909-1539.963=-0.054
σ6.863-6.839=0.024
min1536.623-1536.686=-0.063
max1552.181-1552.192=-0.011
mean1624.000-1620.000=4.000
σ0.000
min1624.000-1620.000=4.000
max1624.000-1620.000=4.000
mean2.238-2.408=-0.170
σ0.215-0.166=0.049
min2.008-2.142=-0.134
max2.489-2.590=-0.101
iters=5
new-facts=6402
prior-facts=6402
mean1857.706-1857.704=0.002
σ0.056-0.058=-0.002
min1857.651-1857.646=0.005
max1857.787-1857.782=0.005
mean1781.200-1777.800=3.400
σ137.787-178.887=-41.101
min1624.000-1620.000=4.000
max1914.000-2033.000=-119.000
mean3.068-3.124=-0.055
σ0.257-0.308=-0.051
min2.872-2.854=0.018
max3.511-3.611=-0.100

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.385-1.316=0.068
σ0.292-0.293=-0.001
min1.110-1.104=0.006
max1.874-1.817=0.057

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.740=0.001
σ580.934-580.935=-0.001
min155.273-155.271=0.002
max1317.142-1317.142=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1624.000-1620.000=4.000
σ0.000
min1624.000-1620.000=4.000
max1624.000-1620.000=4.000
mean0.562-0.540=0.022
σ0.585-0.557=0.027
min0.262-0.256=0.005
max1.438-1.376=0.063
policies=20
mean1552.991-1552.994=-0.003
σ0.351-0.333=0.018
min1552.755-1552.765=-0.009
max1553.513-1553.488=0.025
mean920.000
σ0.000
min920.000
max920.000
mean1624.000-1620.000=4.000
σ0.000
min1624.000-1620.000=4.000
max1624.000-1620.000=4.000
mean2.618-2.598=0.020
σ0.056-0.012=0.044
min2.565-2.587=-0.022
max2.698-2.612=0.086
policies=200
mean15538.045-15538.052=-0.006
σ0.062-0.081=-0.019
min15537.970-15537.969=0.001
max15538.120-15538.129=-0.009
mean9200.000
σ0.000
min9200.000
max9200.000
mean1624.000-1620.000=4.000
σ0.000
min1624.000-1620.000=4.000
max1624.000-1620.000=4.000
mean26.211-26.254=-0.044
σ0.140-0.195=-0.055
min26.114-26.076=0.038
max26.412-26.532=-0.120