Compare commits

Home / Compare a8d87182 .. 7dd7ed8a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.054=0.001
σ0.369-0.370=-0.001
min53.910-53.910=-0.000
max55.105-55.107=-0.003
mean417.000
σ0.000
min417.000
max417.000
mean0.140-0.140=0.000
σ0.005-0.005=-0.000
min0.136-0.133=0.003
max0.151-0.148=0.003
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.001
σ0.006-0.006=0.000
min43.385-43.386=-0.001
max43.404-43.401=0.004
mean417.000
σ0.000
min417.000
max417.000
mean0.121-0.120=0.001
σ0.005-0.003=0.002
min0.114-0.114=0.000
max0.129-0.125=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.982-1007.001=-0.019
σ0.880-1.206=-0.326
min1006.482-1006.464=0.018
max1010.621-1012.057=-1.437
mean1059.400-1055.600=3.800
σ318.382-319.973=-1.591
min569.000-574.000=-5.000
max1638.000-1621.000=17.000
mean1.552-1.576=-0.023
σ0.072-0.078=-0.006
min1.478-1.499=-0.022
max1.766-1.841=-0.075

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.001
σ0.002-0.003=-0.000
min0.882
max0.887
mean1638.000-1621.000=17.000
σ0.000
min1638.000-1621.000=17.000
max1638.000-1621.000=17.000
mean0.409-0.419=-0.010
σ0.120-0.164=-0.044
min0.328-0.327=0.001
max0.619-0.711=-0.092
name=error_case.art
mean2.339-2.339=0.001
σ0.003-0.003=-0.000
min2.337
max2.342
mean1638.000-1621.000=17.000
σ0.000
min1638.000-1621.000=17.000
max1638.000-1621.000=17.000
mean0.881-0.883=-0.002
σ0.088-0.092=-0.004
min0.830-0.808=0.022
max1.036-1.042=-0.006
name=heavy_item.art
mean1.523-1.524=-0.001
σ0.001-0.002=-0.001
min1.522
max1.525-1.526=-0.001
mean1638.000-1621.000=17.000
σ0.000
min1638.000-1621.000=17.000
max1638.000-1621.000=17.000
mean0.564-0.526=0.037
σ0.075-0.053=0.022
min0.481-0.480=0.001
max0.644-0.610=0.035
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=0.000
min2.360
max2.364
mean1638.000-1621.000=17.000
σ0.000
min1638.000-1621.000=17.000
max1638.000-1621.000=17.000
mean0.855-0.853=0.002
σ0.056-0.030=0.026
min0.806-0.826=-0.020
max0.944-0.904=0.040

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.830-964.830=0.000
σ0.025-0.025=0.000
min964.802
max964.863-964.863=0.000
mean1638.000-1621.000=17.000
σ0.000
min1638.000-1621.000=17.000
max1638.000-1621.000=17.000
mean0.811-0.840=-0.029
σ0.041-0.024=0.017
min0.772-0.813=-0.041
max0.857-0.870=-0.013
name=cdr_enhanced_4k_loc.art
mean885.514-885.512=0.002
σ0.004-0.005=-0.000
min885.508-885.504=0.004
max885.518-885.517=0.001
mean1638.000-1621.000=17.000
σ0.000
min1638.000-1621.000=17.000
max1638.000-1621.000=17.000
mean0.725-0.707=0.018
σ0.041-0.034=0.007
min0.653-0.672=-0.019
max0.758-0.742=0.016

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.722=-0.003
mean1638.000-1621.000=17.000
σ0.000
min1638.000-1621.000=17.000
max1638.000-1621.000=17.000
mean4.271-3.549=0.722
σ0.069-0.090=-0.021
min4.136-3.378=0.758
max4.587-3.912=0.675
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1638.000-1621.000=17.000
σ0.000
min1638.000-1621.000=17.000
max1638.000-1621.000=17.000
mean4.256-3.546=0.710
σ0.081-0.090=-0.009
min4.103-3.413=0.691
max4.521-3.939=0.582
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1638.000-1621.000=17.000
σ0.000
min1638.000-1621.000=17.000
max1638.000-1621.000=17.000
mean0.748-0.645=0.103
σ0.017-0.106=-0.088
min0.709-0.518=0.191
max0.871-0.849=0.022
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1638.000-1621.000=17.000
σ0.000
min1638.000-1621.000=17.000
max1638.000-1621.000=17.000
mean0.600-0.514=0.086
σ0.103-0.041=0.062
min0.471-0.491=-0.021
max0.808-0.908=-0.099

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.659-296.965=-1.306
σ0.189-0.228=-0.039
min295.532-296.723=-1.191
max296.185-297.561=-1.376
mean1924.000-1907.000=17.000
σ0.000
min1924.000-1907.000=17.000
max1924.000-1907.000=17.000
mean0.565-0.584=-0.019
σ0.046-0.046=0.000
min0.499-0.513=-0.013
max0.668-0.673=-0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.405-286.826=-1.421
σ0.033-0.039=-0.006
min285.367-286.777=-1.410
max285.445-286.865=-1.421
mean1638.000-1621.000=17.000
σ0.000
min1638.000-1621.000=17.000
max1638.000-1621.000=17.000
mean0.389-0.396=-0.007
σ0.006-0.007=-0.001
min0.382-0.389=-0.007
max0.394-0.402=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1295.781-1297.270=-1.489
σ0.113-0.084=0.029
min1295.674-1297.164=-1.490
max1295.971-1297.380=-1.408
mean1638.000-1621.000=17.000
σ0.000
min1638.000-1621.000=17.000
max1638.000-1621.000=17.000
mean2.002-2.192=-0.189
σ0.187-0.037=0.151
min1.804-2.140=-0.337
max2.207-2.230=-0.023
iters=5
new-facts=6402
prior-facts=1
mean1540.014-1541.381=-1.367
σ6.805-6.815=-0.010
min1536.850-1538.189=-1.339
max1552.184-1553.568=-1.384
mean1638.000-1621.000=17.000
σ0.000
min1638.000-1621.000=17.000
max1638.000-1621.000=17.000
mean2.387-2.328=0.059
σ0.182-0.161=0.021
min2.138-2.139=-0.002
max2.593-2.498=0.095
iters=5
new-facts=6402
prior-facts=6402
mean1857.702-1859.113=-1.410
σ0.051-0.065=-0.014
min1857.654-1859.028=-1.374
max1857.772-1859.192=-1.420
mean1780.000-1768.600=11.400
σ139.755-135.686=4.069
min1638.000-1621.000=17.000
max1924.000-1907.000=17.000
mean3.020-3.108=-0.089
σ0.198-0.241=-0.043
min2.873-2.870=0.003
max3.362-3.454=-0.092

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.369-1.354=0.015
σ0.270-0.370=-0.100
min1.093-0.942=0.151
max1.819-1.791=0.029

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-448.819=-3.078
σ580.934-581.372=-0.437
min155.272-158.132=-2.860
max1317.142-1320.877=-3.734
mean96.250
σ8.500
min92.000
max109.000
mean1638.000-1621.000=17.000
σ0.000
min1638.000-1621.000=17.000
max1638.000-1621.000=17.000
mean0.535-0.532=0.003
σ0.555-0.534=0.021
min0.256-0.263=-0.007
max1.368-1.332=0.035
policies=20
mean1552.991-1581.605=-28.615
σ0.331-0.364=-0.032
min1552.762-1581.357=-28.595
max1553.482-1582.145=-28.663
mean920.000
σ0.000
min920.000
max920.000
mean1638.000-1621.000=17.000
σ0.000
min1638.000-1621.000=17.000
max1638.000-1621.000=17.000
mean2.588-2.635=-0.047
σ0.020-0.011=0.009
min2.567-2.623=-0.057
max2.613-2.649=-0.036
policies=200
mean15537.962-15824.207=-286.245
σ0.129-0.157=-0.028
min15537.827-15824.067=-286.239
max15538.108-15824.431=-286.322
mean9200.000
σ0.000
min9200.000
max9200.000
mean1638.000-1621.000=17.000
σ0.000
min1638.000-1621.000=17.000
max1638.000-1621.000=17.000
mean26.202-26.668=-0.466
σ0.136-0.054=0.081
min26.110-26.618=-0.509
max26.397-26.744=-0.347