Compare commits

Home / Compare 6558e5a7 .. d96780e4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.056=-0.000
σ0.368-0.369=-0.000
min53.914-53.917=-0.004
max55.103-55.105=-0.002
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.140-0.140=0.000
σ0.004-0.004=0.000
min0.136-0.136=-0.000
max0.147-0.147=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.395-43.394=0.001
σ0.006-0.007=-0.001
min43.385-43.387=-0.002
max43.404-43.404=0.000
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.123-0.121=0.001
σ0.003-0.004=-0.001
min0.119-0.116=0.004
max0.129-0.127=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.978-1006.981=-0.003
σ0.878-0.871=0.007
min1006.488-1006.484=0.004
max1010.616-1010.586=0.030
mean1044.950-1042.650=2.300
σ313.891-314.008=-0.117
min574.000-573.000=1.000
max1641.000-1637.000=4.000
mean1.535-1.568=-0.033
σ0.079-0.093=-0.014
min1.394-1.467=-0.073
max1.805-1.826=-0.021

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.001
σ0.002-0.003=-0.000
min0.882
max0.887
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean0.429-0.427=0.002
σ0.149-0.147=0.003
min0.333-0.336=-0.003
max0.692-0.688=0.004
name=error_case.art
mean2.339-2.339=0.001
σ0.003-0.003=-0.000
min2.337
max2.342
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean0.939-0.921=0.018
σ0.079-0.087=-0.008
min0.855-0.841=0.014
max1.048-1.047=0.001
name=heavy_item.art
mean1.523-1.524=-0.001
σ0.001-0.002=-0.001
min1.522
max1.525-1.526=-0.001
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean0.545-0.533=0.012
σ0.057-0.051=0.006
min0.504-0.487=0.018
max0.645-0.614=0.031
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=0.000
min2.360
max2.364
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean0.848-0.840=0.008
σ0.050-0.035=0.015
min0.805-0.807=-0.003
max0.931-0.900=0.030

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.830=0.009
σ0.033-0.030=0.003
min964.813-964.802=0.011
max964.893-964.876=0.017
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean0.816-0.823=-0.006
σ0.048-0.027=0.021
min0.751-0.800=-0.050
max0.864-0.854=0.010
name=cdr_enhanced_4k_loc.art
mean885.513-885.513=-0.000
σ0.007-0.009=-0.002
min885.505-885.504=0.001
max885.521-885.523=-0.002
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean0.708-0.723=-0.015
σ0.034-0.017=0.017
min0.670-0.696=-0.026
max0.736-0.736=-0.000

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.002
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean3.503-4.208=-0.705
σ0.110-0.081=0.029
min3.376-4.085=-0.709
max4.268-4.522=-0.254
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean3.513-4.208=-0.696
σ0.227-0.076=0.152
min3.320-4.072=-0.752
max4.387-4.434=-0.047
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean0.747-0.738=0.009
σ0.018-0.018=0.000
min0.720-0.701=0.019
max0.850-0.847=0.004
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean0.702-0.693=0.009
σ0.016-0.015=0.001
min0.664-0.661=0.003
max0.779-0.769=0.010

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.592-295.674=-0.082
σ0.205-0.154=0.051
min295.427-295.456=-0.029
max296.146-296.045=0.101
mean1928.000-1890.000=38.000
σ0.000
min1928.000-1890.000=38.000
max1928.000-1890.000=38.000
mean0.578-0.574=0.005
σ0.048-0.048=0.000
min0.498-0.511=-0.013
max0.695-0.661=0.033

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.406-285.416=-0.010
σ0.035-0.031=0.004
min285.357-285.382=-0.025
max285.439-285.451=-0.012
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean0.390-0.390=-0.001
σ0.009-0.010=-0.001
min0.380-0.381=-0.001
max0.397-0.404=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1295.801-1295.793=0.008
σ0.115-0.100=0.016
min1295.677-1295.685=-0.008
max1295.932-1295.909=0.024
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean1.941-1.907=0.034
σ0.088-0.089=-0.001
min1.826-1.815=0.012
max2.028-2.019=0.009
iters=5
new-facts=6402
prior-facts=1
mean1539.940-1539.936=0.003
σ6.889-6.917=-0.027
min1536.632-1536.562=0.069
max1552.257-1552.302=-0.045
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean2.370-2.403=-0.034
σ0.210-0.343=-0.133
min2.112-2.059=0.054
max2.635-2.855=-0.220
iters=5
new-facts=6402
prior-facts=6402
mean1857.719-1857.702=0.018
σ0.084-0.053=0.031
min1857.624-1857.653=-0.029
max1857.824-1857.780=0.044
mean1780.800-1770.200=10.600
σ143.738-122.013=21.725
min1641.000-1637.000=4.000
max1928.000-1890.000=38.000
mean3.077-3.047=0.030
σ0.282-0.225=0.057
min2.837-2.858=-0.021
max3.553-3.432=0.121

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.259-1.438=-0.179
σ0.342-0.288=0.054
min0.935-1.101=-0.166
max1.823-1.844=-0.021

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.739-445.739=-0.000
σ580.934-580.934=0.000
min155.271-155.271=-0.000
max1317.141-1317.141=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean0.533-0.543=-0.010
σ0.548-0.571=-0.023
min0.257-0.255=0.002
max1.354-1.399=-0.045
policies=20
mean1552.959-1552.969=-0.010
σ0.315-0.319=-0.004
min1552.746-1552.748=-0.002
max1553.427-1553.443=-0.016
mean920.000
σ0.000
min920.000
max920.000
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean2.577-2.577=0.001
σ0.033-0.008=0.025
min2.540-2.569=-0.029
max2.620-2.588=0.031
policies=200
mean15537.992-15537.995=-0.003
σ0.144-0.074=0.071
min15537.848-15537.908=-0.059
max15538.174-15538.088=0.087
mean9200.000
σ0.000
min9200.000
max9200.000
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean26.113-26.182=-0.068
σ0.029-0.246=-0.218
min26.073-26.051=0.022
max26.140-26.551=-0.411