Compare commits

Home / Compare c186a03c .. f1f537ca

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.057=-0.001
σ0.368-0.369=-0.001
min53.917-53.907=0.010
max55.101-55.106=-0.005
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.138-0.139=-0.001
σ0.004-0.004=-0.000
min0.135-0.136=-0.001
max0.145-0.145=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.395-43.394=0.001
σ0.004-0.006=-0.001
min43.387-43.386=0.002
max43.403-43.403=-0.001
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.130-0.122=0.008
σ0.011-0.005=0.006
min0.114-0.115=-0.000
max0.146-0.131=0.015

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.985-1006.978=0.007
σ0.852-0.878=-0.026
min1006.481-1006.481=-0.001
max1010.484-1010.620=-0.136
mean1045.600-1044.250=1.350
σ314.243-305.980=8.263
min575.000-576.000=-1.000
max1643.000-1660.000=-17.000
mean1.556-1.544=0.012
σ0.077-0.081=-0.004
min1.493-1.429=0.064
max1.804-1.805=-0.000

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1643.000-1660.000=-17.000
σ0.000
min1643.000-1660.000=-17.000
max1643.000-1660.000=-17.000
mean0.425-0.415=0.011
σ0.135-0.136=-0.000
min0.345-0.336=0.009
max0.666-0.656=0.010
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1643.000-1660.000=-17.000
σ0.000
min1643.000-1660.000=-17.000
max1643.000-1660.000=-17.000
mean0.881-0.879=0.002
σ0.089-0.090=-0.002
min0.825-0.816=0.009
max1.037-1.037=-0.000
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1643.000-1660.000=-17.000
σ0.000
min1643.000-1660.000=-17.000
max1643.000-1660.000=-17.000
mean0.539-0.535=0.005
σ0.060-0.053=0.007
min0.490-0.489=0.001
max0.644-0.621=0.023
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1643.000-1660.000=-17.000
σ0.000
min1643.000-1660.000=-17.000
max1643.000-1660.000=-17.000
mean0.856-0.851=0.005
σ0.036-0.049=-0.013
min0.833-0.808=0.026
max0.919-0.931=-0.012

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.840=-0.009
σ0.036-0.033=0.003
min964.810-964.811=-0.001
max964.895-964.894=0.001
mean1643.000-1660.000=-17.000
σ0.000
min1643.000-1660.000=-17.000
max1643.000-1660.000=-17.000
mean0.805-0.796=0.008
σ0.033-0.067=-0.033
min0.782-0.705=0.078
max0.863-0.862=0.001
name=cdr_enhanced_4k_loc.art
mean885.511-885.513=-0.002
σ0.006-0.008=-0.003
min885.504-885.506=-0.001
max885.516-885.525=-0.009
mean1643.000-1660.000=-17.000
σ0.000
min1643.000-1660.000=-17.000
max1643.000-1660.000=-17.000
mean0.707-0.708=-0.002
σ0.054-0.055=-0.001
min0.616-0.615=0.001
max0.755-0.752=0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.720-7.721=-0.001
mean1643.000-1660.000=-17.000
σ0.000
min1643.000-1660.000=-17.000
max1643.000-1660.000=-17.000
mean4.268-4.209=0.059
σ0.093-0.108=-0.016
min4.119-3.589=0.531
max4.668-4.674=-0.006
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.002
mean1643.000-1660.000=-17.000
σ0.000
min1643.000-1660.000=-17.000
max1643.000-1660.000=-17.000
mean3.950-4.196=-0.246
σ0.372-0.140=0.232
min3.409-3.551=-0.142
max4.536-4.509=0.027
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1643.000-1660.000=-17.000
σ0.000
min1643.000-1660.000=-17.000
max1643.000-1660.000=-17.000
mean0.749-0.741=0.008
σ0.017-0.017=0.000
min0.720-0.715=0.006
max0.852-0.849=0.002
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1643.000-1660.000=-17.000
σ0.000
min1643.000-1660.000=-17.000
max1643.000-1660.000=-17.000
mean0.703-0.708=-0.005
σ0.014-0.014=0.000
min0.673-0.674=-0.001
max0.777-0.768=0.009

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.530-295.554=-0.025
σ0.267-0.234=0.033
min295.234-295.379=-0.144
max296.045-296.188=-0.143
mean1911.000-2048.000=-137.000
σ0.000
min1911.000-2048.000=-137.000
max1911.000-2048.000=-137.000
mean0.586-0.569=0.017
σ0.032-0.036=-0.004
min0.514-0.514=-0.000
max0.623-0.602=0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.411-285.407=0.004
σ0.035-0.039=-0.003
min285.368-285.356=0.013
max285.448-285.446=0.001
mean1643.000-1660.000=-17.000
σ0.000
min1643.000-1660.000=-17.000
max1643.000-1660.000=-17.000
mean0.386-0.389=-0.003
σ0.006-0.010=-0.004
min0.381-0.381=0.000
max0.393-0.402=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1295.791-1295.792=-0.001
σ0.108-0.107=0.001
min1295.671-1295.669=0.002
max1295.918-1295.910=0.008
mean1643.000-1660.000=-17.000
σ0.000
min1643.000-1660.000=-17.000
max1643.000-1660.000=-17.000
mean1.890-1.879=0.011
σ0.084-0.081=0.003
min1.807-1.796=0.011
max1.989-1.984=0.005
iters=5
new-facts=6402
prior-facts=1
mean1539.941-1539.932=0.009
σ6.854-6.861=-0.007
min1536.651-1536.636=0.015
max1552.196-1552.201=-0.004
mean1643.000-1660.000=-17.000
σ0.000
min1643.000-1660.000=-17.000
max1643.000-1660.000=-17.000
mean2.330-2.345=-0.015
σ0.224-0.101=0.123
min2.055-2.182=-0.127
max2.599-2.438=0.162
iters=5
new-facts=6402
prior-facts=6402
mean1857.706-1857.706=0.001
σ0.055-0.063=-0.008
min1857.651-1857.648=0.003
max1857.785-1857.791=-0.006
mean1782.200-1800.400=-18.200
σ131.686-167.953=-36.267
min1643.000-1660.000=-17.000
max1911.000-2048.000=-137.000
mean3.120-2.946=0.174
σ0.334-0.092=0.242
min2.858-2.841=0.016
max3.700-3.068=0.632

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.490-1.269=0.221
σ0.265-0.323=-0.058
min1.108-0.945=0.162
max1.725-1.790=-0.065

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.742=-0.001
σ580.935-580.934=0.001
min155.270-155.273=-0.003
max1317.142-1317.143=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1660.000=-17.000
σ0.000
min1643.000-1660.000=-17.000
max1643.000-1660.000=-17.000
mean0.540-0.551=-0.011
σ0.558-0.582=-0.024
min0.257-0.255=0.002
max1.378-1.424=-0.047
policies=20
mean1552.993-1552.993=-0.000
σ0.333-0.328=0.004
min1552.761-1552.771=-0.009
max1553.487-1553.481=0.005
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1660.000=-17.000
σ0.000
min1643.000-1660.000=-17.000
max1643.000-1660.000=-17.000
mean2.597-2.592=0.005
σ0.020-0.018=0.002
min2.575-2.570=0.005
max2.623-2.609=0.014
policies=200
mean15538.053-15538.005=0.048
σ0.054-0.059=-0.005
min15537.996-15537.935=0.061
max15538.105-15538.071=0.034
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1660.000=-17.000
σ0.000
min1643.000-1660.000=-17.000
max1643.000-1660.000=-17.000
mean26.250-26.172=0.078
σ0.204-0.138=0.066
min26.109-26.009=0.101
max26.551-26.336=0.215