Compare commits

Home / Compare b281d642 .. 4a298f59

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.965-53.964=0.001
σ0.370-0.370=0.000
min53.821-53.821=-0.000
max55.016-55.015=0.001
mean417.000
σ0.000
min417.000
max417.000
mean0.136-0.140=-0.004
σ0.005-0.004=0.001
min0.129-0.136=-0.007
max0.143-0.147=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.002
σ0.006-0.006=-0.000
min43.314-43.310=0.004
max43.334-43.334=0.000
mean417.000
σ0.000
min417.000
max417.000
mean0.120-0.122=-0.001
σ0.005-0.004=0.001
min0.113-0.118=-0.005
max0.127-0.130=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.521-1006.515=0.006
σ1.172-1.158=0.013
min1005.947-1005.948=-0.001
max1011.423-1011.362=0.060
mean1054.750-1044.450=10.300
σ312.362-311.657=0.705
min557.000-598.000=-41.000
max1519.000-1632.000=-113.000
mean1.512-1.535=-0.023
σ0.088-0.065=0.024
min1.365-1.462=-0.097
max1.767-1.696=0.070

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1519.000-1632.000=-113.000
σ0.000
min1519.000-1632.000=-113.000
max1519.000-1632.000=-113.000
mean0.417-0.421=-0.004
σ0.143-0.153=-0.011
min0.341-0.331=0.010
max0.671-0.694=-0.023
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1519.000-1632.000=-113.000
σ0.000
min1519.000-1632.000=-113.000
max1519.000-1632.000=-113.000
mean0.883-0.882=0.001
σ0.092-0.108=-0.017
min0.804-0.808=-0.005
max1.040-1.072=-0.033
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1519.000-1632.000=-113.000
σ0.000
min1519.000-1632.000=-113.000
max1519.000-1632.000=-113.000
mean0.530-0.535=-0.005
σ0.046-0.053=-0.007
min0.496-0.493=0.003
max0.608-0.625=-0.018
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1519.000-1632.000=-113.000
σ0.000
min1519.000-1632.000=-113.000
max1519.000-1632.000=-113.000
mean0.837-0.852=-0.015
σ0.043-0.042=0.001
min0.803-0.813=-0.010
max0.910-0.917=-0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.839=-0.008
σ0.038-0.033=0.005
min964.806-964.810=-0.005
max964.897-964.894=0.004
mean1519.000-1632.000=-113.000
σ0.000
min1519.000-1632.000=-113.000
max1519.000-1632.000=-113.000
mean0.835-0.827=0.008
σ0.029-0.038=-0.010
min0.784-0.765=0.019
max0.855-0.858=-0.003
name=cdr_enhanced_4k_loc.art
mean885.510-885.513=-0.002
σ0.008-0.008=-0.000
min885.504
max885.521-885.523=-0.002
mean1519.000-1632.000=-113.000
σ0.000
min1519.000-1632.000=-113.000
max1519.000-1632.000=-113.000
mean0.714-0.708=0.006
σ0.042-0.031=0.011
min0.664-0.671=-0.007
max0.754-0.737=0.017

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.720=0.000
mean1519.000-1632.000=-113.000
σ0.000
min1519.000-1632.000=-113.000
max1519.000-1632.000=-113.000
mean4.264-4.243=0.021
σ0.089-0.087=0.002
min4.124-4.089=0.035
max4.581-4.597=-0.017
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=-0.000
min7.664
max7.668
mean1519.000-1632.000=-113.000
σ0.000
min1519.000-1632.000=-113.000
max1519.000-1632.000=-113.000
mean4.261-4.237=0.025
σ0.084-0.095=-0.011
min4.105-4.076=0.029
max4.596-4.528=0.068
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1519.000-1632.000=-113.000
σ0.000
min1519.000-1632.000=-113.000
max1519.000-1632.000=-113.000
mean0.740-0.737=0.003
σ0.016-0.016=-0.000
min0.715-0.710=0.006
max0.857-0.843=0.015
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1519.000-1632.000=-113.000
σ0.000
min1519.000-1632.000=-113.000
max1519.000-1632.000=-113.000
mean0.697-0.698=-0.001
σ0.015-0.016=-0.001
min0.670-0.671=-0.002
max0.772-0.783=-0.011

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.353-296.313=0.040
σ0.210-0.236=-0.026
min296.216-296.166=0.050
max296.932-296.965=-0.033
mean2031.000-2022.000=9.000
σ0.000
min2031.000-2022.000=9.000
max2031.000-2022.000=9.000
mean0.576-0.570=0.006
σ0.026-0.034=-0.008
min0.518-0.510=0.008
max0.598-0.606=-0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.031-285.042=-0.011
σ0.039-0.026=0.012
min284.983-285.014=-0.030
max285.075-285.075=0.001
mean1519.000-1632.000=-113.000
σ0.000
min1519.000-1632.000=-113.000
max1519.000-1632.000=-113.000
mean0.393-0.393=-0.000
σ0.008-0.009=-0.001
min0.383-0.385=-0.002
max0.405-0.408=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.424-1295.422=0.002
σ0.121-0.109=0.012
min1295.295-1295.299=-0.004
max1295.590-1295.561=0.029
mean1519.000-1632.000=-113.000
σ0.000
min1519.000-1632.000=-113.000
max1519.000-1632.000=-113.000
mean1.889-1.902=-0.013
σ0.091-0.100=-0.010
min1.807-1.818=-0.012
max2.025-2.055=-0.030
iters=5
new-facts=6402
prior-facts=1
mean1539.541-1539.523=0.019
σ6.784-6.831=-0.047
min1536.269-1536.265=0.004
max1551.672-1551.739=-0.067
mean1519.000-1632.000=-113.000
σ0.000
min1519.000-1632.000=-113.000
max1519.000-1632.000=-113.000
mean2.258-2.246=0.012
σ0.258-0.222=0.036
min2.003-2.054=-0.051
max2.634-2.580=0.054
iters=5
new-facts=6402
prior-facts=6402
mean1857.333-1857.333=0.000
σ0.069-0.051=0.017
min1857.239-1857.276=-0.037
max1857.397-1857.402=-0.004
mean1738.600-1769.600=-31.000
σ212.893-171.261=41.632
min1519.000-1632.000=-113.000
max2031.000-2022.000=9.000
mean2.892-2.883=0.009
σ0.071-0.106=-0.035
min2.822-2.723=0.099
max2.987-3.006=-0.019

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.561-1.221=0.340
σ0.191-0.259=-0.067
min1.258-0.930=0.328
max1.738-1.614=0.124

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.190-448.191=-0.001
σ581.332-581.331=0.001
min157.521-157.524=-0.004
max1320.188-1320.188=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1519.000-1632.000=-113.000
σ0.000
min1519.000-1632.000=-113.000
max1519.000-1632.000=-113.000
mean0.526-0.560=-0.035
σ0.529-0.576=-0.048
min0.257-0.268=-0.011
max1.319-1.425=-0.106
policies=20
mean1575.565-1575.571=-0.006
σ0.349-0.351=-0.002
min1575.330-1575.330=-0.001
max1576.084-1576.092=-0.008
mean920.000
σ0.000
min920.000
max920.000
mean1519.000-1632.000=-113.000
σ0.000
min1519.000-1632.000=-113.000
max1519.000-1632.000=-113.000
mean2.623-2.622=0.001
σ0.020-0.016=0.004
min2.603-2.607=-0.005
max2.646-2.643=0.003
policies=200
mean15763.664-15763.666=-0.001
σ0.154-0.164=-0.010
min15763.564-15763.581=-0.016
max15763.892-15763.911=-0.019
mean9200.000
σ0.000
min9200.000
max9200.000
mean1519.000-1632.000=-113.000
σ0.000
min1519.000-1632.000=-113.000
max1519.000-1632.000=-113.000
mean26.484-26.476=0.008
σ0.040-0.058=-0.018
min26.437-26.411=0.025
max26.526-26.550=-0.024