Compare commits

Home / Compare 13a4bcb3 .. d99da350

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.013-54.014=-0.002
σ0.369-0.368=0.001
min53.879-53.866=0.012
max55.063-55.060=0.003
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.135-0.138=-0.004
σ0.005-0.004=0.001
min0.129-0.135=-0.006
max0.142-0.144=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.321-43.321=-0.000
σ0.007-0.006=0.001
min43.312-43.313=-0.001
max43.337-43.334=0.003
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.117-0.122=-0.005
σ0.003-0.004=-0.001
min0.115-0.118=-0.003
max0.122-0.130=-0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.307-1006.309=-0.003
σ1.165-1.182=-0.018
min1005.774-1005.765=0.008
max1011.178-1011.267=-0.089
mean1048.400-1051.150=-2.750
σ313.630-303.691=9.939
min598.000-586.000=12.000
max1646.000-1640.000=6.000
mean1.561-1.561=-0.000
σ0.079-0.103=-0.024
min1.478-1.471=0.007
max1.786-1.820=-0.034

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean0.416-0.423=-0.007
σ0.136-0.140=-0.004
min0.329-0.330=-0.001
max0.657-0.670=-0.014
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean0.895-0.916=-0.021
σ0.114-0.102=0.012
min0.828-0.832=-0.005
max1.097-1.090=0.007
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean0.575-0.551=0.024
σ0.074-0.056=0.018
min0.497-0.493=0.004
max0.673-0.625=0.048
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean0.861-0.870=-0.010
σ0.045-0.062=-0.017
min0.822-0.827=-0.005
max0.930-0.979=-0.049

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.113-964.113=-0.001
σ0.023-0.031=-0.008
min964.092-964.088=0.004
max964.151-964.164=-0.013
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean0.826-0.811=0.014
σ0.031-0.030=0.001
min0.795-0.783=0.012
max0.864-0.858=0.005
name=cdr_enhanced_4k_loc.art
mean884.713-884.711=0.001
σ0.006-0.007=-0.001
min884.705
max884.722-884.721=0.001
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean0.720-0.710=0.009
σ0.014-0.040=-0.026
min0.704-0.642=0.062
max0.738-0.739=-0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.719-7.718=0.001
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean3.504-4.214=-0.711
σ0.086-0.081=0.005
min3.368-4.094=-0.726
max3.850-4.663=-0.813
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666-7.669=-0.003
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean3.660-4.196=-0.536
σ0.332-0.060=0.271
min3.364-4.094=-0.730
max4.666-4.476=0.190
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean0.739-0.753=-0.014
σ0.029-0.044=-0.015
min0.587-0.714=-0.127
max0.880-1.062=-0.182
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean0.696-0.705=-0.009
σ0.029-0.022=0.008
min0.516-0.671=-0.155
max0.785-0.781=0.004

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.284-296.277=0.007
σ0.257-0.279=-0.022
min296.071-295.980=0.091
max296.967-296.999=-0.032
mean1905.000-1902.000=3.000
σ0.000
min1905.000-1902.000=3.000
max1905.000-1902.000=3.000
mean0.564-0.568=-0.004
σ0.043-0.043=0.000
min0.502-0.512=-0.010
max0.610-0.652=-0.041

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.676-284.704=-0.028
σ0.040-0.027=0.013
min284.639-284.677=-0.039
max284.735-284.735=-0.000
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean0.404-0.392=0.013
σ0.002-0.007=-0.005
min0.402-0.384=0.018
max0.408-0.403=0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.075-1295.077=-0.001
σ0.102-0.105=-0.003
min1294.961-1294.960=0.001
max1295.198-1295.206=-0.008
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean1.926-1.917=0.008
σ0.094-0.104=-0.010
min1.818-1.808=0.011
max2.034-2.037=-0.003
iters=5
new-facts=6402
prior-facts=1
mean1539.187-1539.184=0.003
σ6.857-6.828=0.029
min1535.917-1535.950=-0.032
max1551.450-1551.395=0.055
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean2.267-2.213=0.054
σ0.261-0.180=0.082
min2.060-2.058=0.002
max2.683-2.489=0.195
iters=5
new-facts=6402
prior-facts=6402
mean1856.991-1856.989=0.002
σ0.054-0.059=-0.005
min1856.938-1856.932=0.007
max1857.068-1857.076=-0.008
mean1775.800-1773.200=2.600
σ128.280-128.550=-0.271
min1646.000-1640.000=6.000
max1905.000-1902.000=3.000
mean3.003-3.045=-0.042
σ0.301-0.272=0.029
min2.683-2.827=-0.144
max3.486-3.502=-0.017

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.158-1.197=-0.039
σ0.304-0.289=0.014
min0.925-0.927=-0.002
max1.644-1.672=-0.028

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.784-447.784=-0.000
σ581.213-581.212=0.000
min157.174-157.176=-0.002
max1319.603-1319.602=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean0.542-0.535=0.006
σ0.564-0.553=0.011
min0.259-0.257=0.002
max1.388-1.364=0.023
policies=20
mean1572.086-1572.089=-0.003
σ0.355-0.363=-0.008
min1571.850-1571.841=0.008
max1572.614-1572.628=-0.014
mean920.000
σ0.000
min920.000
max920.000
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean2.624-2.628=-0.004
σ0.013-0.024=-0.012
min2.606-2.599=0.006
max2.634-2.658=-0.024
policies=200
mean15729.025-15729.009=0.017
σ0.074-0.167=-0.093
min15728.930-15728.823=0.107
max15729.106-15729.208=-0.103
mean9200.000
σ0.000
min9200.000
max9200.000
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean26.612-26.496=0.116
σ0.176-0.130=0.046
min26.474-26.402=0.072
max26.855-26.688=0.167