Compare commits

Home / Compare 8740ac3a .. 18c809a9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.012-54.016=-0.003
σ0.369-0.369=-0.000
min53.872-53.870=0.001
max55.063-55.066=-0.003
mean416.000
σ0.000
min416.000
max416.000
mean0.139-0.140=-0.001
σ0.005-0.005=0.000
min0.134-0.136=-0.002
max0.146-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.322-43.324=-0.002
σ0.006-0.005=0.001
min43.312-43.313=-0.001
max43.333-43.331=0.002
mean416.000
σ0.000
min416.000
max416.000
mean0.121-0.121=-0.000
σ0.005-0.004=0.001
min0.114-0.116=-0.002
max0.129-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.312-1006.307=0.005
σ1.160-1.180=-0.019
min1005.762-1005.771=-0.009
max1011.164-1011.225=-0.060
mean1047.150-1047.250=-0.100
σ313.716-313.828=-0.112
min596.000-595.000=1.000
max1645.000-1643.000=2.000
mean1.567-1.582=-0.015
σ0.094-0.120=-0.026
min1.478-1.474=0.004
max1.804-1.961=-0.157

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.419-0.413=0.006
σ0.141-0.152=-0.011
min0.325-0.328=-0.003
max0.661-0.683=-0.023
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.863-0.875=-0.012
σ0.087-0.101=-0.014
min0.797-0.804=-0.006
max1.014-1.050=-0.035
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.534-0.532=0.002
σ0.048-0.053=-0.005
min0.498-0.490=0.009
max0.618-0.620=-0.002
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.824-0.839=-0.015
σ0.041-0.027=0.014
min0.798-0.820=-0.023
max0.891-0.885=0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.115=0.000
σ0.034-0.034=-0.000
min964.085-964.086=-0.001
max964.170-964.171=-0.001
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.812-0.831=-0.019
σ0.047-0.024=0.023
min0.735-0.810=-0.075
max0.850-0.866=-0.016
name=cdr_enhanced_4k_loc.art
mean884.711-884.711=-0.001
σ0.007-0.007=0.000
min884.703-884.705=-0.001
max884.722-884.722=0.000
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.694-0.709=-0.015
σ0.057-0.044=0.013
min0.601-0.659=-0.057
max0.741-0.747=-0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.714=0.000
σ0.002-0.002=-0.000
min7.714
max7.718
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean4.233-4.212=0.021
σ0.094-0.075=0.020
min4.091-4.081=0.009
max4.531-4.559=-0.029
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666-7.667=-0.001
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean4.182-4.193=-0.011
σ0.069-0.059=0.010
min4.066-4.057=0.009
max4.494-4.382=0.112
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.733-0.732=0.000
σ0.019-0.020=-0.001
min0.698-0.698=-0.001
max0.857-0.854=0.003
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.695-0.700=-0.005
σ0.015-0.018=-0.003
min0.666-0.627=0.039
max0.779-0.775=0.005

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.194-296.114=0.080
σ0.268-0.202=0.066
min296.041-295.949=0.093
max296.951-296.636=0.315
mean1897.000-1918.000=-21.000
σ0.000
min1897.000-1918.000=-21.000
max1897.000-1918.000=-21.000
mean0.558-0.584=-0.025
σ0.038-0.050=-0.012
min0.503-0.520=-0.017
max0.597-0.702=-0.105

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.697-284.697=0.001
σ0.035-0.035=0.000
min284.653-284.646=0.007
max284.740-284.731=0.009
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.398-0.403=-0.005
σ0.011-0.009=0.002
min0.385-0.388=-0.003
max0.407-0.411=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.087-1295.080=0.007
σ0.121-0.111=0.009
min1294.960-1294.960=0.001
max1295.239-1295.225=0.014
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean1.915-1.905=0.011
σ0.097-0.063=0.034
min1.798-1.825=-0.027
max1.999-1.969=0.030
iters=5
new-facts=6402
prior-facts=1
mean1539.179-1539.189=-0.010
σ6.838-6.868=-0.030
min1535.877-1535.881=-0.005
max1551.407-1551.470=-0.063
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean2.281-2.302=-0.022
σ0.229-0.233=-0.004
min2.026-2.049=-0.023
max2.514-2.522=-0.008
iters=5
new-facts=6402
prior-facts=6402
mean1856.984-1856.982=0.002
σ0.057-0.056=0.000
min1856.931-1856.935=-0.004
max1857.067-1857.070=-0.003
mean1769.200-1776.400=-7.200
σ122.316-136.983=-14.667
min1645.000-1643.000=2.000
max1897.000-1918.000=-21.000
mean3.057-3.027=0.030
σ0.271-0.312=-0.042
min2.840-2.686=0.154
max3.519-3.538=-0.019

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.214-1.171=0.044
σ0.324-0.228=0.096
min0.937-0.943=-0.006
max1.756-1.531=0.225

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.787-447.786=0.000
σ581.212-581.212=-0.000
min157.179-157.179=0.000
max1319.605
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.539-0.538=0.001
σ0.549-0.556=-0.007
min0.263-0.257=0.006
max1.363-1.373=-0.010
policies=20
mean1572.100-1572.102=-0.001
σ0.348-0.348=0.000
min1571.865-1571.865=-0.000
max1572.617-1572.618=-0.001
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean2.615-2.621=-0.005
σ0.011-0.012=-0.000
min2.603-2.604=-0.001
max2.627-2.629=-0.003
policies=200
mean15729.075-15729.068=0.006
σ0.064-0.127=-0.063
min15729.029-15728.954=0.076
max15729.167-15729.242=-0.075
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean26.476-26.499=-0.023
σ0.046-0.061=-0.015
min26.427-26.407=0.020
max26.538-26.531=0.007