Compare commits

Home / Compare bdc2bee1 .. 5862b1ef

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.712-53.709=0.003
σ0.367-0.371=-0.004
min53.571-53.563=0.008
max54.755-54.765=-0.009
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.148-0.140=0.009
σ0.010-0.004=0.007
min0.135-0.137=-0.002
max0.165-0.147=0.018
cache=y
dps=1
iters=10
policies=100
mean43.061-43.058=0.003
σ0.007-0.006=0.001
min43.046-43.048=-0.001
max43.072-43.065=0.007
mean416.000
σ0.000
min416.000
max416.000
mean0.134-0.120=0.013
σ0.012-0.002=0.010
min0.118-0.116=0.002
max0.147-0.125=0.022

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.105-1005.105=0.000
σ0.900-0.886=0.014
min1004.641-1004.634=0.006
max1008.837-1008.779=0.058
mean1049.000-1061.300=-12.300
σ315.131-328.217=-13.085
min593.000-551.000=42.000
max1653.000-1628.000=25.000
mean1.636-1.639=-0.003
σ0.079-0.093=-0.015
min1.561-1.556=0.006
max1.867-1.915=-0.049

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.906-0.906=0.000
σ0.003-0.003=0.000
min0.904
max0.910-0.910=0.000
mean1653.000-1628.000=25.000
σ0.000
min1653.000-1628.000=25.000
max1653.000-1628.000=25.000
mean0.447-0.441=0.006
σ0.145-0.161=-0.016
min0.340-0.340=0.000
max0.681-0.726=-0.045
name=error_case.art
mean2.336-2.335=0.000
σ0.003-0.003=-0.001
min2.333
max2.339-2.340=-0.002
mean1653.000-1628.000=25.000
σ0.000
min1653.000-1628.000=25.000
max1653.000-1628.000=25.000
mean0.881-0.873=0.008
σ0.106-0.106=0.000
min0.817-0.803=0.014
max1.068-1.057=0.011
name=heavy_item.art
mean1.521-1.522=-0.001
σ0.001-0.002=-0.001
min1.521
max1.524-1.525=-0.001
mean1653.000-1628.000=25.000
σ0.000
min1653.000-1628.000=25.000
max1653.000-1628.000=25.000
mean0.534-0.549=-0.015
σ0.048-0.047=0.002
min0.492-0.507=-0.015
max0.611-0.627=-0.016
name=nested_use.art
mean2.358-2.357=0.001
σ0.002-0.002=0.000
min2.356
max2.360
mean1653.000-1628.000=25.000
σ0.000
min1653.000-1628.000=25.000
max1653.000-1628.000=25.000
mean0.842-0.833=0.010
σ0.033-0.039=-0.007
min0.813-0.804=0.009
max0.895-0.900=-0.004

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.439-964.443=-0.003
σ0.023-0.024=-0.001
min964.412-964.423=-0.011
max964.465-964.483=-0.017
mean1653.000-1628.000=25.000
σ0.000
min1653.000-1628.000=25.000
max1653.000-1628.000=25.000
mean0.841-0.841=0.000
σ0.034-0.023=0.011
min0.786-0.809=-0.022
max0.869-0.865=0.004
name=cdr_enhanced_4k_loc.art
mean885.849-885.846=0.003
σ0.006-0.009=-0.003
min885.842-885.839=0.004
max885.856-885.859=-0.002
mean1653.000-1628.000=25.000
σ0.000
min1653.000-1628.000=25.000
max1653.000-1628.000=25.000
mean0.722-0.718=0.004
σ0.029-0.037=-0.008
min0.678-0.665=0.014
max0.749-0.747=0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.708-7.708=-0.000
σ0.002-0.002=-0.000
min7.707
max7.714-7.712=0.001
mean1653.000-1628.000=25.000
σ0.000
min1653.000-1628.000=25.000
max1653.000-1628.000=25.000
mean3.508-4.287=-0.779
σ0.073-0.086=-0.013
min3.384-4.131=-0.746
max3.745-4.657=-0.912
name=record_render_large_syntax_err.art
mean7.656
σ0.002
min7.655
max7.659
mean1653.000-1628.000=25.000
σ0.000
min1653.000-1628.000=25.000
max1653.000-1628.000=25.000
mean3.460-4.251=-0.791
σ0.100-0.076=0.024
min3.257-4.132=-0.875
max3.768-4.515=-0.748
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1653.000-1628.000=25.000
σ0.000
min1653.000-1628.000=25.000
max1653.000-1628.000=25.000
mean0.540-0.747=-0.207
σ0.017-0.028=-0.011
min0.516-0.562=-0.046
max0.644-0.848=-0.204
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1653.000-1628.000=25.000
σ0.000
min1653.000-1628.000=25.000
max1653.000-1628.000=25.000
mean0.512-0.708=-0.196
σ0.012-0.015=-0.003
min0.483-0.670=-0.187
max0.567-0.780=-0.213

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.173-294.207=-0.034
σ0.296-0.257=0.039
min293.939-294.040=-0.101
max294.967-294.914=0.053
mean1934.000-1933.000=1.000
σ0.000
min1934.000-1933.000=1.000
max1934.000-1933.000=1.000
mean0.578-0.573=0.005
σ0.054-0.019=0.036
min0.498-0.534=-0.036
max0.671-0.589=0.082

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.492-281.497=-0.006
σ0.041-0.039=0.003
min281.437-281.442=-0.005
max281.532-281.537=-0.004
mean1653.000-1628.000=25.000
σ0.000
min1653.000-1628.000=25.000
max1653.000-1628.000=25.000
mean0.383-0.398=-0.015
σ0.006-0.007=-0.001
min0.378-0.390=-0.012
max0.390-0.407=-0.016
iters=5
new-facts=1
prior-facts=6402
mean1291.483-1291.477=0.007
σ0.113-0.113=0.000
min1291.356-1291.364=-0.008
max1291.615-1291.655=-0.040
mean1653.000-1628.000=25.000
σ0.000
min1653.000-1628.000=25.000
max1653.000-1628.000=25.000
mean2.025-1.954=0.071
σ0.153-0.160=-0.007
min1.834-1.797=0.037
max2.261-2.224=0.037
iters=5
new-facts=6402
prior-facts=1
mean1534.336-1534.333=0.002
σ3.972-4.005=-0.033
min1532.303-1532.337=-0.034
max1541.429-1541.489=-0.060
mean1653.000-1628.000=25.000
σ0.000
min1653.000-1628.000=25.000
max1653.000-1628.000=25.000
mean2.305-2.164=0.141
σ0.192-0.155=0.037
min2.041-2.040=0.000
max2.581-2.402=0.179
iters=5
new-facts=6402
prior-facts=6402
mean1853.351-1853.352=-0.000
σ0.055-0.059=-0.004
min1853.308-1853.296=0.012
max1853.434-1853.438=-0.004
mean1793.000-1789.000=4.000
σ140.504-145.638=-5.134
min1653.000-1628.000=25.000
max1934.000-1933.000=1.000
mean3.068-3.043=0.026
σ0.366-0.257=0.109
min2.653-2.768=-0.115
max3.656-3.428=0.228

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.325-1.432=-0.107
σ0.205-0.266=-0.061
min1.108-1.241=-0.133
max1.657-1.890=-0.232

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.512-442.511=0.001
σ577.234-577.234=0.001
min153.894-153.893=0.001
max1308.363-1308.362=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1653.000-1628.000=25.000
σ0.000
min1653.000-1628.000=25.000
max1653.000-1628.000=25.000
mean0.529-0.541=-0.012
σ0.541-0.566=-0.025
min0.257-0.256=0.001
max1.341-1.390=-0.049
policies=20
mean1539.212-1539.197=0.015
σ0.325-0.323=0.002
min1538.988-1538.973=0.015
max1539.695-1539.676=0.019
mean920.000
σ0.000
min920.000
max920.000
mean1653.000-1628.000=25.000
σ0.000
min1653.000-1628.000=25.000
max1653.000-1628.000=25.000
mean2.585-2.572=0.013
σ0.024-0.017=0.007
min2.564-2.556=0.008
max2.618-2.595=0.024
policies=200
mean15400.379-15400.284=0.095
σ0.069-0.100=-0.030
min15400.281-15400.227=0.054
max15400.443-15400.433=0.010
mean9200.000
σ0.000
min9200.000
max9200.000
mean1653.000-1628.000=25.000
σ0.000
min1653.000-1628.000=25.000
max1653.000-1628.000=25.000
mean26.107-26.005=0.102
σ0.224-0.108=0.116
min25.984-25.868=0.115
max26.442-26.093=0.349