Compare commits

Home / Compare 8e32add1 .. f0e4cf2e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.703-53.703=-0.000
σ0.370-0.367=0.003
min53.560-53.559=0.001
max54.756-54.748=0.008
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.137-0.137=0.001
σ0.006-0.004=0.002
min0.130-0.131=-0.001
max0.146-0.143=0.003
cache=y
dps=1
iters=10
policies=100
mean43.056-43.058=-0.001
σ0.005-0.005=-0.001
min43.050-43.052=-0.002
max43.065-43.067=-0.002
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.119-0.120=-0.001
σ0.004-0.005=-0.001
min0.114-0.113=0.000
max0.125-0.128=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.105-1005.111=-0.005
σ0.883-0.866=0.017
min1004.640-1004.618=0.022
max1008.762-1008.684=0.078
mean1052.550-1053.900=-1.350
σ309.919-321.349=-11.430
min564.000-553.000=11.000
max1650.000-1633.000=17.000
mean1.631-1.638=-0.008
σ0.067-0.089=-0.021
min1.579-1.558=0.020
max1.840-1.853=-0.013

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.882-0.883=-0.001
σ0.002-0.002=-0.000
min0.881
max0.886-0.886=0.000
mean1650.000-1633.000=17.000
σ0.000
min1650.000-1633.000=17.000
max1650.000-1633.000=17.000
mean0.424-0.440=-0.015
σ0.140-0.171=-0.031
min0.341-0.337=0.004
max0.674-0.744=-0.070
name=error_case.art
mean2.334-2.333=0.001
σ0.003-0.003=-0.000
min2.332
max2.337
mean1650.000-1633.000=17.000
σ0.000
min1650.000-1633.000=17.000
max1650.000-1633.000=17.000
mean0.877-0.932=-0.055
σ0.083-0.168=-0.085
min0.826-0.842=-0.016
max1.024-1.232=-0.208
name=heavy_item.art
mean1.521-1.521=-0.001
σ0.001-0.002=-0.001
min1.520
max1.523-1.524=-0.001
mean1650.000-1633.000=17.000
σ0.000
min1650.000-1633.000=17.000
max1650.000-1633.000=17.000
mean0.540-0.548=-0.008
σ0.055-0.051=0.004
min0.489-0.516=-0.027
max0.633-0.639=-0.007
name=nested_use.art
mean2.356-2.355=0.001
σ0.002-0.002=0.000
min2.355
max2.358
mean1650.000-1633.000=17.000
σ0.000
min1650.000-1633.000=17.000
max1650.000-1633.000=17.000
mean0.846-0.854=-0.008
σ0.039-0.033=0.006
min0.806-0.819=-0.013
max0.910-0.906=0.004

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-963.553=-0.001
σ0.025-0.024=0.001
min963.524-963.523=0.001
max963.585-963.582=0.004
mean1650.000-1633.000=17.000
σ0.000
min1650.000-1633.000=17.000
max1650.000-1633.000=17.000
mean0.832-0.855=-0.022
σ0.033-0.013=0.020
min0.777-0.832=-0.055
max0.860-0.865=-0.005
name=cdr_enhanced_4k_loc.art
mean884.857-884.855=0.001
σ0.004-0.008=-0.004
min884.851-884.847=0.004
max884.860-884.865=-0.005
mean1650.000-1633.000=17.000
σ0.000
min1650.000-1633.000=17.000
max1650.000-1633.000=17.000
mean0.717-0.698=0.019
σ0.036-0.039=-0.003
min0.664-0.663=0.001
max0.745-0.744=0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=0.000
min7.705
max7.711-7.709=0.002
mean1650.000-1633.000=17.000
σ0.000
min1650.000-1633.000=17.000
max1650.000-1633.000=17.000
mean4.271-4.237=0.034
σ0.090-0.085=0.005
min4.140-4.118=0.023
max4.546-4.553=-0.006
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1650.000-1633.000=17.000
σ0.000
min1650.000-1633.000=17.000
max1650.000-1633.000=17.000
mean4.232-4.221=0.011
σ0.067-0.075=-0.009
min4.113-4.085=0.028
max4.537-4.514=0.023
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1650.000-1633.000=17.000
σ0.000
min1650.000-1633.000=17.000
max1650.000-1633.000=17.000
mean0.756-0.741=0.014
σ0.018-0.017=0.001
min0.725-0.707=0.018
max0.880-0.831=0.049
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1650.000-1633.000=17.000
σ0.000
min1650.000-1633.000=17.000
max1650.000-1633.000=17.000
mean0.720-0.706=0.014
σ0.017-0.013=0.004
min0.661-0.681=-0.020
max0.804-0.775=0.028

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.428-294.182=0.246
σ0.221-0.241=-0.020
min294.284-294.009=0.275
max295.044-294.852=0.192
mean1915.000-1935.000=-20.000
σ0.000
min1915.000-1935.000=-20.000
max1915.000-1935.000=-20.000
mean0.577-0.583=-0.006
σ0.029-0.050=-0.021
min0.514-0.518=-0.004
max0.609-0.695=-0.085

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.499-281.493=0.006
σ0.037-0.043=-0.007
min281.451-281.439=0.011
max281.536-281.537=-0.000
mean1650.000-1633.000=17.000
σ0.000
min1650.000-1633.000=17.000
max1650.000-1633.000=17.000
mean0.389-0.388=0.001
σ0.004-0.006=-0.002
min0.384-0.379=0.005
max0.393-0.394=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1291.481-1291.481=0.000
σ0.110-0.113=-0.003
min1291.361-1291.359=0.003
max1291.615-1291.619=-0.004
mean1650.000-1633.000=17.000
σ0.000
min1650.000-1633.000=17.000
max1650.000-1633.000=17.000
mean1.902-1.932=-0.030
σ0.095-0.106=-0.011
min1.810-1.810=0.000
max2.011-2.019=-0.008
iters=5
new-facts=6402
prior-facts=1
mean1534.361-1534.394=-0.033
σ3.973-3.999=-0.026
min1532.374-1532.408=-0.034
max1541.460-1541.539=-0.078
mean1650.000-1633.000=17.000
σ0.000
min1650.000-1633.000=17.000
max1650.000-1633.000=17.000
mean2.350-2.427=-0.077
σ0.263-0.316=-0.053
min2.026-2.110=-0.085
max2.614-2.830=-0.216
iters=5
new-facts=6402
prior-facts=6402
mean1853.356-1853.354=0.002
σ0.052-0.055=-0.002
min1853.315-1853.306=0.009
max1853.432-1853.434=-0.002
mean1779.800-1779.600=0.200
σ129.664-151.320=-21.656
min1650.000-1633.000=17.000
max1915.000-1935.000=-20.000
mean3.033-3.049=-0.016
σ0.268-0.136=0.132
min2.858-2.881=-0.024
max3.500-3.212=0.288

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.387-1.348=0.039
σ0.207-0.344=-0.137
min1.112-1.113=-0.001
max1.676-1.945=-0.269

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.428-442.429=-0.001
σ577.064-577.064=-0.000
min153.892-153.896=-0.004
max1308.024-1308.025=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1650.000-1633.000=17.000
σ0.000
min1650.000-1633.000=17.000
max1650.000-1633.000=17.000
mean0.521-0.537=-0.015
σ0.523-0.551=-0.028
min0.258-0.257=0.001
max1.306-1.363=-0.057
policies=20
mean1539.227-1539.226=0.002
σ0.325-0.325=0.000
min1539.003-1539.001=0.002
max1539.710-1539.707=0.003
mean920.000
σ0.000
min920.000
max920.000
mean1650.000-1633.000=17.000
σ0.000
min1650.000-1633.000=17.000
max1650.000-1633.000=17.000
mean2.582-2.586=-0.004
σ0.009-0.013=-0.004
min2.570-2.571=-0.001
max2.590-2.598=-0.008
policies=200
mean15400.447-15400.460=-0.013
σ0.025-0.092=-0.068
min15400.415-15400.364=0.052
max15400.472-15400.585=-0.112
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000-1633.000=17.000
σ0.000
min1650.000-1633.000=17.000
max1650.000-1633.000=17.000
mean26.178-26.158=0.020
σ0.265-0.065=0.200
min25.980-26.108=-0.128
max26.569-26.254=0.315