Compare commits

Home / Compare 27f27d30 .. 29ba7fcf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.016-54.014=0.002
σ0.369-0.369=-0.000
min53.871-53.869=0.002
max55.065-55.064=0.001
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.140-0.137=0.003
σ0.005-0.004=0.001
min0.135-0.131=0.004
max0.150-0.144=0.006
cache=y
dps=1
iters=10
policies=100
mean43.321-43.322=-0.000
σ0.006-0.007=-0.001
min43.312-43.312=-0.001
max43.334-43.337=-0.003
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.120-0.120=0.000
σ0.004-0.005=-0.001
min0.115-0.114=0.001
max0.128-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.308-1006.309=-0.001
σ1.178-1.166=0.011
min1005.736-1005.761=-0.025
max1011.239-1011.190=0.049
mean1047.050-1049.650=-2.600
σ310.052-313.721=-3.669
min550.000-598.000=-48.000
max1511.000-1646.000=-135.000
mean1.526-1.546=-0.020
σ0.065-0.081=-0.017
min1.455-1.463=-0.007
max1.711-1.765=-0.054

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1511.000-1646.000=-135.000
σ0.000
min1511.000-1646.000=-135.000
max1511.000-1646.000=-135.000
mean0.400-0.429=-0.029
σ0.136-0.130=0.006
min0.322-0.340=-0.018
max0.641-0.654=-0.013
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1511.000-1646.000=-135.000
σ0.000
min1511.000-1646.000=-135.000
max1511.000-1646.000=-135.000
mean0.892-0.877=0.014
σ0.085-0.084=0.001
min0.829-0.811=0.018
max1.041-1.023=0.018
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1511.000-1646.000=-135.000
σ0.000
min1511.000-1646.000=-135.000
max1511.000-1646.000=-135.000
mean0.550-0.539=0.011
σ0.050-0.060=-0.011
min0.513-0.488=0.025
max0.633-0.637=-0.004
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1511.000-1646.000=-135.000
σ0.000
min1511.000-1646.000=-135.000
max1511.000-1646.000=-135.000
mean0.854-0.856=-0.002
σ0.038-0.049=-0.010
min0.817-0.814=0.003
max0.919-0.940=-0.021

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.102-964.114=-0.012
σ0.036-0.021=0.015
min964.077-964.092=-0.015
max964.164-964.139=0.025
mean1511.000-1646.000=-135.000
σ0.000
min1511.000-1646.000=-135.000
max1511.000-1646.000=-135.000
mean0.835-0.848=-0.014
σ0.032-0.018=0.014
min0.777-0.817=-0.039
max0.854-0.862=-0.008
name=cdr_enhanced_4k_loc.art
mean884.709-884.713=-0.003
σ0.005-0.007=-0.001
min884.703
max884.716-884.722=-0.006
mean1511.000-1646.000=-135.000
σ0.000
min1511.000-1646.000=-135.000
max1511.000-1646.000=-135.000
mean0.711-0.706=0.006
σ0.029-0.032=-0.002
min0.665-0.673=-0.008
max0.738-0.741=-0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.720-7.718=0.003
mean1511.000-1646.000=-135.000
σ0.000
min1511.000-1646.000=-135.000
max1511.000-1646.000=-135.000
mean4.174-4.223=-0.049
σ0.079-0.072=0.007
min4.045-4.067=-0.022
max4.424-4.466=-0.042
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1511.000-1646.000=-135.000
σ0.000
min1511.000-1646.000=-135.000
max1511.000-1646.000=-135.000
mean4.197-4.222=-0.025
σ0.080-0.061=0.019
min4.081-4.114=-0.033
max4.437-4.384=0.053
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1511.000-1646.000=-135.000
σ0.000
min1511.000-1646.000=-135.000
max1511.000-1646.000=-135.000
mean0.735-0.736=-0.001
σ0.018-0.021=-0.003
min0.701-0.707=-0.006
max0.860-0.863=-0.003
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1511.000-1646.000=-135.000
σ0.000
min1511.000-1646.000=-135.000
max1511.000-1646.000=-135.000
mean0.695-0.683=0.012
σ0.033-0.016=0.017
min0.498-0.653=-0.154
max0.776-0.760=0.016

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.311-296.435=-0.124
σ0.215-0.269=-0.055
min296.105-296.146=-0.041
max296.882-297.109=-0.227
mean1912.000-1920.000=-8.000
σ0.000
min1912.000-1920.000=-8.000
max1912.000-1920.000=-8.000
mean0.584-0.588=-0.004
σ0.044-0.053=-0.009
min0.518-0.510=0.007
max0.676-0.712=-0.036

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.697-284.655=0.042
σ0.035-0.047=-0.012
min284.654-284.605=0.049
max284.737-284.705=0.032
mean1511.000-1646.000=-135.000
σ0.000
min1511.000-1646.000=-135.000
max1511.000-1646.000=-135.000
mean0.396-0.405=-0.008
σ0.009-0.002=0.007
min0.385-0.402=-0.017
max0.403-0.408=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.078-1295.076=0.002
σ0.110-0.112=-0.002
min1294.963-1294.962=0.001
max1295.214-1295.217=-0.003
mean1511.000-1646.000=-135.000
σ0.000
min1511.000-1646.000=-135.000
max1511.000-1646.000=-135.000
mean1.916-1.904=0.012
σ0.100-0.101=-0.001
min1.806-1.793=0.014
max2.004-2.013=-0.009
iters=5
new-facts=6402
prior-facts=1
mean1539.188-1539.187=0.001
σ6.842-6.865=-0.022
min1535.915-1535.939=-0.025
max1551.424-1551.464=-0.040
mean1511.000-1646.000=-135.000
σ0.000
min1511.000-1646.000=-135.000
max1511.000-1646.000=-135.000
mean2.262-2.243=0.019
σ0.253-0.239=0.014
min2.027-2.036=-0.010
max2.655-2.583=0.072
iters=5
new-facts=6402
prior-facts=6402
mean1856.977-1856.980=-0.002
σ0.072-0.064=0.008
min1856.889-1856.902=-0.013
max1857.068-1857.068=0.000
mean1745.400-1778.400=-33.000
σ173.304-136.583=36.721
min1511.000-1646.000=-135.000
max1912.000-1920.000=-8.000
mean2.973-3.062=-0.090
σ0.140-0.275=-0.136
min2.854-2.873=-0.019
max3.203-3.546=-0.343

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.652-1.111=0.541
σ0.205-0.336=-0.131
min1.342-0.919=0.423
max1.849-1.706=0.143

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-447.786=-0.002
σ581.212-581.212=0.000
min157.177-157.179=-0.002
max1319.603-1319.605=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1511.000-1646.000=-135.000
σ0.000
min1511.000-1646.000=-135.000
max1511.000-1646.000=-135.000
mean0.548-0.534=0.014
σ0.562-0.549=0.014
min0.263-0.259=0.004
max1.392-1.357=0.035
policies=20
mean1572.088-1572.104=-0.016
σ0.355-0.349=0.006
min1571.851-1571.865=-0.014
max1572.616-1572.622=-0.006
mean920.000
σ0.000
min920.000
max920.000
mean1511.000-1646.000=-135.000
σ0.000
min1511.000-1646.000=-135.000
max1511.000-1646.000=-135.000
mean2.627-2.618=0.009
σ0.008-0.021=-0.012
min2.620-2.596=0.024
max2.639-2.636=0.003
policies=200
mean15729.058-15729.002=0.056
σ0.132-0.041=0.091
min15728.943-15728.946=-0.003
max15729.242-15729.041=0.201
mean9200.000
σ0.000
min9200.000
max9200.000
mean1511.000-1646.000=-135.000
σ0.000
min1511.000-1646.000=-135.000
max1511.000-1646.000=-135.000
mean26.479-26.464=0.016
σ0.055-0.117=-0.062
min26.431-26.350=0.081
max26.532-26.625=-0.093