Compare commits

Home / Compare 9ad1ef7e .. a7a5e0a7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.705-53.704=0.001
σ0.368-0.369=-0.000
min53.568-53.561=0.008
max54.754-54.753=0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.138-0.137=0.001
σ0.004-0.006=-0.002
min0.135-0.130=0.005
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.059-43.058=0.001
σ0.006-0.005=0.002
min43.050-43.050=-0.000
max43.070-43.064=0.005
mean415.000
σ0.000
min415.000
max415.000
mean0.120-0.122=-0.001
σ0.004-0.004=-0.000
min0.114-0.116=-0.002
max0.126-0.130=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.108-1005.105=0.002
σ0.885-0.884=0.001
min1004.638-1004.637=0.001
max1008.776-1008.759=0.017
mean1050.250-1052.450=-2.200
σ315.021-320.475=-5.454
min594.000-552.000=42.000
max1654.000-1631.000=23.000
mean1.615-1.619=-0.005
σ0.086-0.095=-0.010
min1.499-1.485=0.014
max1.867-1.888=-0.021

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.882-0.883=-0.000
σ0.002-0.002=-0.000
min0.881
max0.886
mean1654.000-1631.000=23.000
σ0.000
min1654.000-1631.000=23.000
max1654.000-1631.000=23.000
mean0.422-0.413=0.009
σ0.135-0.130=0.006
min0.344-0.327=0.017
max0.663-0.643=0.020
name=error_case.art
mean2.335-2.333=0.001
σ0.003-0.003=0.000
min2.332
max2.339-2.337=0.002
mean1654.000-1631.000=23.000
σ0.000
min1654.000-1631.000=23.000
max1654.000-1631.000=23.000
mean0.876-0.910=-0.035
σ0.093-0.084=0.009
min0.818-0.831=-0.014
max1.040-1.024=0.016
name=heavy_item.art
mean1.521-1.521=-0.001
σ0.001-0.002=-0.000
min1.520
max1.523-1.524=-0.001
mean1654.000-1631.000=23.000
σ0.000
min1654.000-1631.000=23.000
max1654.000-1631.000=23.000
mean0.550-0.549=0.000
σ0.043-0.064=-0.021
min0.519-0.497=0.022
max0.626-0.661=-0.035
name=nested_use.art
mean2.356-2.355=0.001
σ0.002-0.002=0.000
min2.355
max2.358
mean1654.000-1631.000=23.000
σ0.000
min1654.000-1631.000=23.000
max1654.000-1631.000=23.000
mean0.850-0.839=0.011
σ0.040-0.043=-0.004
min0.822-0.811=0.011
max0.917-0.914=0.004

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.551-963.549=0.001
σ0.024-0.026=-0.003
min963.523
max963.580-963.592=-0.011
mean1654.000-1631.000=23.000
σ0.000
min1654.000-1631.000=23.000
max1654.000-1631.000=23.000
mean0.839-0.767=0.071
σ0.028-0.057=-0.028
min0.791-0.727=0.064
max0.861-0.865=-0.003
name=cdr_enhanced_4k_loc.art
mean884.857-884.856=0.001
σ0.003-0.006=-0.003
min884.852-884.847=0.005
max884.860-884.861=-0.001
mean1654.000-1631.000=23.000
σ0.000
min1654.000-1631.000=23.000
max1654.000-1631.000=23.000
mean0.744-0.683=0.060
σ0.009-0.049=-0.040
min0.735-0.613=0.122
max0.756-0.746=0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=0.000
min7.705
max7.709
mean1654.000-1631.000=23.000
σ0.000
min1654.000-1631.000=23.000
max1654.000-1631.000=23.000
mean4.276-4.240=0.036
σ0.089-0.095=-0.005
min4.167-4.100=0.067
max4.656-4.648=0.008
name=record_render_large_syntax_err.art
mean7.655-7.655=-0.000
σ0.002-0.002=-0.000
min7.654
max7.658-7.659=-0.001
mean1654.000-1631.000=23.000
σ0.000
min1654.000-1631.000=23.000
max1654.000-1631.000=23.000
mean4.262-4.204=0.057
σ0.072-0.067=0.005
min4.128-4.080=0.049
max4.489-4.432=0.057
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1654.000-1631.000=23.000
σ0.000
min1654.000-1631.000=23.000
max1654.000-1631.000=23.000
mean0.591-0.742=-0.151
σ0.097-0.021=0.076
min0.516-0.706=-0.190
max0.858-0.892=-0.034
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1654.000-1631.000=23.000
σ0.000
min1654.000-1631.000=23.000
max1654.000-1631.000=23.000
mean0.506-0.701=-0.195
σ0.021-0.037=-0.015
min0.329-0.517=-0.188
max0.548-0.830=-0.282

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.261-294.118=0.143
σ0.191-0.237=-0.047
min294.059-293.958=0.102
max294.734-294.769=-0.034
mean1904.000-2043.000=-139.000
σ0.000
min1904.000-2043.000=-139.000
max1904.000-2043.000=-139.000
mean0.609-0.577=0.032
σ0.037-0.030=0.007
min0.570-0.522=0.048
max0.707-0.617=0.090

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.496-281.491=0.005
σ0.035-0.040=-0.005
min281.452-281.444=0.009
max281.533-281.532=0.001
mean1654.000-1631.000=23.000
σ0.000
min1654.000-1631.000=23.000
max1654.000-1631.000=23.000
mean0.387-0.389=-0.002
σ0.006-0.007=-0.001
min0.379-0.380=-0.000
max0.391-0.397=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1291.484-1291.482=0.002
σ0.115-0.102=0.014
min1291.365-1291.366=-0.001
max1291.652-1291.603=0.049
mean1654.000-1631.000=23.000
σ0.000
min1654.000-1631.000=23.000
max1654.000-1631.000=23.000
mean1.874-1.883=-0.009
σ0.082-0.105=-0.023
min1.804-1.794=0.010
max2.005-2.038=-0.033
iters=5
new-facts=6402
prior-facts=1
mean1534.358-1534.320=0.038
σ3.978-4.009=-0.032
min1532.410-1532.297=0.113
max1541.469-1541.483=-0.014
mean1654.000-1631.000=23.000
σ0.000
min1654.000-1631.000=23.000
max1654.000-1631.000=23.000
mean2.132-2.277=-0.145
σ0.192-0.193=-0.001
min1.874-2.073=-0.199
max2.359-2.469=-0.110
iters=5
new-facts=6402
prior-facts=6402
mean1853.362-1853.347=0.015
σ0.052-0.055=-0.002
min1853.304-1853.301=0.002
max1853.430-1853.427=0.002
mean1775.400-1785.800=-10.400
σ122.796-180.209=-57.413
min1654.000-1631.000=23.000
max1904.000-2043.000=-139.000
mean3.083-2.829=0.253
σ0.273-0.072=0.201
min2.855-2.704=0.151
max3.550-2.882=0.669

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.340-1.461=-0.122
σ0.250-0.320=-0.069
min1.112-1.104=0.008
max1.768-1.928=-0.160

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.429-442.429=0.000
σ577.065-577.064=0.001
min153.894-153.895=-0.001
max1308.026-1308.025=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1654.000-1631.000=23.000
σ0.000
min1654.000-1631.000=23.000
max1654.000-1631.000=23.000
mean0.550-0.520=0.030
σ0.583-0.521=0.062
min0.257-0.252=0.005
max1.425-1.302=0.123
policies=20
mean1539.222-1539.233=-0.011
σ0.315-0.337=-0.021
min1539.004-1539.001=0.002
max1539.690-1539.733=-0.043
mean920.000
σ0.000
min920.000
max920.000
mean1654.000-1631.000=23.000
σ0.000
min1654.000-1631.000=23.000
max1654.000-1631.000=23.000
mean2.569-2.600=-0.031
σ0.010-0.031=-0.021
min2.560-2.571=-0.012
max2.583-2.642=-0.059
policies=200
mean15400.350-15400.437=-0.087
σ0.088-0.055=0.033
min15400.221-15400.372=-0.151
max15400.406-15400.487=-0.081
mean9200.000
σ0.000
min9200.000
max9200.000
mean1654.000-1631.000=23.000
σ0.000
min1654.000-1631.000=23.000
max1654.000-1631.000=23.000
mean26.194-26.117=0.077
σ0.263-0.144=0.120
min26.055-25.970=0.085
max26.589-26.311=0.278