Compare commits

Home / Compare 2cac975d .. d139c961

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.032-54.030=0.002
σ0.369-0.368=0.001
min53.885-53.885=0.000
max55.080-55.077=0.004
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.138-0.136=0.003
σ0.005-0.004=0.000
min0.133-0.131=0.002
max0.148-0.142=0.006
cache=y
dps=1
iters=10
policies=100
mean43.384-43.382=0.002
σ0.005-0.007=-0.002
min43.376-43.373=0.003
max43.391-43.392=-0.001
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.123-0.122=0.001
σ0.004-0.005=-0.001
min0.119-0.115=0.004
max0.129-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.329-1006.332=-0.002
σ0.896-0.876=0.020
min1005.858-1005.834=0.025
max1010.054-1009.964=0.090
mean1049.550-1051.400=-1.850
σ317.712-308.087=9.625
min546.000-575.000=-29.000
max1650.000-1651.000=-1.000
mean1.572-1.542=0.030
σ0.117-0.061=0.056
min1.363-1.474=-0.111
max1.817-1.653=0.164

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.881
max0.886
mean1650.000-1651.000=-1.000
σ0.000
min1650.000-1651.000=-1.000
max1650.000-1651.000=-1.000
mean0.414-0.412=0.002
σ0.129-0.135=-0.006
min0.331-0.335=-0.004
max0.641-0.651=-0.010
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1650.000-1651.000=-1.000
σ0.000
min1650.000-1651.000=-1.000
max1650.000-1651.000=-1.000
mean0.878-0.881=-0.002
σ0.067-0.085=-0.019
min0.821-0.825=-0.004
max0.990-1.030=-0.040
name=heavy_item.art
mean1.521-1.522=-0.000
σ0.002-0.002=0.000
min1.520
max1.524-1.524=-0.000
mean1650.000-1651.000=-1.000
σ0.000
min1650.000-1651.000=-1.000
max1650.000-1651.000=-1.000
mean0.543-0.536=0.007
σ0.043-0.048=-0.006
min0.502-0.502=-0.000
max0.611-0.615=-0.003
name=nested_use.art
mean2.355-2.356=-0.000
σ0.002-0.002=-0.001
min2.355
max2.358-2.360=-0.001
mean1650.000-1651.000=-1.000
σ0.000
min1650.000-1651.000=-1.000
max1650.000-1651.000=-1.000
mean0.843-0.831=0.012
σ0.031-0.040=-0.010
min0.813-0.806=0.007
max0.890-0.901=-0.011

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.551-963.552=-0.001
σ0.027-0.025=0.001
min963.527-963.523=0.004
max963.594-963.586=0.008
mean1650.000-1651.000=-1.000
σ0.000
min1650.000-1651.000=-1.000
max1650.000-1651.000=-1.000
mean0.774-0.810=-0.036
σ0.039-0.025=0.014
min0.704-0.782=-0.078
max0.794-0.848=-0.054
name=cdr_enhanced_4k_loc.art
mean884.856-884.856=0.000
σ0.005-0.006=-0.001
min884.847
max884.860-884.863=-0.003
mean1650.000-1651.000=-1.000
σ0.000
min1650.000-1651.000=-1.000
max1650.000-1651.000=-1.000
mean0.693-0.691=0.002
σ0.040-0.066=-0.026
min0.654-0.611=0.043
max0.738-0.740=-0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=-0.000
min7.705
max7.709
mean1650.000-1651.000=-1.000
σ0.000
min1650.000-1651.000=-1.000
max1650.000-1651.000=-1.000
mean4.208-4.200=0.008
σ0.078-0.073=0.005
min4.075-3.905=0.170
max4.595-4.434=0.161
name=record_render_large_syntax_err.art
mean7.655-7.655=0.000
σ0.002-0.002=0.000
min7.654
max7.660-7.658=0.002
mean1650.000-1651.000=-1.000
σ0.000
min1650.000-1651.000=-1.000
max1650.000-1651.000=-1.000
mean4.210-4.205=0.005
σ0.104-0.078=0.026
min4.087-4.054=0.033
max4.848-4.491=0.357
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1650.000-1651.000=-1.000
σ0.000
min1650.000-1651.000=-1.000
max1650.000-1651.000=-1.000
mean0.748-0.744=0.004
σ0.018-0.021=-0.003
min0.716-0.614=0.102
max0.841-0.841=-0.000
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1650.000-1651.000=-1.000
σ0.000
min1650.000-1651.000=-1.000
max1650.000-1651.000=-1.000
mean0.714-0.709=0.005
σ0.026-0.015=0.011
min0.525-0.679=-0.154
max0.795-0.786=0.010

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.463-295.841=-0.378
σ0.180-0.284=-0.103
min295.294-295.627=-0.333
max295.938-296.624=-0.686
mean1907.000-1920.000=-13.000
σ0.000
min1907.000-1920.000=-13.000
max1907.000-1920.000=-13.000
mean0.579-0.598=-0.019
σ0.041-0.036=0.005
min0.499-0.526=-0.028
max0.649-0.677=-0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.248-285.253=-0.005
σ0.043-0.038=0.005
min285.187-285.208=-0.021
max285.289-285.293=-0.003
mean1650.000-1651.000=-1.000
σ0.000
min1650.000-1651.000=-1.000
max1650.000-1651.000=-1.000
mean0.403-0.396=0.007
σ0.009-0.011=-0.002
min0.392-0.383=0.009
max0.411-0.407=0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.198-1295.186=0.012
σ0.112-0.102=0.010
min1295.080-1295.072=0.008
max1295.338-1295.303=0.034
mean1650.000-1651.000=-1.000
σ0.000
min1650.000-1651.000=-1.000
max1650.000-1651.000=-1.000
mean1.914-1.916=-0.002
σ0.090-0.126=-0.037
min1.816-1.802=0.014
max2.015-2.081=-0.066
iters=5
new-facts=6402
prior-facts=1
mean1538.078-1538.093=-0.015
σ4.047-4.073=-0.026
min1536.047-1536.022=0.025
max1545.309-1545.369=-0.060
mean1650.000-1651.000=-1.000
σ0.000
min1650.000-1651.000=-1.000
max1650.000-1651.000=-1.000
mean2.257-2.410=-0.153
σ0.208-0.376=-0.168
min2.022-2.057=-0.034
max2.448-2.927=-0.479
iters=5
new-facts=6402
prior-facts=6402
mean1857.100-1857.103=-0.003
σ0.056-0.058=-0.002
min1857.040-1857.043=-0.002
max1857.163-1857.178=-0.015
mean1775.200-1779.000=-3.800
σ128.712-135.283=-6.571
min1650.000-1651.000=-1.000
max1907.000-1920.000=-13.000
mean3.016-2.904=0.112
σ0.122-0.159=-0.037
min2.877-2.679=0.198
max3.200-3.106=0.095

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.436-1.354=0.083
σ0.185-0.270=-0.085
min1.118-1.116=0.003
max1.577-1.818=-0.241

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.610-443.609=0.001
σ577.065-577.066=-0.000
min155.074-155.076=-0.002
max1309.208-1309.208=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1650.000-1651.000=-1.000
σ0.000
min1650.000-1651.000=-1.000
max1650.000-1651.000=-1.000
mean0.545-0.548=-0.003
σ0.564-0.568=-0.004
min0.258-0.263=-0.004
max1.391-1.400=-0.009
policies=20
mean1551.045-1551.035=0.010
σ0.331-0.331=-0.000
min1550.819-1550.816=0.002
max1551.537-1551.528=0.009
mean920.000
σ0.000
min920.000
max920.000
mean1650.000-1651.000=-1.000
σ0.000
min1650.000-1651.000=-1.000
max1650.000-1651.000=-1.000
mean2.599-2.601=-0.002
σ0.017-0.008=0.009
min2.575-2.593=-0.017
max2.615-2.610=0.005
policies=200
mean15518.538-15518.462=0.077
σ0.092-0.080=0.012
min15518.468-15518.342=0.126
max15518.664-15518.515=0.149
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000-1651.000=-1.000
σ0.000
min1650.000-1651.000=-1.000
max1650.000-1651.000=-1.000
mean26.243-26.220=0.022
σ0.077-0.087=-0.011
min26.178-26.151=0.027
max26.354-26.348=0.006