Compare commits

Home / Compare 30fcebbb .. 86c27746

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.016-54.015=0.001
σ0.371-0.368=0.003
min53.881-53.878=0.003
max55.072-55.063=0.009
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.140-0.139=0.000
σ0.004-0.003=0.000
min0.135-0.135=-0.001
max0.147-0.145=0.001
cache=y
dps=1
iters=10
policies=100
mean43.321-43.321=-0.000
σ0.004-0.007=-0.003
min43.316-43.307=0.009
max43.329-43.335=-0.006
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.123-0.123=0.000
σ0.004-0.004=0.000
min0.119-0.119=0.000
max0.130-0.130=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.305-1006.303=0.003
σ1.187-1.171=0.016
min1005.779-1005.768=0.010
max1011.282-1011.208=0.074
mean1052.200-1051.050=1.150
σ304.135-314.662=-10.527
min586.000-599.000=-13.000
max1639.000-1651.000=-12.000
mean1.575-1.563=0.012
σ0.104-0.089=0.016
min1.475-1.408=0.066
max1.855-1.791=0.064

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1639.000-1651.000=-12.000
σ0.000
min1639.000-1651.000=-12.000
max1639.000-1651.000=-12.000
mean0.401-0.412=-0.012
σ0.112-0.153=-0.041
min0.330-0.319=0.011
max0.598-0.684=-0.086
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1639.000-1651.000=-12.000
σ0.000
min1639.000-1651.000=-12.000
max1639.000-1651.000=-12.000
mean0.894-0.896=-0.002
σ0.099-0.098=0.001
min0.825-0.839=-0.014
max1.068-1.069=-0.001
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1639.000-1651.000=-12.000
σ0.000
min1639.000-1651.000=-12.000
max1639.000-1651.000=-12.000
mean0.543-0.556=-0.013
σ0.049-0.054=-0.005
min0.499-0.517=-0.018
max0.624-0.648=-0.023
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1639.000-1651.000=-12.000
σ0.000
min1639.000-1651.000=-12.000
max1639.000-1651.000=-12.000
mean0.865-0.858=0.007
σ0.035-0.022=0.013
min0.842-0.834=0.007
max0.926-0.885=0.040

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.113-964.115=-0.002
σ0.033-0.033=-0.000
min964.085-964.086=-0.001
max964.167-964.170=-0.003
mean1639.000-1651.000=-12.000
σ0.000
min1639.000-1651.000=-12.000
max1639.000-1651.000=-12.000
mean0.823-0.829=-0.006
σ0.018-0.031=-0.013
min0.806-0.779=0.027
max0.847-0.852=-0.004
name=cdr_enhanced_4k_loc.art
mean884.712-884.711=0.001
σ0.007-0.007=-0.000
min884.705-884.703=0.001
max884.722-884.722=0.000
mean1639.000-1651.000=-12.000
σ0.000
min1639.000-1651.000=-12.000
max1639.000-1651.000=-12.000
mean0.705-0.733=-0.028
σ0.053-0.018=0.035
min0.635-0.704=-0.070
max0.748-0.748=-0.000

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=0.000
min7.714
max7.719-7.718=0.001
mean1639.000-1651.000=-12.000
σ0.000
min1639.000-1651.000=-12.000
max1639.000-1651.000=-12.000
mean4.195-3.560=0.635
σ0.079-0.070=0.009
min4.085-3.432=0.653
max4.567-3.910=0.657
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1639.000-1651.000=-12.000
σ0.000
min1639.000-1651.000=-12.000
max1639.000-1651.000=-12.000
mean4.200-3.569=0.631
σ0.077-0.064=0.013
min4.071-3.450=0.621
max4.539-3.801=0.738
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1639.000-1651.000=-12.000
σ0.000
min1639.000-1651.000=-12.000
max1639.000-1651.000=-12.000
mean0.740-0.748=-0.008
σ0.028-0.019=0.010
min0.701-0.719=-0.018
max0.918-0.864=0.054
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1639.000-1651.000=-12.000
σ0.000
min1639.000-1651.000=-12.000
max1639.000-1651.000=-12.000
mean0.705-0.708=-0.003
σ0.021-0.020=0.001
min0.676-0.670=0.006
max0.837-0.777=0.060

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.344-296.256=0.088
σ0.215-0.255=-0.040
min296.217-295.991=0.226
max296.932-296.913=0.019
mean2065.000-1910.000=155.000
σ0.000
min2065.000-1910.000=155.000
max2065.000-1910.000=155.000
mean0.570-0.581=-0.011
σ0.013-0.040=-0.026
min0.539-0.508=0.030
max0.582-0.669=-0.087

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.641-284.641=-0.000
σ0.051-0.063=-0.012
min284.580-284.567=0.013
max284.686-284.713=-0.026
mean1639.000-1651.000=-12.000
σ0.000
min1639.000-1651.000=-12.000
max1639.000-1651.000=-12.000
mean0.402-0.399=0.003
σ0.010-0.012=-0.001
min0.386-0.387=-0.000
max0.412-0.414=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.084-1295.084=-0.001
σ0.104-0.100=0.004
min1295.006-1295.026=-0.020
max1295.266-1295.262=0.004
mean1639.000-1651.000=-12.000
σ0.000
min1639.000-1651.000=-12.000
max1639.000-1651.000=-12.000
mean1.907-1.917=-0.009
σ0.094-0.102=-0.008
min1.797-1.805=-0.008
max2.017-2.021=-0.005
iters=5
new-facts=6402
prior-facts=1
mean1539.258-1539.270=-0.013
σ6.859-6.844=0.015
min1535.984-1535.926=0.057
max1551.522-1551.507=0.015
mean1639.000-1651.000=-12.000
σ0.000
min1639.000-1651.000=-12.000
max1639.000-1651.000=-12.000
mean2.314-2.355=-0.041
σ0.207-0.221=-0.014
min2.046-2.019=0.027
max2.505-2.612=-0.106
iters=5
new-facts=6402
prior-facts=6402
mean1856.975-1856.971=0.004
σ0.073-0.066=0.007
min1856.927-1856.920=0.006
max1857.093-1857.070=0.023
mean1801.000-1779.000=22.000
σ185.139-128.410=56.730
min1639.000-1651.000=-12.000
max2065.000-1910.000=155.000
mean2.917-3.029=-0.113
σ0.087-0.193=-0.105
min2.829-2.851=-0.022
max3.040-3.349=-0.310

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.220-1.229=-0.009
σ0.340-0.349=-0.009
min0.934-0.943=-0.008
max1.764-1.818=-0.054

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.244-448.242=0.002
σ581.216-581.217=-0.000
min157.632-157.630=0.002
max1320.068-1320.067=0.001
mean98.250
σ8.500
min94.000
max111.000
mean1639.000-1651.000=-12.000
σ0.000
min1639.000-1651.000=-12.000
max1639.000-1651.000=-12.000
mean0.552-0.543=0.009
σ0.577-0.558=0.019
min0.261-0.262=-0.001
max1.418-1.380=0.037
policies=20
mean1576.657-1576.650=0.007
σ0.360-0.369=-0.010
min1576.416-1576.399=0.017
max1577.191-1577.198=-0.007
mean940.000
σ0.000
min940.000
max940.000
mean1639.000-1651.000=-12.000
σ0.000
min1639.000-1651.000=-12.000
max1639.000-1651.000=-12.000
mean2.633-2.643=-0.010
σ0.006-0.011=-0.005
min2.625-2.633=-0.008
max2.639-2.656=-0.017
policies=200
mean15774.818-15774.771=0.047
σ0.079-0.098=-0.019
min15774.770-15774.667=0.103
max15774.935-15774.900=0.035
mean9400.000
σ0.000
min9400.000
max9400.000
mean1639.000-1651.000=-12.000
σ0.000
min1639.000-1651.000=-12.000
max1639.000-1651.000=-12.000
mean26.709-26.725=-0.016
σ0.052-0.080=-0.029
min26.660-26.627=0.033
max26.777-26.820=-0.043