Compare commits

Home / Compare 30ffdd92 .. c34062eb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.031-54.030=0.000
σ0.369-0.368=0.001
min53.891-53.881=0.011
max55.080-55.077=0.003
mean418.000-420.000=-2.000
σ0.000
min418.000-420.000=-2.000
max418.000-420.000=-2.000
mean0.139-0.138=0.001
σ0.005-0.005=-0.001
min0.133-0.130=0.002
max0.149-0.146=0.003
cache=y
dps=1
iters=10
policies=100
mean43.384-43.383=0.000
σ0.007-0.005=0.002
min43.376-43.376=-0.001
max43.393-43.391=0.002
mean418.000-420.000=-2.000
σ0.000
min418.000-420.000=-2.000
max418.000-420.000=-2.000
mean0.120-0.123=-0.002
σ0.004-0.004=0.000
min0.114-0.119=-0.005
max0.128-0.130=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.329-1006.334=-0.005
σ0.927-0.879=0.048
min1005.856-1005.830=0.026
max1010.185-1009.970=0.215
mean1052.850-1053.000=-0.150
σ310.247-311.473=-1.226
min555.000-568.000=-13.000
max1646.000-1649.000=-3.000
mean1.550-1.566=-0.016
σ0.144-0.108=0.036
min1.336-1.383=-0.047
max1.930-1.875=0.055

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.882
σ0.002
min0.881
max0.886
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean0.415-0.418=-0.003
σ0.124-0.135=-0.011
min0.347-0.332=0.015
max0.635-0.657=-0.022
name=error_case.art
mean2.334
σ0.003
min2.332
max2.337
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean0.886-0.885=0.001
σ0.085-0.090=-0.004
min0.829-0.827=0.002
max1.035-1.039=-0.004
name=heavy_item.art
mean1.521-1.521=0.000
σ0.001-0.001=-0.000
min1.520
max1.523
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean0.544-0.569=-0.025
σ0.049-0.064=-0.015
min0.506-0.508=-0.001
max0.630-0.654=-0.024
name=nested_use.art
mean2.356
σ0.002
min2.355
max2.358
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean0.844-0.850=-0.006
σ0.044-0.046=-0.002
min0.804-0.817=-0.013
max0.919-0.929=-0.010

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.551-963.556=-0.005
σ0.024-0.030=-0.006
min963.524-963.531=-0.006
max963.582-963.607=-0.024
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean0.813-0.848=-0.035
σ0.026-0.008=0.018
min0.779-0.838=-0.059
max0.849-0.860=-0.011
name=cdr_enhanced_4k_loc.art
mean884.857-884.857=-0.000
σ0.005-0.004=0.000
min884.851
max884.861-884.861=-0.001
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean0.708-0.729=-0.021
σ0.043-0.023=0.021
min0.652-0.689=-0.038
max0.743-0.742=0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=-0.000
min7.705
max7.711
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean4.246-4.233=0.012
σ0.072-0.076=-0.004
min4.107-4.117=-0.010
max4.549-4.507=0.042
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean4.236-4.214=0.022
σ0.077-0.078=-0.001
min4.092-4.042=0.051
max4.515-4.479=0.036
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean0.747-0.749=-0.001
σ0.018-0.023=-0.004
min0.719-0.717=0.001
max0.871-0.898=-0.026
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean0.710-0.519=0.191
σ0.020-0.050=-0.030
min0.602-0.488=0.114
max0.787-0.784=0.002

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.632-295.379=0.253
σ0.196-0.184=0.011
min295.443-295.235=0.208
max296.117-295.858=0.258
mean1907.000-1905.000=2.000
σ0.000
min1907.000-1905.000=2.000
max1907.000-1905.000=2.000
mean0.557-0.571=-0.014
σ0.035-0.055=-0.020
min0.502-0.494=0.007
max0.623-0.677=-0.054

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.245-285.241=0.004
σ0.038-0.033=0.005
min285.195-285.196=-0.001
max285.287-285.282=0.005
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean0.388-0.395=-0.007
σ0.008-0.011=-0.003
min0.380-0.380=-0.001
max0.402-0.408=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1295.197-1295.200=-0.003
σ0.108-0.113=-0.004
min1295.068-1295.074=-0.006
max1295.314-1295.331=-0.017
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean1.904-1.940=-0.036
σ0.142-0.110=0.033
min1.696-1.815=-0.119
max2.023-2.051=-0.028
iters=5
new-facts=6402
prior-facts=1
mean1538.096-1538.078=0.018
σ4.052-4.019=0.034
min1536.052-1536.076=-0.024
max1545.332-1545.257=0.075
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean2.335-2.235=0.100
σ0.351-0.153=0.198
min2.025-2.054=-0.029
max2.794-2.412=0.382
iters=5
new-facts=6402
prior-facts=6402
mean1857.105-1857.109=-0.004
σ0.051-0.050=0.001
min1857.057-1857.059=-0.002
max1857.176-1857.184=-0.008
mean1777.400-1774.800=2.600
σ128.788-127.425=1.363
min1646.000-1649.000=-3.000
max1907.000-1905.000=2.000
mean3.041-3.097=-0.056
σ0.274-0.340=-0.066
min2.874-2.857=0.017
max3.527-3.695=-0.168

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.408-1.299=0.108
σ0.229-0.226=0.002
min1.264-1.103=0.161
max1.805-1.630=0.176

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.611-443.609=0.002
σ577.065-577.065=0.000
min155.077-155.076=0.002
max1309.208-1309.206=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean0.552-0.549=0.003
σ0.579-0.578=0.002
min0.262-0.258=0.004
max1.421-1.415=0.006
policies=20
mean1551.043-1551.029=0.015
σ0.330-0.329=0.001
min1550.815-1550.804=0.011
max1551.534-1551.518=0.016
mean920.000
σ0.000
min920.000
max920.000
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean2.596-2.594=0.003
σ0.013-0.007=0.006
min2.584-2.588=-0.004
max2.608-2.601=0.007
policies=200
mean15518.559-15518.555=0.004
σ0.083-0.109=-0.026
min15518.465-15518.425=0.040
max15518.668-15518.686=-0.019
mean9200.000
σ0.000
min9200.000
max9200.000
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean26.192-26.168=0.024
σ0.140-0.125=0.015
min26.099-26.033=0.066
max26.398-26.326=0.072