Compare commits

Home / Compare 6dda49c3 .. e00abb4b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.031-54.032=-0.001
σ0.370-0.370=0.000
min53.887-53.883=0.004
max55.085-55.085=-0.000
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.138-0.139=-0.001
σ0.005-0.004=0.001
min0.132-0.136=-0.004
max0.148-0.145=0.004
cache=y
dps=1
iters=10
policies=100
mean43.385-43.384=0.001
σ0.006-0.006=-0.000
min43.376-43.374=0.003
max43.394-43.392=0.002
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.122-0.121=0.001
σ0.003-0.005=-0.001
min0.119-0.114=0.005
max0.128-0.130=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.334-1006.330=0.004
σ0.882-0.893=-0.011
min1005.861-1005.861=-0.000
max1009.961-1010.039=-0.077
mean1046.950-1052.100=-5.150
σ310.129-317.345=-7.216
min564.000-545.000=19.000
max1637.000-1628.000=9.000
mean1.593-1.561=0.032
σ0.119-0.081=0.038
min1.500-1.482=0.018
max1.871-1.819=0.051

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.882-0.883=-0.001
σ0.002-0.002=-0.000
min0.881
max0.886
mean1637.000-1628.000=9.000
σ0.000
min1637.000-1628.000=9.000
max1637.000-1628.000=9.000
mean0.419-0.414=0.005
σ0.136-0.117=0.019
min0.340-0.348=-0.007
max0.661-0.622=0.039
name=error_case.art
mean2.334-2.333=0.001
σ0.003-0.003=-0.000
min2.332
max2.337
mean1637.000-1628.000=9.000
σ0.000
min1637.000-1628.000=9.000
max1637.000-1628.000=9.000
mean0.869-0.874=-0.005
σ0.095-0.094=0.001
min0.812-0.819=-0.007
max1.036-1.039=-0.003
name=heavy_item.art
mean1.521-1.521=-0.001
σ0.001-0.002=-0.001
min1.520
max1.523-1.524=-0.001
mean1637.000-1628.000=9.000
σ0.000
min1637.000-1628.000=9.000
max1637.000-1628.000=9.000
mean0.542-0.540=0.002
σ0.052-0.062=-0.010
min0.492-0.498=-0.006
max0.626-0.648=-0.022
name=nested_use.art
mean2.357-2.355=0.001
σ0.002-0.002=0.001
min2.355
max2.360-2.358=0.001
mean1637.000-1628.000=9.000
σ0.000
min1637.000-1628.000=9.000
max1637.000-1628.000=9.000
mean0.838-0.854=-0.016
σ0.046-0.036=0.010
min0.806-0.830=-0.024
max0.916-0.913=0.003

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.556-963.550=0.006
σ0.030-0.031=-0.001
min963.531-963.523=0.008
max963.607-963.602=0.004
mean1637.000-1628.000=9.000
σ0.000
min1637.000-1628.000=9.000
max1637.000-1628.000=9.000
mean0.771-0.775=-0.003
σ0.058-0.080=-0.023
min0.723-0.659=0.064
max0.845-0.852=-0.006
name=cdr_enhanced_4k_loc.art
mean884.857-884.855=0.001
σ0.008-0.008=-0.000
min884.847
max884.862-884.865=-0.002
mean1637.000-1628.000=9.000
σ0.000
min1637.000-1628.000=9.000
max1637.000-1628.000=9.000
mean0.715-0.705=0.010
σ0.034-0.034=0.000
min0.668-0.676=-0.008
max0.749-0.745=0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706
σ0.002-0.002=0.000
min7.705
max7.711-7.709=0.001
mean1637.000-1628.000=9.000
σ0.000
min1637.000-1628.000=9.000
max1637.000-1628.000=9.000
mean3.541-4.252=-0.711
σ0.090-0.091=-0.001
min3.388-4.101=-0.713
max3.883-4.573=-0.691
name=record_render_large_syntax_err.art
mean7.655-7.655=0.000
σ0.002-0.002=0.000
min7.654
max7.659-7.658=0.001
mean1637.000-1628.000=9.000
σ0.000
min1637.000-1628.000=9.000
max1637.000-1628.000=9.000
mean3.487-4.264=-0.777
σ0.062-0.082=-0.020
min3.355-4.134=-0.780
max3.736-4.571=-0.835
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1637.000-1628.000=9.000
σ0.000
min1637.000-1628.000=9.000
max1637.000-1628.000=9.000
mean0.748-0.749=-0.001
σ0.015-0.022=-0.007
min0.713-0.719=-0.006
max0.849-0.905=-0.056
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1637.000-1628.000=9.000
σ0.000
min1637.000-1628.000=9.000
max1637.000-1628.000=9.000
mean0.697-0.713=-0.016
σ0.048-0.019=0.029
min0.511-0.671=-0.160
max0.800-0.806=-0.006

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.708-295.341=0.367
σ0.242-0.216=0.026
min295.533-295.219=0.315
max296.369-295.939=0.430
mean1893.000-1888.000=5.000
σ0.000
min1893.000-1888.000=5.000
max1893.000-1888.000=5.000
mean0.584-0.590=-0.005
σ0.043-0.050=-0.007
min0.528-0.511=0.016
max0.679-0.695=-0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.246-285.253=-0.007
σ0.036-0.036=0.000
min285.196-285.201=-0.006
max285.285-285.287=-0.002
mean1637.000-1628.000=9.000
σ0.000
min1637.000-1628.000=9.000
max1637.000-1628.000=9.000
mean0.383-0.402=-0.019
σ0.002-0.012=-0.010
min0.380-0.389=-0.008
max0.385-0.414=-0.028
iters=5
new-facts=1
prior-facts=6402
mean1295.188-1295.193=-0.005
σ0.102-0.106=-0.004
min1295.066-1295.073=-0.007
max1295.296-1295.324=-0.028
mean1637.000-1628.000=9.000
σ0.000
min1637.000-1628.000=9.000
max1637.000-1628.000=9.000
mean1.921-1.940=-0.020
σ0.092-0.182=-0.090
min1.823-1.792=0.031
max2.033-2.240=-0.207
iters=5
new-facts=6402
prior-facts=1
mean1538.081-1538.151=-0.070
σ4.011-4.009=0.002
min1536.039-1536.140=-0.101
max1545.245-1545.316=-0.071
mean1637.000-1628.000=9.000
σ0.000
min1637.000-1628.000=9.000
max1637.000-1628.000=9.000
mean2.221-2.413=-0.192
σ0.235-0.235=-0.000
min2.031-2.027=0.004
max2.489-2.609=-0.121
iters=5
new-facts=6402
prior-facts=6402
mean1857.106-1857.103=0.003
σ0.051-0.052=-0.001
min1857.052-1857.057=-0.005
max1857.174-1857.180=-0.006
mean1776.600-1770.800=5.800
σ121.574-122.730=-1.156
min1637.000-1628.000=9.000
max1893.000-1888.000=5.000
mean3.052-3.035=0.017
σ0.243-0.252=-0.008
min2.857-2.824=0.033
max3.467-3.460=0.007

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.318-1.478=-0.160
σ0.293-0.356=-0.064
min1.106-1.101=0.005
max1.818-1.853=-0.036

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.609-443.611=-0.002
σ577.065-577.065=0.000
min155.075-155.077=-0.002
max1309.207-1309.208=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1637.000-1628.000=9.000
σ0.000
min1637.000-1628.000=9.000
max1637.000-1628.000=9.000
mean0.547-0.544=0.003
σ0.567-0.563=0.004
min0.262-0.262=0.001
max1.398-1.389=0.009
policies=20
mean1551.031-1551.047=-0.016
σ0.338-0.330=0.008
min1550.804-1550.823=-0.020
max1551.533-1551.538=-0.004
mean920.000
σ0.000
min920.000
max920.000
mean1637.000-1628.000=9.000
σ0.000
min1637.000-1628.000=9.000
max1637.000-1628.000=9.000
mean2.602-2.594=0.008
σ0.024-0.012=0.012
min2.580-2.579=0.001
max2.636-2.608=0.028
policies=200
mean15518.537-15518.568=-0.031
σ0.144-0.092=0.052
min15518.353-15518.499=-0.146
max15518.689-15518.700=-0.010
mean9200.000
σ0.000
min9200.000
max9200.000
mean1637.000-1628.000=9.000
σ0.000
min1637.000-1628.000=9.000
max1637.000-1628.000=9.000
mean26.223-26.145=0.078
σ0.106-0.036=0.070
min26.115-26.108=0.007
max26.370-26.192=0.178