Compare commits

Home / Compare c863d6ed .. 8e84fb6b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.016=-0.002
σ0.369-0.369=-0.000
min53.867-53.874=-0.006
max55.062-55.065=-0.003
mean414.700-415.000=-0.300
σ0.483-0.000=0.483
min414.000-415.000=-1.000
max415.000
mean0.140-0.141=-0.002
σ0.004-0.004=-0.000
min0.136-0.137=-0.001
max0.146-0.148=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.000
σ0.006-0.008=-0.002
min43.313-43.312=0.001
max43.332-43.338=-0.006
mean415.000
σ0.000
min415.000
max415.000
mean0.117-0.122=-0.005
σ0.003-0.004=-0.001
min0.114-0.118=-0.004
max0.121-0.130=-0.010

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.305-1006.310=-0.005
σ1.170-1.175=-0.005
min1005.769-1005.757=0.012
max1011.208-1011.236=-0.029
mean1054.200-1046.750=7.450
σ303.029-313.149=-10.120
min595.000-596.000=-1.000
max1451.000-1643.000=-192.000
mean1.556-1.542=0.013
σ0.080-0.079=0.001
min1.484-1.463=0.021
max1.747-1.778=-0.031

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1451.000-1643.000=-192.000
σ0.000
min1451.000-1643.000=-192.000
max1451.000-1643.000=-192.000
mean0.413-0.402=0.011
σ0.125-0.129=-0.005
min0.340-0.321=0.018
max0.635-0.632=0.004
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1451.000-1643.000=-192.000
σ0.000
min1451.000-1643.000=-192.000
max1451.000-1643.000=-192.000
mean0.907-0.881=0.026
σ0.113-0.089=0.024
min0.839-0.820=0.019
max1.105-1.035=0.070
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1451.000-1643.000=-192.000
σ0.000
min1451.000-1643.000=-192.000
max1451.000-1643.000=-192.000
mean0.541-0.540=0.000
σ0.062-0.046=0.016
min0.484-0.502=-0.017
max0.647-0.618=0.029
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1451.000-1643.000=-192.000
σ0.000
min1451.000-1643.000=-192.000
max1451.000-1643.000=-192.000
mean0.837-0.828=0.009
σ0.030-0.042=-0.012
min0.814-0.787=0.028
max0.889-0.894=-0.005

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.097-964.113=-0.016
σ0.025-0.032=-0.007
min964.077-964.086=-0.008
max964.138-964.165=-0.027
mean1451.000-1643.000=-192.000
σ0.000
min1451.000-1643.000=-192.000
max1451.000-1643.000=-192.000
mean0.829-0.843=-0.014
σ0.023-0.019=0.004
min0.798-0.812=-0.014
max0.853-0.857=-0.004
name=cdr_enhanced_4k_loc.art
mean884.710-884.711=-0.001
σ0.006-0.004=0.002
min884.703-884.705=-0.001
max884.716-884.715=0.001
mean1451.000-1643.000=-192.000
σ0.000
min1451.000-1643.000=-192.000
max1451.000-1643.000=-192.000
mean0.724-0.706=0.018
σ0.037-0.041=-0.004
min0.659-0.659=0.000
max0.750-0.738=0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.719-7.721=-0.003
mean1451.000-1643.000=-192.000
σ0.000
min1451.000-1643.000=-192.000
max1451.000-1643.000=-192.000
mean4.247-4.243=0.004
σ0.094-0.094=-0.001
min4.088-4.092=-0.004
max4.587-4.576=0.011
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1451.000-1643.000=-192.000
σ0.000
min1451.000-1643.000=-192.000
max1451.000-1643.000=-192.000
mean4.228-4.224=0.003
σ0.073-0.079=-0.006
min4.072-4.096=-0.024
max4.464-4.511=-0.046
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1451.000-1643.000=-192.000
σ0.000
min1451.000-1643.000=-192.000
max1451.000-1643.000=-192.000
mean0.729-0.730=-0.001
σ0.019-0.018=0.001
min0.697-0.698=-0.002
max0.859-0.851=0.008
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1451.000-1643.000=-192.000
σ0.000
min1451.000-1643.000=-192.000
max1451.000-1643.000=-192.000
mean0.694-0.694=0.000
σ0.025-0.017=0.009
min0.497-0.665=-0.168
max0.779-0.789=-0.009

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.304-296.237=0.068
σ0.230-0.198=0.031
min296.136-296.000=0.136
max296.936-296.745=0.191
mean1908.000-1973.000=-65.000
σ0.000
min1908.000-1973.000=-65.000
max1908.000-1973.000=-65.000
mean0.576-0.588=-0.012
σ0.048-0.051=-0.003
min0.514-0.511=0.003
max0.677-0.697=-0.020

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.697-284.700=-0.003
σ0.035-0.029=0.006
min284.652-284.666=-0.014
max284.739-284.736=0.003
mean1451.000-1643.000=-192.000
σ0.000
min1451.000-1643.000=-192.000
max1451.000-1643.000=-192.000
mean0.397-0.397=-0.000
σ0.010-0.008=0.002
min0.386-0.387=-0.001
max0.405-0.403=0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.089-1295.057=0.032
σ0.064-0.080=-0.016
min1295.011-1294.951=0.059
max1295.170-1295.152=0.017
mean1451.000-1643.000=-192.000
σ0.000
min1451.000-1643.000=-192.000
max1451.000-1643.000=-192.000
mean2.067-1.965=0.102
σ0.053-0.216=-0.162
min2.005-1.805=0.200
max2.140-2.322=-0.182
iters=5
new-facts=6402
prior-facts=1
mean1539.174-1539.186=-0.013
σ6.859-6.846=0.013
min1535.937-1535.949=-0.012
max1551.439-1551.429=0.010
mean1451.000-1643.000=-192.000
σ0.000
min1451.000-1643.000=-192.000
max1451.000-1643.000=-192.000
mean2.206-2.308=-0.101
σ0.170-0.265=-0.095
min1.969-2.011=-0.041
max2.377-2.651=-0.274
iters=5
new-facts=6402
prior-facts=6402
mean1856.980-1856.998=-0.018
σ0.080-0.065=0.015
min1856.865-1856.922=-0.057
max1857.067-1857.061=0.006
mean1746.800-1799.400=-52.600
σ175.252-166.117=9.135
min1498.000-1643.000=-145.000
max1908.000-1973.000=-65.000
mean3.126-2.978=0.149
σ0.253-0.182=0.070
min2.856-2.831=0.026
max3.497-3.204=0.292

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.757-1.256=0.501
σ0.091-0.324=-0.233
min1.609-1.050=0.559
max1.851-1.808=0.043

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.783=0.002
σ581.213-581.212=0.001
min157.176-157.176=0.000
max1319.605-1319.602=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1451.000-1643.000=-192.000
σ0.000
min1451.000-1643.000=-192.000
max1451.000-1643.000=-192.000
mean0.550-0.540=0.010
σ0.579-0.559=0.020
min0.259-0.258=0.002
max1.418-1.379=0.040
policies=20
mean1572.099-1572.078=0.021
σ0.355-0.359=-0.004
min1571.857-1571.834=0.023
max1572.626-1572.611=0.015
mean920.000
σ0.000
min920.000
max920.000
mean1451.000-1643.000=-192.000
σ0.000
min1451.000-1643.000=-192.000
max1451.000-1643.000=-192.000
mean2.623-2.622=0.001
σ0.015-0.014=0.001
min2.607-2.605=0.002
max2.640-2.635=0.005
policies=200
mean15729.041-15729.025=0.016
σ0.020-0.163=-0.143
min15729.015-15728.892=0.123
max15729.063-15729.253=-0.190
mean9200.000
σ0.000
min9200.000
max9200.000
mean1451.000-1643.000=-192.000
σ0.000
min1451.000-1643.000=-192.000
max1451.000-1643.000=-192.000
mean26.519-26.540=-0.020
σ0.049-0.047=0.002
min26.461-26.482=-0.021
max26.564-26.588=-0.024