Compare commits

Home / Compare b54453eb .. f4bb46a8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.016-54.014=0.002
σ0.370-0.371=-0.001
min53.879-53.876=0.004
max55.070-55.070=0.000
mean421.000-417.000=4.000
σ0.000
min421.000-417.000=4.000
max421.000-417.000=4.000
mean0.140-0.137=0.003
σ0.005-0.005=-0.001
min0.136-0.130=0.006
max0.148-0.144=0.003
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=-0.001
σ0.005-0.005=0.000
min43.312-43.315=-0.003
max43.330-43.331=-0.000
mean421.000-417.000=4.000
σ0.000
min421.000-417.000=4.000
max421.000-417.000=4.000
mean0.123-0.122=0.001
σ0.005-0.004=0.001
min0.119-0.119=-0.000
max0.133-0.129=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.307-1006.303=0.004
σ1.188-1.216=-0.028
min1005.770-1005.776=-0.006
max1011.287-1011.406=-0.119
mean1057.050-1045.400=11.650
σ304.380-313.961=-9.582
min591.000-595.000=-4.000
max1649.000-1644.000=5.000
mean1.563-1.575=-0.012
σ0.089-0.117=-0.028
min1.468-1.472=-0.004
max1.780-1.957=-0.177

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean0.411-0.405=0.005
σ0.132-0.136=-0.003
min0.316-0.317=-0.001
max0.644-0.645=-0.001
name=error_case.art
mean2.338-2.337=0.001
σ0.002-0.003=-0.000
min2.336
max2.341
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean0.888-0.890=-0.002
σ0.085-0.091=-0.006
min0.841-0.828=0.013
max1.038-1.048=-0.010
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean0.535-0.555=-0.020
σ0.056-0.045=0.011
min0.485-0.518=-0.033
max0.628-0.632=-0.004
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean0.840-0.851=-0.010
σ0.039-0.044=-0.005
min0.806-0.810=-0.004
max0.896-0.924=-0.028

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.113-964.113=0.000
σ0.032-0.027=0.005
min964.085-964.093=-0.008
max964.166-964.159=0.007
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean0.836-0.806=0.030
σ0.031-0.037=-0.006
min0.781-0.778=0.003
max0.854-0.859=-0.005
name=cdr_enhanced_4k_loc.art
mean884.712-884.712=-0.001
σ0.007-0.006=0.001
min884.705
max884.722-884.721=0.002
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean0.702-0.726=-0.024
σ0.028-0.024=0.005
min0.668-0.684=-0.016
max0.742-0.743=-0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.714=0.000
σ0.002-0.002=-0.000
min7.714
max7.718
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean4.253-4.293=-0.040
σ0.093-0.105=-0.013
min4.109-4.104=0.005
max4.598-4.708=-0.110
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666-7.667=-0.001
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean4.196-4.277=-0.082
σ0.078-0.096=-0.018
min4.049-4.130=-0.082
max4.453-4.555=-0.102
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean0.739-0.713=0.026
σ0.021-0.025=-0.004
min0.710-0.673=0.037
max0.859-0.850=0.009
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean0.685-0.701=-0.016
σ0.047-0.016=0.031
min0.485-0.670=-0.184
max0.754-0.784=-0.030

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.272-296.337=-0.065
σ0.266-0.208=0.058
min296.108-296.169=-0.061
max297.001-296.884=0.117
mean1917.000-1916.000=1.000
σ0.000
min1917.000-1916.000=1.000
max1917.000-1916.000=1.000
mean0.591-0.576=0.016
σ0.027-0.055=-0.028
min0.544-0.507=0.037
max0.639-0.702=-0.063

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.642-284.641=0.000
σ0.068-0.064=0.003
min284.570-284.571=-0.001
max284.724-284.719=0.005
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean0.400-0.398=0.002
σ0.012-0.009=0.003
min0.385-0.388=-0.003
max0.414-0.406=0.008
iters=5
new-facts=1
prior-facts=6402
mean1295.091-1295.077=0.014
σ0.108-0.110=-0.002
min1295.024-1294.971=0.052
max1295.284-1295.265=0.019
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean1.917-1.919=-0.002
σ0.096-0.125=-0.030
min1.806-1.804=0.001
max2.024-2.105=-0.082
iters=5
new-facts=6402
prior-facts=1
mean1539.246-1539.279=-0.033
σ6.867-6.803=0.064
min1535.982-1536.054=-0.072
max1551.525-1551.445=0.080
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean2.237-2.335=-0.098
σ0.207-0.211=-0.004
min2.008-2.147=-0.139
max2.503-2.585=-0.082
iters=5
new-facts=6402
prior-facts=6402
mean1856.970-1856.980=-0.010
σ0.069-0.066=0.003
min1856.922-1856.920=0.002
max1857.083-1857.079=0.004
mean1777.400-1774.600=2.800
σ134.584-136.535=-1.951
min1649.000-1644.000=5.000
max1917.000-1916.000=1.000
mean3.009-3.069=-0.060
σ0.178-0.410=-0.232
min2.843-2.733=0.109
max3.296-3.768=-0.472

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.195-1.181=0.015
σ0.251-0.234=0.017
min0.939-0.950=-0.010
max1.542-1.548=-0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.242-448.241=0.001
σ581.218-581.217=0.001
min157.631-157.627=0.004
max1320.069-1320.067=0.002
mean98.250
σ8.500
min94.000
max111.000
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean0.557-0.547=0.011
σ0.587-0.559=0.028
min0.263-0.266=-0.003
max1.438-1.385=0.053
policies=20
mean1576.626-1576.639=-0.013
σ0.359-0.360=-0.000
min1576.382-1576.394=-0.012
max1577.160-1577.173=-0.013
mean940.000
σ0.000
min940.000
max940.000
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean2.628-2.647=-0.019
σ0.017-0.019=-0.002
min2.614-2.626=-0.012
max2.653-2.670=-0.017
policies=200
mean15774.720-15774.681=0.038
σ0.159-0.079=0.080
min15774.567-15774.573=-0.006
max15774.941-15774.757=0.184
mean9400.000
σ0.000
min9400.000
max9400.000
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean26.648-26.695=-0.047
σ0.033-0.048=-0.015
min26.619-26.631=-0.012
max26.694-26.732=-0.039