Compare commits

Home / Compare 7a004480 .. bf1a797a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.014=0.001
σ0.369-0.369=-0.000
min53.869-53.870=-0.001
max55.065-55.065=0.000
mean414.000
σ0.000
min414.000
max414.000
mean0.139-0.138=0.001
σ0.004-0.006=-0.002
min0.132-0.129=0.003
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=-0.000
σ0.007-0.006=0.001
min43.307-43.311=-0.005
max43.333-43.332=0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.120-0.120=0.000
σ0.004-0.004=-0.000
min0.115-0.113=0.002
max0.127-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.308-1006.308=0.000
σ1.176-1.177=-0.000
min1005.767-1005.742=0.025
max1011.240-1011.236=0.003
mean1043.350-1055.400=-12.050
σ291.995-314.638=-22.643
min596.000-588.000=8.000
max1425.000-1619.000=-194.000
mean1.554-1.537=0.017
σ0.099-0.077=0.022
min1.369-1.367=0.002
max1.775-1.729=0.046

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1425.000-1619.000=-194.000
σ0.000
min1425.000-1619.000=-194.000
max1425.000-1619.000=-194.000
mean0.433-0.415=0.018
σ0.145-0.160=-0.015
min0.323-0.321=0.003
max0.684-0.698=-0.015
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1425.000-1619.000=-194.000
σ0.000
min1425.000-1619.000=-194.000
max1425.000-1619.000=-194.000
mean0.879-0.909=-0.030
σ0.101-0.160=-0.059
min0.812-0.826=-0.014
max1.058-1.193=-0.135
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1425.000-1619.000=-194.000
σ0.000
min1425.000-1619.000=-194.000
max1425.000-1619.000=-194.000
mean0.535-0.608=-0.073
σ0.053-0.050=0.003
min0.497-0.543=-0.046
max0.627-0.659=-0.032
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1425.000-1619.000=-194.000
σ0.000
min1425.000-1619.000=-194.000
max1425.000-1619.000=-194.000
mean0.837-0.857=-0.020
σ0.033-0.039=-0.005
min0.815-0.834=-0.019
max0.895-0.926=-0.032

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.097-964.114=-0.018
σ0.024-0.033=-0.009
min964.077-964.086=-0.009
max964.136-964.168=-0.033
mean1425.000-1619.000=-194.000
σ0.000
min1425.000-1619.000=-194.000
max1425.000-1619.000=-194.000
mean0.794-0.837=-0.043
σ0.079-0.039=0.040
min0.657-0.768=-0.111
max0.858-0.862=-0.004
name=cdr_enhanced_4k_loc.art
mean884.710-884.711=-0.001
σ0.006-0.007=-0.000
min884.703-884.705=-0.001
max884.717-884.721=-0.005
mean1425.000-1619.000=-194.000
σ0.000
min1425.000-1619.000=-194.000
max1425.000-1619.000=-194.000
mean0.720-0.718=0.003
σ0.034-0.019=0.015
min0.660-0.696=-0.036
max0.741-0.737=0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.719-7.718=0.001
mean1425.000-1619.000=-194.000
σ0.000
min1425.000-1619.000=-194.000
max1425.000-1619.000=-194.000
mean4.219-3.868=0.351
σ0.083-0.357=-0.274
min4.071-3.427=0.644
max4.491-4.587=-0.096
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1425.000-1619.000=-194.000
σ0.000
min1425.000-1619.000=-194.000
max1425.000-1619.000=-194.000
mean4.177-4.227=-0.050
σ0.064-0.066=-0.002
min4.077-4.101=-0.025
max4.326-4.467=-0.141
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1425.000-1619.000=-194.000
σ0.000
min1425.000-1619.000=-194.000
max1425.000-1619.000=-194.000
mean0.736-0.729=0.007
σ0.025-0.024=0.000
min0.602-0.570=0.032
max0.846-0.847=-0.001
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1425.000-1619.000=-194.000
σ0.000
min1425.000-1619.000=-194.000
max1425.000-1619.000=-194.000
mean0.562-0.697=-0.134
σ0.094-0.013=0.081
min0.481-0.669=-0.188
max0.799-0.766=0.034

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.181-296.192=-0.012
σ0.255-0.202=0.052
min295.998-296.054=-0.056
max296.882-296.724=0.158
mean1907.000-1904.000=3.000
σ0.000
min1907.000-1904.000=3.000
max1907.000-1904.000=3.000
mean0.567-0.588=-0.020
σ0.041-0.015=0.027
min0.507-0.556=-0.049
max0.640-0.604=0.036

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.682-284.694=-0.013
σ0.044-0.035=0.008
min284.634-284.649=-0.014
max284.734-284.731=0.004
mean1425.000-1619.000=-194.000
σ0.000
min1425.000-1619.000=-194.000
max1425.000-1619.000=-194.000
mean0.398-0.396=0.002
σ0.008-0.009=-0.001
min0.385-0.385=0.001
max0.405-0.404=0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.093-1295.091=0.002
σ0.064-0.118=-0.054
min1295.028-1294.968=0.060
max1295.186-1295.249=-0.063
mean1425.000-1619.000=-194.000
σ0.000
min1425.000-1619.000=-194.000
max1425.000-1619.000=-194.000
mean2.074-1.890=0.184
σ0.056-0.096=-0.040
min2.011-1.798=0.212
max2.152-2.019=0.132
iters=5
new-facts=6402
prior-facts=1
mean1539.220-1539.185=0.035
σ6.828-6.840=-0.012
min1536.038-1535.955=0.082
max1551.433-1551.418=0.015
mean1425.000-1619.000=-194.000
σ0.000
min1425.000-1619.000=-194.000
max1425.000-1619.000=-194.000
mean2.301-2.214=0.087
σ0.249-0.192=0.057
min2.116-2.040=0.075
max2.704-2.480=0.223
iters=5
new-facts=6402
prior-facts=6402
mean1856.981-1856.989=-0.008
σ0.068-0.050=0.018
min1856.898-1856.941=-0.044
max1857.065-1857.064=0.002
mean1745.200-1767.200=-22.000
σ174.953-135.682=39.271
min1498.000-1619.000=-121.000
max1907.000-1904.000=3.000
mean3.069-3.102=-0.033
σ0.249-0.353=-0.103
min2.851-2.850=0.001
max3.420-3.720=-0.299

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.727-1.219=0.508
σ0.143-0.260=-0.117
min1.479-0.932=0.547
max1.828-1.623=0.205

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-447.783=0.003
σ581.213-581.211=0.002
min157.176-157.175=0.000
max1319.605-1319.599=0.006
mean96.250
σ8.500
min92.000
max109.000
mean1425.000-1619.000=-194.000
σ0.000
min1425.000-1619.000=-194.000
max1425.000-1619.000=-194.000
mean0.530-0.550=-0.020
σ0.535-0.578=-0.043
min0.259-0.259=-0.001
max1.332-1.417=-0.085
policies=20
mean1572.107-1572.078=0.029
σ0.358-0.360=-0.001
min1571.865-1571.832=0.033
max1572.640-1572.612=0.028
mean920.000
σ0.000
min920.000
max920.000
mean1425.000-1619.000=-194.000
σ0.000
min1425.000-1619.000=-194.000
max1425.000-1619.000=-194.000
mean2.633-2.624=0.009
σ0.009-0.012=-0.002
min2.624-2.615=0.009
max2.643-2.641=0.002
policies=200
mean15729.087-15729.009=0.078
σ0.106-0.160=-0.054
min15728.982-15728.839=0.143
max15729.227-15729.189=0.039
mean9200.000
σ0.000
min9200.000
max9200.000
mean1425.000-1619.000=-194.000
σ0.000
min1425.000-1619.000=-194.000
max1425.000-1619.000=-194.000
mean26.603-26.497=0.106
σ0.040-0.122=-0.083
min26.565-26.375=0.190
max26.649-26.667=-0.018