Compare commits

Home / Compare c5f2b7cf .. f9d5369a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.031-54.032=-0.001
σ0.369-0.369=-0.000
min53.886-53.888=-0.003
max55.080-55.081=-0.001
mean418.000-420.000=-2.000
σ0.000
min418.000-420.000=-2.000
max418.000-420.000=-2.000
mean0.140-0.140=-0.000
σ0.004-0.004=-0.000
min0.137-0.136=0.000
max0.146-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.384-43.384=-0.000
σ0.007-0.007=-0.000
min43.374-43.374=-0.000
max43.395-43.399=-0.004
mean418.000-420.000=-2.000
σ0.000
min418.000-420.000=-2.000
max418.000-420.000=-2.000
mean0.122-0.123=-0.001
σ0.004-0.004=0.001
min0.116-0.118=-0.002
max0.129-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.327-1006.327=-0.001
σ0.897-0.844=0.053
min1005.841-1005.837=0.004
max1010.051-1009.816=0.235
mean1051.450-1054.300=-2.850
σ307.762-308.413=-0.651
min566.000-558.000=8.000
max1636.000-1654.000=-18.000
mean1.544-1.558=-0.015
σ0.080-0.079=0.001
min1.473-1.465=0.008
max1.820-1.778=0.043

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.881
max0.886
mean1636.000-1654.000=-18.000
σ0.000
min1636.000-1654.000=-18.000
max1636.000-1654.000=-18.000
mean0.418-0.434=-0.016
σ0.140-0.133=0.007
min0.331-0.343=-0.011
max0.666-0.666=0.001
name=error_case.art
mean2.333-2.334=-0.001
σ0.003-0.002=0.001
min2.332-2.333=-0.001
max2.337
mean1636.000-1654.000=-18.000
σ0.000
min1636.000-1654.000=-18.000
max1636.000-1654.000=-18.000
mean0.869-0.906=-0.037
σ0.088-0.098=-0.010
min0.808-0.852=-0.044
max1.022-1.081=-0.059
name=heavy_item.art
mean1.522-1.522=-0.000
σ0.002-0.002=-0.000
min1.520
max1.524-1.525=-0.001
mean1636.000-1654.000=-18.000
σ0.000
min1636.000-1654.000=-18.000
max1636.000-1654.000=-18.000
mean0.539-0.554=-0.015
σ0.051-0.044=0.006
min0.499-0.513=-0.014
max0.627-0.627=-0.001
name=nested_use.art
mean2.356-2.356=-0.000
σ0.002-0.002=-0.001
min2.355
max2.358-2.360=-0.002
mean1636.000-1654.000=-18.000
σ0.000
min1636.000-1654.000=-18.000
max1636.000-1654.000=-18.000
mean0.831-0.859=-0.027
σ0.042-0.034=0.009
min0.800-0.833=-0.033
max0.901-0.915=-0.014

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.553-963.552=0.001
σ0.019-0.025=-0.006
min963.532-963.523=0.009
max963.584-963.585=-0.001
mean1636.000-1654.000=-18.000
σ0.000
min1636.000-1654.000=-18.000
max1636.000-1654.000=-18.000
mean0.780-0.822=-0.042
σ0.063-0.030=0.034
min0.668-0.773=-0.105
max0.826-0.854=-0.028
name=cdr_enhanced_4k_loc.art
mean884.856-884.856=0.001
σ0.004-0.005=-0.001
min884.851-884.847=0.004
max884.860-884.860=-0.000
mean1636.000-1654.000=-18.000
σ0.000
min1636.000-1654.000=-18.000
max1636.000-1654.000=-18.000
mean0.720-0.732=-0.012
σ0.029-0.025=0.004
min0.670-0.687=-0.017
max0.741-0.746=-0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=0.000
min7.705
max7.710-7.709=0.001
mean1636.000-1654.000=-18.000
σ0.000
min1636.000-1654.000=-18.000
max1636.000-1654.000=-18.000
mean4.235-4.227=0.008
σ0.090-0.083=0.007
min4.095-4.080=0.015
max4.569-4.523=0.047
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1636.000-1654.000=-18.000
σ0.000
min1636.000-1654.000=-18.000
max1636.000-1654.000=-18.000
mean4.225-4.212=0.013
σ0.074-0.080=-0.007
min4.115-4.074=0.041
max4.471-4.599=-0.128
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1636.000-1654.000=-18.000
σ0.000
min1636.000-1654.000=-18.000
max1636.000-1654.000=-18.000
mean0.747-0.749=-0.002
σ0.017-0.017=0.000
min0.715-0.716=-0.002
max0.858-0.848=0.009
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1636.000-1654.000=-18.000
σ0.000
min1636.000-1654.000=-18.000
max1636.000-1654.000=-18.000
mean0.707-0.696=0.011
σ0.041-0.015=0.026
min0.506-0.666=-0.160
max0.789-0.779=0.010

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.593-295.747=-0.154
σ0.261-0.237=0.024
min295.378-295.546=-0.168
max296.305-296.392=-0.087
mean1943.000-1898.000=45.000
σ0.000
min1943.000-1898.000=45.000
max1943.000-1898.000=45.000
mean0.594-0.577=0.016
σ0.046-0.068=-0.023
min0.535-0.506=0.029
max0.701-0.730=-0.029

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.247-285.239=0.008
σ0.040-0.039=0.002
min285.198-285.189=0.010
max285.289-285.279=0.010
mean1636.000-1654.000=-18.000
σ0.000
min1636.000-1654.000=-18.000
max1636.000-1654.000=-18.000
mean0.385-0.390=-0.005
σ0.011-0.010=0.002
min0.380-0.383=-0.003
max0.405-0.402=0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.194-1295.170=0.023
σ0.097-0.111=-0.014
min1295.082-1295.080=0.002
max1295.296-1295.353=-0.058
mean1636.000-1654.000=-18.000
σ0.000
min1636.000-1654.000=-18.000
max1636.000-1654.000=-18.000
mean1.944-1.976=-0.032
σ0.126-0.189=-0.063
min1.809-1.803=0.006
max2.104-2.254=-0.149
iters=5
new-facts=6402
prior-facts=1
mean1538.093-1538.127=-0.034
σ4.022-3.984=0.038
min1536.052-1536.201=-0.149
max1545.275-1545.249=0.026
mean1636.000-1654.000=-18.000
σ0.000
min1636.000-1654.000=-18.000
max1636.000-1654.000=-18.000
mean2.289-2.296=-0.008
σ0.289-0.199=0.090
min2.035-2.090=-0.055
max2.626-2.538=0.088
iters=5
new-facts=6402
prior-facts=6402
mean1857.111-1857.105=0.006
σ0.067-0.054=0.013
min1857.039-1857.052=-0.013
max1857.202-1857.178=0.025
mean1788.000-1771.200=16.800
σ151.516-120.825=30.691
min1636.000-1654.000=-18.000
max1943.000-1898.000=45.000
mean3.004-3.033=-0.029
σ0.117-0.177=-0.061
min2.876-2.859=0.016
max3.110-3.328=-0.218

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.358-1.352=0.007
σ0.277-0.216=0.062
min1.101-1.111=-0.010
max1.833-1.696=0.137

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.610-443.607=0.003
σ577.064-577.066=-0.001
min155.076-155.071=0.005
max1309.207-1309.206=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1636.000-1654.000=-18.000
σ0.000
min1636.000-1654.000=-18.000
max1636.000-1654.000=-18.000
mean0.534-0.522=0.012
σ0.557-0.530=0.028
min0.250-0.253=-0.003
max1.370-1.317=0.053
policies=20
mean1551.043-1551.017=0.026
σ0.332-0.331=0.002
min1550.815-1550.789=0.025
max1551.536-1551.507=0.029
mean920.000
σ0.000
min920.000
max920.000
mean1636.000-1654.000=-18.000
σ0.000
min1636.000-1654.000=-18.000
max1636.000-1654.000=-18.000
mean2.595-2.584=0.011
σ0.012-0.023=-0.011
min2.581-2.554=0.027
max2.607-2.610=-0.003
policies=200
mean15518.468-15518.420=0.048
σ0.058-0.135=-0.077
min15518.395-15518.278=0.117
max15518.525-15518.602=-0.077
mean9200.000
σ0.000
min9200.000
max9200.000
mean1636.000-1654.000=-18.000
σ0.000
min1636.000-1654.000=-18.000
max1636.000-1654.000=-18.000
mean26.156-26.200=-0.044
σ0.101-0.138=-0.037
min26.081-26.091=-0.010
max26.303-26.380=-0.077