Compare commits

Home / Compare 90061216 .. 896a8eba

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.056=-0.002
σ0.369-0.370=-0.001
min53.908-53.917=-0.010
max55.103-55.109=-0.006
mean419.000-418.700=0.300
σ0.000-0.483=-0.483
min419.000-418.000=1.000
max419.000
mean0.138-0.140=-0.002
σ0.004-0.003=0.000
min0.132-0.136=-0.004
max0.145-0.145=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=-0.000
σ0.006-0.006=0.001
min43.386-43.385=0.001
max43.402-43.406=-0.004
mean419.000
σ0.000
min419.000
max419.000
mean0.120-0.122=-0.002
σ0.004-0.004=0.000
min0.115-0.119=-0.003
max0.126-0.129=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.929=0.050
σ0.925-0.868=0.057
min1006.507-1006.428=0.079
max1010.827-1010.523=0.305
mean1055.650-1053.650=2.000
σ306.148-311.042=-4.894
min576.000-557.000=19.000
max1457.000-1652.000=-195.000
mean1.568-1.513=0.055
σ0.135-0.074=0.061
min1.469-1.407=0.062
max2.021-1.763=0.257

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1457.000-1652.000=-195.000
σ0.000
min1457.000-1652.000=-195.000
max1457.000-1652.000=-195.000
mean0.441-0.399=0.041
σ0.126-0.106=0.020
min0.352-0.331=0.021
max0.659-0.587=0.072
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1457.000-1652.000=-195.000
σ0.000
min1457.000-1652.000=-195.000
max1457.000-1652.000=-195.000
mean0.886-0.877=0.009
σ0.097-0.102=-0.004
min0.826-0.816=0.010
max1.058-1.058=0.001
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1457.000-1652.000=-195.000
σ0.000
min1457.000-1652.000=-195.000
max1457.000-1652.000=-195.000
mean0.532-0.534=-0.002
σ0.051-0.050=0.001
min0.482-0.490=-0.008
max0.616-0.619=-0.002
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1457.000-1652.000=-195.000
σ0.000
min1457.000-1652.000=-195.000
max1457.000-1652.000=-195.000
mean0.843-0.838=0.006
σ0.040-0.045=-0.005
min0.816-0.815=0.002
max0.911-0.918=-0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.822-964.840=-0.018
σ0.026-0.029=-0.003
min964.802-964.818=-0.016
max964.864-964.888=-0.023
mean1457.000-1652.000=-195.000
σ0.000
min1457.000-1652.000=-195.000
max1457.000-1652.000=-195.000
mean0.829-0.844=-0.015
σ0.032-0.024=0.008
min0.795-0.804=-0.009
max0.865-0.867=-0.002
name=cdr_enhanced_4k_loc.art
mean885.511-885.512=-0.001
σ0.006-0.007=-0.000
min885.504-885.505=-0.001
max885.518-885.522=-0.004
mean1457.000-1652.000=-195.000
σ0.000
min1457.000-1652.000=-195.000
max1457.000-1652.000=-195.000
mean0.736-0.715=0.021
σ0.008-0.035=-0.027
min0.723-0.676=0.047
max0.745-0.743=0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.723=-0.004
mean1457.000-1652.000=-195.000
σ0.000
min1457.000-1652.000=-195.000
max1457.000-1652.000=-195.000
mean3.535-4.269=-0.734
σ0.084-0.085=-0.001
min3.395-4.114=-0.719
max3.894-4.579=-0.685
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1457.000-1652.000=-195.000
σ0.000
min1457.000-1652.000=-195.000
max1457.000-1652.000=-195.000
mean3.523-4.252=-0.728
σ0.064-0.078=-0.014
min3.386-4.123=-0.737
max3.734-4.553=-0.819
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1457.000-1652.000=-195.000
σ0.000
min1457.000-1652.000=-195.000
max1457.000-1652.000=-195.000
mean0.540-0.735=-0.195
σ0.015-0.019=-0.003
min0.520-0.702=-0.182
max0.638-0.852=-0.214
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1457.000-1652.000=-195.000
σ0.000
min1457.000-1652.000=-195.000
max1457.000-1652.000=-195.000
mean0.506-0.703=-0.197
σ0.016-0.015=0.001
min0.475-0.674=-0.199
max0.569-0.790=-0.221

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.628-295.395=0.233
σ0.285-0.236=0.050
min295.466-295.247=0.220
max296.421-296.057=0.364
mean1905.000-1897.000=8.000
σ0.000
min1905.000-1897.000=8.000
max1905.000-1897.000=8.000
mean0.583-0.575=0.008
σ0.046-0.057=-0.010
min0.500-0.506=-0.006
max0.645-0.685=-0.041

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.398-285.365=0.033
σ0.030-0.038=-0.007
min285.360-285.310=0.050
max285.431-285.401=0.030
mean1457.000-1652.000=-195.000
σ0.000
min1457.000-1652.000=-195.000
max1457.000-1652.000=-195.000
mean0.403-0.391=0.012
σ0.005-0.009=-0.004
min0.396-0.381=0.014
max0.410-0.404=0.006
iters=5
new-facts=1
prior-facts=6402
mean1295.765-1295.745=0.020
σ0.069-0.113=-0.044
min1295.676-1295.625=0.051
max1295.838-1295.883=-0.045
mean1457.000-1652.000=-195.000
σ0.000
min1457.000-1652.000=-195.000
max1457.000-1652.000=-195.000
mean1.913-1.900=0.014
σ0.102-0.081=0.021
min1.819-1.806=0.013
max2.048-1.975=0.073
iters=5
new-facts=6402
prior-facts=1
mean1539.992-1539.900=0.092
σ6.860-6.853=0.007
min1536.776-1536.612=0.164
max1552.261-1552.154=0.107
mean1457.000-1652.000=-195.000
σ0.000
min1457.000-1652.000=-195.000
max1457.000-1652.000=-195.000
mean2.503-2.360=0.143
σ0.156-0.233=-0.077
min2.248-2.009=0.239
max2.645-2.564=0.081
iters=5
new-facts=6402
prior-facts=6402
mean1857.700-1857.657=0.043
σ0.051-0.070=-0.019
min1857.654-1857.570=0.084
max1857.774-1857.751=0.023
mean1744.600-1778.200=-33.600
σ171.144-120.082=51.062
min1505.000-1652.000=-147.000
max1905.000-1897.000=8.000
mean3.058-2.985=0.073
σ0.264-0.108=0.155
min2.869-2.841=0.028
max3.524-3.086=0.438

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.759-1.189=0.571
σ0.129-0.341=-0.212
min1.608-0.930=0.678
max1.917-1.752=0.166

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.634=0.107
σ580.934-580.934=0.000
min155.272-155.164=0.109
max1317.142-1317.035=0.107
mean96.250
σ8.500
min92.000
max109.000
mean1457.000-1652.000=-195.000
σ0.000
min1457.000-1652.000=-195.000
max1457.000-1652.000=-195.000
mean0.542-0.531=0.011
σ0.558-0.537=0.020
min0.262-0.256=0.006
max1.378-1.337=0.041
policies=20
mean1552.986-1551.945=1.041
σ0.317-0.331=-0.013
min1552.769-1551.715=1.054
max1553.457-1552.435=1.022
mean920.000
σ0.000
min920.000
max920.000
mean1457.000-1652.000=-195.000
σ0.000
min1457.000-1652.000=-195.000
max1457.000-1652.000=-195.000
mean2.572-2.586=-0.015
σ0.017-0.015=0.002
min2.557-2.568=-0.011
max2.595-2.604=-0.008
policies=200
mean15538.060-15527.664=10.396
σ0.060-0.091=-0.031
min15538.014-15527.588=10.426
max15538.147-15527.784=10.363
mean9200.000
σ0.000
min9200.000
max9200.000
mean1457.000-1652.000=-195.000
σ0.000
min1457.000-1652.000=-195.000
max1457.000-1652.000=-195.000
mean26.140-26.051=0.089
σ0.018-0.122=-0.104
min26.118-25.943=0.175
max26.161-26.220=-0.058