Compare commits

Home / Compare 9b0246aa .. 340cc67a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.057=-0.002
σ0.369-0.369=-0.001
min53.908-53.915=-0.007
max55.103-55.108=-0.005
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.138-0.141=-0.003
σ0.004-0.003=0.000
min0.132-0.138=-0.006
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=-0.001
σ0.006-0.007=-0.001
min43.386-43.383=0.003
max43.402-43.407=-0.005
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.120-0.121=-0.001
σ0.004-0.004=-0.000
min0.115-0.116=-0.000
max0.126-0.128=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.922=0.057
σ0.925-0.886=0.039
min1006.507-1006.454=0.053
max1010.827-1010.595=0.233
mean1055.650-1050.850=4.800
σ306.148-315.826=-9.678
min576.000-545.000=31.000
max1457.000-1626.000=-169.000
mean1.568-1.530=0.038
σ0.135-0.074=0.061
min1.469-1.423=0.046
max2.021-1.769=0.252

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1457.000-1626.000=-169.000
σ0.000
min1457.000-1626.000=-169.000
max1457.000-1626.000=-169.000
mean0.441-0.404=0.037
σ0.126-0.093=0.033
min0.352-0.352=-0.001
max0.659-0.568=0.091
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1457.000-1626.000=-169.000
σ0.000
min1457.000-1626.000=-169.000
max1457.000-1626.000=-169.000
mean0.886-0.893=-0.007
σ0.097-0.088=0.009
min0.826-0.833=-0.007
max1.058-1.046=0.012
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1457.000-1626.000=-169.000
σ0.000
min1457.000-1626.000=-169.000
max1457.000-1626.000=-169.000
mean0.532-0.532=0.000
σ0.051-0.048=0.004
min0.482-0.487=-0.005
max0.616-0.611=0.006
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1457.000-1626.000=-169.000
σ0.000
min1457.000-1626.000=-169.000
max1457.000-1626.000=-169.000
mean0.843-0.843=-0.000
σ0.040-0.045=-0.005
min0.816-0.809=0.007
max0.911-0.921=-0.010

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.822-964.840=-0.017
σ0.026-0.035=-0.009
min964.802-964.809=-0.007
max964.864-964.897=-0.032
mean1457.000-1626.000=-169.000
σ0.000
min1457.000-1626.000=-169.000
max1457.000-1626.000=-169.000
mean0.829-0.822=0.007
σ0.032-0.027=0.005
min0.795-0.800=-0.005
max0.865-0.852=0.013
name=cdr_enhanced_4k_loc.art
mean885.511-885.512=-0.001
σ0.006-0.007=-0.001
min885.504
max885.518-885.522=-0.004
mean1457.000-1626.000=-169.000
σ0.000
min1457.000-1626.000=-169.000
max1457.000-1626.000=-169.000
mean0.736-0.704=0.032
σ0.008-0.025=-0.017
min0.723-0.664=0.059
max0.745-0.728=0.017

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.001
mean1457.000-1626.000=-169.000
σ0.000
min1457.000-1626.000=-169.000
max1457.000-1626.000=-169.000
mean3.535-4.232=-0.697
σ0.084-0.079=0.005
min3.395-4.063=-0.668
max3.894-4.507=-0.613
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1457.000-1626.000=-169.000
σ0.000
min1457.000-1626.000=-169.000
max1457.000-1626.000=-169.000
mean3.523-4.189=-0.666
σ0.064-0.069=-0.005
min3.386-4.029=-0.643
max3.734-4.482=-0.749
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1457.000-1626.000=-169.000
σ0.000
min1457.000-1626.000=-169.000
max1457.000-1626.000=-169.000
mean0.540-0.736=-0.196
σ0.015-0.018=-0.002
min0.520-0.704=-0.185
max0.638-0.841=-0.203
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1457.000-1626.000=-169.000
σ0.000
min1457.000-1626.000=-169.000
max1457.000-1626.000=-169.000
mean0.506-0.699=-0.193
σ0.016-0.029=-0.013
min0.475-0.510=-0.035
max0.569-0.786=-0.217

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.628-295.627=0.001
σ0.285-0.215=0.070
min295.466-295.482=-0.016
max296.421-296.213=0.208
mean1905.000-1904.000=1.000
σ0.000
min1905.000-1904.000=1.000
max1905.000-1904.000=1.000
mean0.583-0.566=0.016
σ0.046-0.051=-0.004
min0.500-0.498=0.002
max0.645-0.681=-0.037

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.398-285.356=0.042
σ0.030-0.037=-0.007
min285.360-285.303=0.057
max285.431-285.395=0.035
mean1457.000-1626.000=-169.000
σ0.000
min1457.000-1626.000=-169.000
max1457.000-1626.000=-169.000
mean0.403-0.387=0.016
σ0.005-0.009=-0.003
min0.396-0.380=0.015
max0.410-0.399=0.011
iters=5
new-facts=1
prior-facts=6402
mean1295.765-1295.731=0.035
σ0.069-0.120=-0.051
min1295.676-1295.597=0.079
max1295.838-1295.926=-0.088
mean1457.000-1626.000=-169.000
σ0.000
min1457.000-1626.000=-169.000
max1457.000-1626.000=-169.000
mean1.913-2.006=-0.093
σ0.102-0.215=-0.113
min1.819-1.807=0.012
max2.048-2.283=-0.235
iters=5
new-facts=6402
prior-facts=1
mean1539.992-1539.885=0.108
σ6.860-6.795=0.065
min1536.776-1536.695=0.082
max1552.261-1552.037=0.223
mean1457.000-1626.000=-169.000
σ0.000
min1457.000-1626.000=-169.000
max1457.000-1626.000=-169.000
mean2.503-2.273=0.230
σ0.156-0.156=0.001
min2.248-2.102=0.146
max2.645-2.438=0.206
iters=5
new-facts=6402
prior-facts=6402
mean1857.700-1857.657=0.043
σ0.051-0.055=-0.005
min1857.654-1857.597=0.057
max1857.774-1857.733=0.041
mean1744.600-1770.400=-25.800
σ171.144-130.692=40.452
min1505.000-1626.000=-121.000
max1905.000-1904.000=1.000
mean3.058-3.104=-0.046
σ0.264-0.275=-0.011
min2.869-2.861=0.008
max3.524-3.570=-0.046

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.759-1.243=0.516
σ0.129-0.278=-0.149
min1.608-1.060=0.548
max1.917-1.719=0.199

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.490=0.251
σ580.934-580.640=0.294
min155.272-155.165=0.108
max1317.142-1316.450=0.692
mean96.250
σ8.500
min92.000
max109.000
mean1457.000-1626.000=-169.000
σ0.000
min1457.000-1626.000=-169.000
max1457.000-1626.000=-169.000
mean0.542-0.508=0.034
σ0.558-0.501=0.057
min0.262-0.256=0.006
max1.378-1.260=0.118
policies=20
mean1552.986-1551.944=1.041
σ0.317-0.317=0.000
min1552.769-1551.728=1.041
max1553.457-1552.415=1.041
mean920.000
σ0.000
min920.000
max920.000
mean1457.000-1626.000=-169.000
σ0.000
min1457.000-1626.000=-169.000
max1457.000-1626.000=-169.000
mean2.572-2.568=0.004
σ0.017-0.013=0.004
min2.557-2.557=0.000
max2.595-2.585=0.011
policies=200
mean15538.060-15527.578=10.482
σ0.060-0.175=-0.116
min15538.014-15527.473=10.541
max15538.147-15527.838=10.309
mean9200.000
σ0.000
min9200.000
max9200.000
mean1457.000-1626.000=-169.000
σ0.000
min1457.000-1626.000=-169.000
max1457.000-1626.000=-169.000
mean26.140-26.022=0.119
σ0.018-0.143=-0.125
min26.118-25.921=0.197
max26.161-26.234=-0.073