Compare commits

Home / Compare 2bc35bcc .. 5d121ba7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.964-54.015=-0.051
σ0.370-0.370=0.000
min53.818-53.870=-0.052
max55.017-55.067=-0.050
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.137-0.140=-0.003
σ0.005-0.005=-0.000
min0.130-0.134=-0.004
max0.145-0.150=-0.005
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.001
σ0.007-0.006=0.001
min43.311-43.311=-0.000
max43.335-43.335=0.000
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.122-0.121=0.002
σ0.005-0.003=0.002
min0.116-0.119=-0.003
max0.129-0.127=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.515-1006.308=0.208
σ1.175-1.194=-0.019
min1005.945-1005.777=0.168
max1011.433-1011.313=0.120
mean1052.900-1052.200=0.700
σ312.563-307.208=5.355
min554.000-585.000=-31.000
max1516.000-1644.000=-128.000
mean1.520-1.565=-0.045
σ0.063-0.085=-0.022
min1.447-1.490=-0.043
max1.663-1.789=-0.126

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.866=0.018
σ0.003
min0.882-0.864=0.018
max0.887-0.869=0.018
mean1516.000-1644.000=-128.000
σ0.000
min1516.000-1644.000=-128.000
max1516.000-1644.000=-128.000
mean0.426-0.413=0.013
σ0.136-0.138=-0.002
min0.339-0.332=0.007
max0.666-0.659=0.008
name=error_case.art
mean2.339-2.337=0.001
σ0.003
min2.337-2.336=0.001
max2.342-2.341=0.001
mean1516.000-1644.000=-128.000
σ0.000
min1516.000-1644.000=-128.000
max1516.000-1644.000=-128.000
mean0.913-0.881=0.031
σ0.083-0.101=-0.018
min0.840-0.821=0.020
max1.047-1.060=-0.014
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002-0.002=-0.000
min1.522-1.522=0.001
max1.526-1.526=0.001
mean1516.000-1644.000=-128.000
σ0.000
min1516.000-1644.000=-128.000
max1516.000-1644.000=-128.000
mean0.538-0.529=0.009
σ0.059-0.046=0.014
min0.494-0.490=0.004
max0.642-0.606=0.036
name=nested_use.art
mean2.361-2.360=0.001
σ0.002
min2.360-2.359=0.001
max2.364-2.363=0.001
mean1516.000-1644.000=-128.000
σ0.000
min1516.000-1644.000=-128.000
max1516.000-1644.000=-128.000
mean0.851-0.828=0.023
σ0.055-0.035=0.020
min0.807-0.783=0.024
max0.945-0.878=0.067

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.830-964.115=0.715
σ0.037-0.033=0.004
min964.809-964.088=0.722
max964.895-964.169=0.726
mean1516.000-1644.000=-128.000
σ0.000
min1516.000-1644.000=-128.000
max1516.000-1644.000=-128.000
mean0.811-0.846=-0.035
σ0.046-0.003=0.043
min0.748-0.843=-0.095
max0.852-0.852=0.001
name=cdr_enhanced_4k_loc.art
mean885.511-884.712=0.799
σ0.006-0.008=-0.002
min885.504-884.703=0.801
max885.518-884.723=0.795
mean1516.000-1644.000=-128.000
σ0.000
min1516.000-1644.000=-128.000
max1516.000-1644.000=-128.000
mean0.714-0.682=0.033
σ0.047-0.040=0.007
min0.631-0.627=0.004
max0.740-0.726=0.014

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.715=0.002
σ0.002-0.002=0.000
min7.715-7.714=0.002
max7.719-7.718=0.002
mean1516.000-1644.000=-128.000
σ0.000
min1516.000-1644.000=-128.000
max1516.000-1644.000=-128.000
mean4.245-3.476=0.769
σ0.090-0.078=0.012
min4.106-3.370=0.736
max4.616-3.760=0.856
name=record_render_large_syntax_err.art
mean7.665-7.663=0.002
σ0.002-0.002=-0.000
min7.664-7.662=0.002
max7.668-7.666=0.002
mean1516.000-1644.000=-128.000
σ0.000
min1516.000-1644.000=-128.000
max1516.000-1644.000=-128.000
mean4.234-4.112=0.122
σ0.082-0.303=-0.221
min4.079-3.401=0.677
max4.511-4.985=-0.474
name=record_render_success.art
mean2.291-2.289=0.001
σ0.002
min2.290-2.289=0.001
max2.294-2.292=0.001
mean1516.000-1644.000=-128.000
σ0.000
min1516.000-1644.000=-128.000
max1516.000-1644.000=-128.000
mean0.742-0.730=0.012
σ0.018-0.016=0.002
min0.705-0.705=0.000
max0.858-0.811=0.047
name=record_render_syntax_err.art
mean2.166-2.165=0.001
σ0.002
min2.165-2.164=0.001
max2.169-2.168=0.001
mean1516.000-1644.000=-128.000
σ0.000
min1516.000-1644.000=-128.000
max1516.000-1644.000=-128.000
mean0.573-0.692=-0.118
σ0.099-0.013=0.085
min0.477-0.665=-0.188
max0.758-0.740=0.018

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.165-296.286=-0.121
σ0.213-0.232=-0.019
min295.974-296.106=-0.133
max296.726-296.915=-0.188
mean1918.000-1907.000=11.000
σ0.000
min1918.000-1907.000=11.000
max1918.000-1907.000=11.000
mean0.571-0.583=-0.011
σ0.052-0.044=0.007
min0.506-0.538=-0.032
max0.697-0.690=0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.036-284.693=0.343
σ0.035-0.039=-0.004
min284.989-284.641=0.347
max285.073-284.734=0.339
mean1516.000-1644.000=-128.000
σ0.000
min1516.000-1644.000=-128.000
max1516.000-1644.000=-128.000
mean0.395-0.398=-0.002
σ0.007-0.010=-0.002
min0.388-0.386=0.002
max0.406-0.406=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.414-1295.080=0.334
σ0.112-0.107=0.004
min1295.287-1294.961=0.326
max1295.556-1295.208=0.348
mean1516.000-1644.000=-128.000
σ0.000
min1516.000-1644.000=-128.000
max1516.000-1644.000=-128.000
mean1.919-1.901=0.018
σ0.104-0.097=0.007
min1.813-1.806=0.007
max2.060-2.030=0.030
iters=5
new-facts=6402
prior-facts=1
mean1539.524-1539.222=0.302
σ6.863-6.838=0.025
min1536.224-1535.923=0.300
max1551.794-1551.448=0.346
mean1516.000-1644.000=-128.000
σ0.000
min1516.000-1644.000=-128.000
max1516.000-1644.000=-128.000
mean2.281-2.357=-0.077
σ0.204-0.177=0.027
min2.087-2.051=0.036
max2.576-2.459=0.117
iters=5
new-facts=6402
prior-facts=6402
mean1857.322-1856.986=0.336
σ0.055-0.053=0.002
min1857.275-1856.940=0.336
max1857.408-1857.070=0.338
mean1751.200-1776.600=-25.400
σ174.382-129.782=44.601
min1516.000-1644.000=-128.000
max1918.000-1907.000=11.000
mean3.024-3.037=-0.013
σ0.273-0.296=-0.023
min2.775-2.778=-0.003
max3.476-3.532=-0.056

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.593-1.176=0.417
σ0.309-0.312=-0.003
min1.230-0.940=0.290
max1.889-1.685=0.204

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.192-447.784=0.407
σ581.331-581.213=0.118
min157.524-157.176=0.348
max1320.189-1319.604=0.585
mean96.250
σ8.500
min92.000
max109.000
mean1516.000-1644.000=-128.000
σ0.000
min1516.000-1644.000=-128.000
max1516.000-1644.000=-128.000
mean0.549-0.548=0.001
σ0.564-0.570=-0.007
min0.262-0.261=0.001
max1.395-1.404=-0.009
policies=20
mean1575.581-1572.086=3.494
σ0.372-0.354=0.017
min1575.332-1571.846=3.486
max1576.133-1572.613=3.521
mean920.000
σ0.000
min920.000
max920.000
mean1516.000-1644.000=-128.000
σ0.000
min1516.000-1644.000=-128.000
max1516.000-1644.000=-128.000
mean2.653-2.628=0.025
σ0.055-0.022=0.033
min2.617-2.607=0.009
max2.734-2.651=0.084
policies=200
mean15763.663-15729.010=34.654
σ0.125-0.092=0.034
min15763.552-15728.874=34.678
max15763.801-15729.066=34.735
mean9200.000
σ0.000
min9200.000
max9200.000
mean1516.000-1644.000=-128.000
σ0.000
min1516.000-1644.000=-128.000
max1516.000-1644.000=-128.000
mean26.558-26.548=0.009
σ0.030-0.088=-0.058
min26.525-26.487=0.038
max26.596-26.677=-0.081