Compare commits

Home / Compare be81eccf .. 782dec28

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.964-53.965=-0.001
σ0.370-0.369=0.001
min53.827-53.826=0.001
max55.016-55.014=0.002
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.137-0.140=-0.003
σ0.004-0.004=0.000
min0.132-0.133=-0.001
max0.146-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.324-43.322=0.002
σ0.006-0.007=-0.001
min43.312-43.314=-0.002
max43.336-43.339=-0.002
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.122-0.121=0.001
σ0.002-0.004=-0.002
min0.120-0.114=0.006
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.570-1006.565=0.005
σ1.422-1.445=-0.024
min1005.941-1005.942=-0.001
max1012.539-1012.654=-0.115
mean1061.300-1047.500=13.800
σ320.302-305.053=15.249
min541.000-588.000=-47.000
max1521.000-1638.000=-117.000
mean1.547-1.543=0.004
σ0.080-0.062=0.019
min1.391-1.470=-0.080
max1.801-1.702=0.099

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1521.000-1638.000=-117.000
σ0.000
min1521.000-1638.000=-117.000
max1521.000-1638.000=-117.000
mean0.421-0.439=-0.018
σ0.130-0.180=-0.050
min0.341-0.336=0.005
max0.652-0.759=-0.107
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1521.000-1638.000=-117.000
σ0.000
min1521.000-1638.000=-117.000
max1521.000-1638.000=-117.000
mean0.884-0.910=-0.027
σ0.108-0.150=-0.042
min0.810-0.812=-0.002
max1.071-1.175=-0.103
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1521.000-1638.000=-117.000
σ0.000
min1521.000-1638.000=-117.000
max1521.000-1638.000=-117.000
mean0.533-0.533=0.000
σ0.047-0.050=-0.003
min0.500-0.492=0.008
max0.608-0.614=-0.006
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1521.000-1638.000=-117.000
σ0.000
min1521.000-1638.000=-117.000
max1521.000-1638.000=-117.000
mean0.842-0.952=-0.110
σ0.034-0.175=-0.141
min0.822-0.834=-0.012
max0.902-1.259=-0.358

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.840=-0.009
σ0.038-0.033=0.005
min964.803-964.812=-0.009
max964.897-964.894=0.002
mean1521.000-1638.000=-117.000
σ0.000
min1521.000-1638.000=-117.000
max1521.000-1638.000=-117.000
mean0.842-0.819=0.023
σ0.022-0.061=-0.039
min0.816-0.713=0.103
max0.862-0.865=-0.002
name=cdr_enhanced_4k_loc.art
mean885.510-885.512=-0.002
σ0.006-0.007=-0.002
min885.504-885.505=-0.001
max885.515-885.523=-0.008
mean1521.000-1638.000=-117.000
σ0.000
min1521.000-1638.000=-117.000
max1521.000-1638.000=-117.000
mean0.729-0.717=0.011
σ0.015-0.041=-0.026
min0.704-0.649=0.055
max0.743-0.752=-0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.720=0.002
mean1521.000-1638.000=-117.000
σ0.000
min1521.000-1638.000=-117.000
max1521.000-1638.000=-117.000
mean4.209-4.246=-0.037
σ0.073-0.076=-0.002
min4.093-4.097=-0.004
max4.467-4.557=-0.090
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1521.000-1638.000=-117.000
σ0.000
min1521.000-1638.000=-117.000
max1521.000-1638.000=-117.000
mean4.181-4.216=-0.035
σ0.076-0.082=-0.006
min4.064-4.076=-0.011
max4.454-4.464=-0.010
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1521.000-1638.000=-117.000
σ0.000
min1521.000-1638.000=-117.000
max1521.000-1638.000=-117.000
mean0.738-0.739=-0.001
σ0.018-0.019=-0.001
min0.702-0.709=-0.007
max0.858-0.853=0.005
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1521.000-1638.000=-117.000
σ0.000
min1521.000-1638.000=-117.000
max1521.000-1638.000=-117.000
mean0.699-0.701=-0.002
σ0.016-0.017=-0.002
min0.671-0.646=0.025
max0.776-0.787=-0.011

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.479-297.450=0.029
σ0.293-0.177=0.116
min297.217-297.307=-0.090
max298.240-297.924=0.315
mean1901.000-1895.000=6.000
σ0.000
min1901.000-1895.000=6.000
max1901.000-1895.000=6.000
mean0.569-0.568=0.001
σ0.053-0.045=0.008
min0.511-0.500=0.011
max0.683-0.643=0.040

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.224-286.225=-0.001
σ0.038-0.036=0.002
min286.175-286.180=-0.005
max286.265-286.266=-0.001
mean1521.000-1638.000=-117.000
σ0.000
min1521.000-1638.000=-117.000
max1521.000-1638.000=-117.000
mean0.401-0.397=0.005
σ0.005-0.006=-0.002
min0.398-0.388=0.009
max0.410-0.406=0.003
iters=5
new-facts=1
prior-facts=6402
mean1296.683-1296.636=0.047
σ0.079-0.076=0.003
min1296.595-1296.541=0.054
max1296.802-1296.722=0.080
mean1521.000-1638.000=-117.000
σ0.000
min1521.000-1638.000=-117.000
max1521.000-1638.000=-117.000
mean2.210-2.066=0.144
σ0.051-0.051=0.000
min2.133-2.007=0.127
max2.258-2.129=0.129
iters=5
new-facts=6402
prior-facts=1
mean1540.775-1540.776=-0.001
σ6.891-6.890=0.001
min1537.532-1537.483=0.049
max1553.100-1553.098=0.002
mean1521.000-1638.000=-117.000
σ0.000
min1521.000-1638.000=-117.000
max1521.000-1638.000=-117.000
mean2.321-2.403=-0.081
σ0.312-0.324=-0.012
min2.150-2.139=0.011
max2.876-2.937=-0.061
iters=5
new-facts=6402
prior-facts=6402
mean1858.513-1858.509=0.004
σ0.062-0.076=-0.014
min1858.431-1858.396=0.035
max1858.590-1858.588=0.002
mean1744.600-1768.400=-23.800
σ163.653-126.057=37.596
min1521.000-1638.000=-117.000
max1901.000-1895.000=6.000
mean3.135-3.096=0.039
σ0.372-0.282=0.090
min2.870-2.857=0.013
max3.768-3.524=0.244

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.572-1.235=0.338
σ0.371-0.291=0.080
min1.089-0.946=0.143
max1.869-1.708=0.161

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean450.886-450.887=-0.000
σ581.930-581.929=0.000
min159.919-159.920=-0.001
max1323.781-1323.781=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1521.000-1638.000=-117.000
σ0.000
min1521.000-1638.000=-117.000
max1521.000-1638.000=-117.000
mean0.543-0.550=-0.007
σ0.553-0.572=-0.019
min0.264-0.262=0.002
max1.373-1.408=-0.035
policies=20
mean1599.480-1599.477=0.004
σ0.373-0.367=0.006
min1599.231-1599.233=-0.002
max1600.035-1600.023=0.012
mean920.000
σ0.000
min920.000
max920.000
mean1521.000-1638.000=-117.000
σ0.000
min1521.000-1638.000=-117.000
max1521.000-1638.000=-117.000
mean2.659-2.655=0.004
σ0.004-0.009=-0.005
min2.655-2.642=0.013
max2.663-2.662=0.001
policies=200
mean16002.729-16002.738=-0.009
σ0.121-0.106=0.015
min16002.619-16002.649=-0.030
max16002.869-16002.889=-0.020
mean9200.000
σ0.000
min9200.000
max9200.000
mean1521.000-1638.000=-117.000
σ0.000
min1521.000-1638.000=-117.000
max1521.000-1638.000=-117.000
mean26.965-26.874=0.090
σ0.121-0.047=0.074
min26.876-26.829=0.047
max27.144-26.918=0.226