Compare commits

Home / Compare 9ccacbbe .. a0f71a2a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.054=0.000
σ0.367-0.368=-0.001
min53.911-53.912=-0.000
max55.099-55.101=-0.002
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.139-0.139=0.000
σ0.004-0.005=-0.001
min0.133-0.132=0.000
max0.145-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.394-43.392=0.002
σ0.006-0.006=0.000
min43.385-43.383=0.002
max43.405-43.401=0.004
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.123-0.119=0.004
σ0.004-0.005=-0.000
min0.115-0.113=0.003
max0.129-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.003-1007.007=-0.003
σ1.193-1.192=0.000
min1006.454-1006.433=0.021
max1012.007-1012.004=0.003
mean1041.500-1053.300=-11.800
σ304.831-307.686=-2.855
min589.000-578.000=11.000
max1627.000-1645.000=-18.000
mean1.569-1.555=0.014
σ0.097-0.070=0.027
min1.474-1.484=-0.010
max1.839-1.780=0.059

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1627.000-1645.000=-18.000
σ0.000
min1627.000-1645.000=-18.000
max1627.000-1645.000=-18.000
mean0.425-0.414=0.011
σ0.146-0.110=0.036
min0.340-0.356=-0.016
max0.686-0.610=0.076
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1627.000-1645.000=-18.000
σ0.000
min1627.000-1645.000=-18.000
max1627.000-1645.000=-18.000
mean0.905-0.930=-0.025
σ0.146-0.186=-0.040
min0.813-0.817=-0.005
max1.163-1.260=-0.097
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1627.000-1645.000=-18.000
σ0.000
min1627.000-1645.000=-18.000
max1627.000-1645.000=-18.000
mean0.532-0.536=-0.004
σ0.040-0.046=-0.006
min0.503-0.504=-0.000
max0.602-0.610=-0.008
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1627.000-1645.000=-18.000
σ0.000
min1627.000-1645.000=-18.000
max1627.000-1645.000=-18.000
mean0.824-0.841=-0.017
σ0.040-0.037=0.003
min0.795-0.819=-0.024
max0.891-0.905=-0.014

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.837-964.838=-0.001
σ0.025-0.032=-0.008
min964.820-964.811=0.009
max964.878-964.891=-0.013
mean1627.000-1645.000=-18.000
σ0.000
min1627.000-1645.000=-18.000
max1627.000-1645.000=-18.000
mean0.818-0.812=0.006
σ0.048-0.058=-0.010
min0.755-0.730=0.025
max0.854-0.865=-0.011
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.007-0.008=-0.000
min885.504-885.506=-0.001
max885.522-885.524=-0.002
mean1627.000-1645.000=-18.000
σ0.000
min1627.000-1645.000=-18.000
max1627.000-1645.000=-18.000
mean0.720-0.720=-0.001
σ0.047-0.030=0.017
min0.636-0.668=-0.032
max0.751-0.739=0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721
mean1627.000-1645.000=-18.000
σ0.000
min1627.000-1645.000=-18.000
max1627.000-1645.000=-18.000
mean4.180-3.485=0.694
σ0.081-0.069=0.013
min4.044-3.358=0.686
max4.444-3.819=0.625
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1627.000-1645.000=-18.000
σ0.000
min1627.000-1645.000=-18.000
max1627.000-1645.000=-18.000
mean4.194-3.498=0.696
σ0.064-0.086=-0.022
min4.079-3.370=0.709
max4.383-3.778=0.605
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1627.000-1645.000=-18.000
σ0.000
min1627.000-1645.000=-18.000
max1627.000-1645.000=-18.000
mean0.747-0.744=0.003
σ0.018-0.018=-0.001
min0.718-0.671=0.047
max0.869-0.828=0.041
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1627.000-1645.000=-18.000
σ0.000
min1627.000-1645.000=-18.000
max1627.000-1645.000=-18.000
mean0.709-0.701=0.008
σ0.014-0.016=-0.002
min0.685-0.671=0.014
max0.770-0.771=-0.001

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.987-296.811=0.175
σ0.226-0.180=0.046
min296.800-296.669=0.131
max297.603-297.303=0.300
mean1917.000-1925.000=-8.000
σ0.000
min1917.000-1925.000=-8.000
max1917.000-1925.000=-8.000
mean0.583-0.581=0.001
σ0.035-0.054=-0.019
min0.522-0.521=0.002
max0.653-0.702=-0.049

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.824-286.826=-0.002
σ0.037-0.039=-0.002
min286.776-286.773=0.003
max286.864-286.866=-0.002
mean1627.000-1645.000=-18.000
σ0.000
min1627.000-1645.000=-18.000
max1627.000-1645.000=-18.000
mean0.396-0.396=0.000
σ0.007-0.007=-0.000
min0.388-0.388=-0.000
max0.402-0.405=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1297.254-1297.245=0.010
σ0.080-0.062=0.018
min1297.157-1297.172=-0.015
max1297.364-1297.307=0.057
mean1627.000-1645.000=-18.000
σ0.000
min1627.000-1645.000=-18.000
max1627.000-1645.000=-18.000
mean2.113-2.078=0.034
σ0.094-0.059=0.036
min2.003-2.013=-0.010
max2.221-2.139=0.081
iters=5
new-facts=6402
prior-facts=1
mean1541.311-1541.305=0.006
σ6.839-6.843=-0.003
min1538.075-1538.051=0.024
max1553.542-1553.541=0.001
mean1627.000-1645.000=-18.000
σ0.000
min1627.000-1645.000=-18.000
max1627.000-1645.000=-18.000
mean2.186-2.164=0.021
σ0.088-0.107=-0.019
min2.117-2.083=0.034
max2.312-2.346=-0.035
iters=5
new-facts=6402
prior-facts=6402
mean1859.113-1859.108=0.005
σ0.084-0.074=0.010
min1858.989-1859.009=-0.020
max1859.194-1859.186=0.008
mean1767.400-1778.200=-10.800
σ145.364-140.823=4.541
min1627.000-1645.000=-18.000
max1917.000-1925.000=-8.000
mean3.048-3.076=-0.028
σ0.154-0.175=-0.021
min2.866-2.793=0.073
max3.214-3.226=-0.012

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.183-1.208=-0.025
σ0.323-0.308=0.015
min0.957-0.939=0.017
max1.754-1.716=0.038

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.822=-0.001
σ581.372-581.372=0.001
min158.131-158.134=-0.003
max1320.880-1320.880=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1627.000-1645.000=-18.000
σ0.000
min1627.000-1645.000=-18.000
max1627.000-1645.000=-18.000
mean0.553-0.547=0.006
σ0.571-0.564=0.007
min0.264-0.264=0.000
max1.410-1.393=0.017
policies=20
mean1581.629-1581.628=0.001
σ0.367-0.361=0.006
min1581.383-1581.387=-0.004
max1582.175-1582.165=0.010
mean920.000
σ0.000
min920.000
max920.000
mean1627.000-1645.000=-18.000
σ0.000
min1627.000-1645.000=-18.000
max1627.000-1645.000=-18.000
mean2.641-2.647=-0.006
σ0.010-0.022=-0.012
min2.631-2.625=0.006
max2.651-2.672=-0.021
policies=200
mean15824.130-15824.235=-0.105
σ0.125-0.086=0.039
min15823.982-15824.164=-0.182
max15824.273-15824.355=-0.081
mean9200.000
σ0.000
min9200.000
max9200.000
mean1627.000-1645.000=-18.000
σ0.000
min1627.000-1645.000=-18.000
max1627.000-1645.000=-18.000
mean26.671-26.640=0.031
σ0.101-0.046=0.055
min26.563-26.580=-0.017
max26.807-26.691=0.116