Compare commits

Home / Compare c74ac811 .. 8b323e4d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.055=-0.002
σ0.368-0.367=0.001
min53.910-53.911=-0.001
max55.100-55.099=0.001
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.139-0.141=-0.002
σ0.005-0.004=0.001
min0.131-0.136=-0.004
max0.145-0.148=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.397-43.393=0.003
σ0.005-0.006=-0.001
min43.390-43.385=0.006
max43.406-43.405=0.001
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.132-0.122=0.010
σ0.010-0.005=0.005
min0.121-0.117=0.004
max0.150-0.130=0.021

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1007.006=-0.001
σ1.195-1.191=0.003
min1006.435-1006.434=0.001
max1012.009-1011.999=0.010
mean1053.750-1053.350=0.400
σ308.958-307.644=1.314
min578.000-579.000=-1.000
max1652.000-1645.000=7.000
mean1.536-1.540=-0.004
σ0.071-0.091=-0.020
min1.469-1.467=0.001
max1.756-1.770=-0.014

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1652.000-1645.000=7.000
σ0.000
min1652.000-1645.000=7.000
max1652.000-1645.000=7.000
mean0.425-0.413=0.011
σ0.144-0.137=0.007
min0.342-0.326=0.015
max0.681-0.654=0.028
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1652.000-1645.000=7.000
σ0.000
min1652.000-1645.000=7.000
max1652.000-1645.000=7.000
mean0.887-0.881=0.006
σ0.094-0.090=0.004
min0.830-0.805=0.026
max1.051-1.034=0.016
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1652.000-1645.000=7.000
σ0.000
min1652.000-1645.000=7.000
max1652.000-1645.000=7.000
mean0.546-0.549=-0.003
σ0.046-0.049=-0.003
min0.502-0.501=0.001
max0.618-0.632=-0.014
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1652.000-1645.000=7.000
σ0.000
min1652.000-1645.000=7.000
max1652.000-1645.000=7.000
mean0.864-0.849=0.015
σ0.041-0.039=0.002
min0.833-0.826=0.007
max0.930-0.919=0.011

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.839=-0.001
σ0.034-0.034=0.001
min964.811-964.811=0.000
max964.896-964.894=0.002
mean1652.000-1645.000=7.000
σ0.000
min1652.000-1645.000=7.000
max1652.000-1645.000=7.000
mean0.788-0.834=-0.046
σ0.059-0.017=0.042
min0.726-0.814=-0.088
max0.853-0.848=0.006
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.008-0.008=-0.000
min885.504
max885.522-885.523=-0.001
mean1652.000-1645.000=7.000
σ0.000
min1652.000-1645.000=7.000
max1652.000-1645.000=7.000
mean0.719-0.712=0.007
σ0.047-0.029=0.018
min0.636-0.665=-0.029
max0.748-0.736=0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.721=0.002
mean1652.000-1645.000=7.000
σ0.000
min1652.000-1645.000=7.000
max1652.000-1645.000=7.000
mean4.268-4.251=0.017
σ0.078-0.085=-0.007
min4.127-4.128=-0.001
max4.500-4.601=-0.101
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1652.000-1645.000=7.000
σ0.000
min1652.000-1645.000=7.000
max1652.000-1645.000=7.000
mean4.252-4.242=0.010
σ0.077-0.093=-0.016
min4.117-4.112=0.004
max4.507-4.531=-0.024
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1652.000-1645.000=7.000
σ0.000
min1652.000-1645.000=7.000
max1652.000-1645.000=7.000
mean0.756-0.750=0.006
σ0.016-0.035=-0.019
min0.722-0.551=0.172
max0.858-0.862=-0.004
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1652.000-1645.000=7.000
σ0.000
min1652.000-1645.000=7.000
max1652.000-1645.000=7.000
mean0.715-0.716=-0.001
σ0.016-0.018=-0.002
min0.678-0.604=0.074
max0.783-0.760=0.023

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.121-297.024=0.097
σ0.184-0.270=-0.087
min296.922-296.776=0.146
max297.590-297.742=-0.152
mean1948.000-1920.000=28.000
σ0.000
min1948.000-1920.000=28.000
max1948.000-1920.000=28.000
mean0.591-0.590=0.001
σ0.026-0.036=-0.009
min0.526-0.537=-0.011
max0.616-0.669=-0.054

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.817-286.825=-0.008
σ0.037-0.036=0.001
min286.773-286.774=-0.001
max286.864-286.859=0.004
mean1652.000-1645.000=7.000
σ0.000
min1652.000-1645.000=7.000
max1652.000-1645.000=7.000
mean0.396-0.401=-0.004
σ0.006-0.007=-0.001
min0.388-0.388=0.000
max0.402-0.406=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1297.258-1297.229=0.029
σ0.072-0.074=-0.001
min1297.179-1297.140=0.039
max1297.361-1297.292=0.069
mean1652.000-1645.000=7.000
σ0.000
min1652.000-1645.000=7.000
max1652.000-1645.000=7.000
mean2.124-2.066=0.058
σ0.092-0.056=0.036
min2.014-1.999=0.015
max2.215-2.146=0.069
iters=5
new-facts=6402
prior-facts=1
mean1541.327-1541.326=0.001
σ6.846-6.848=-0.002
min1538.091-1538.107=-0.016
max1553.569-1553.573=-0.004
mean1652.000-1645.000=7.000
σ0.000
min1652.000-1645.000=7.000
max1652.000-1645.000=7.000
mean2.260-2.273=-0.013
σ0.178-0.187=-0.009
min2.094-2.115=-0.022
max2.499-2.484=0.016
iters=5
new-facts=6402
prior-facts=6402
mean1859.116-1859.116=-0.000
σ0.062-0.078=-0.016
min1859.039-1859.007=0.032
max1859.184-1859.199=-0.015
mean1793.400-1786.400=7.000
σ148.734-135.083=13.651
min1652.000-1645.000=7.000
max1948.000-1920.000=28.000
mean2.999-3.171=-0.171
σ0.175-0.278=-0.103
min2.795-2.863=-0.067
max3.249-3.569=-0.320

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.274-1.226=0.048
σ0.332-0.344=-0.012
min0.929-0.932=-0.003
max1.760-1.772=-0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.822=0.000
σ581.372-581.372=-0.000
min158.134-158.135=-0.000
max1320.879-1320.880=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1652.000-1645.000=7.000
σ0.000
min1652.000-1645.000=7.000
max1652.000-1645.000=7.000
mean0.544-0.559=-0.016
σ0.552-0.596=-0.044
min0.264-0.258=0.006
max1.372-1.453=-0.081
policies=20
mean1581.626-1581.628=-0.002
σ0.357-0.354=0.003
min1581.387-1581.388=-0.001
max1582.157-1582.154=0.003
mean920.000
σ0.000
min920.000
max920.000
mean1652.000-1645.000=7.000
σ0.000
min1652.000-1645.000=7.000
max1652.000-1645.000=7.000
mean2.635-2.631=0.003
σ0.002-0.008=-0.006
min2.633-2.623=0.010
max2.637-2.642=-0.005
policies=200
mean15824.190-15824.240=-0.050
σ0.113-0.027=0.086
min15824.028-15824.218=-0.190
max15824.276-15824.274=0.002
mean9200.000
σ0.000
min9200.000
max9200.000
mean1652.000-1645.000=7.000
σ0.000
min1652.000-1645.000=7.000
max1652.000-1645.000=7.000
mean26.645-26.598=0.047
σ0.080-0.067=0.013
min26.560-26.542=0.018
max26.749-26.693=0.055