Compare commits

Home / Compare fe101fc5 .. 94405c49

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.059=-0.005
σ0.371-0.369=0.002
min53.909-53.913=-0.004
max55.110-55.108=0.002
mean418.000
σ0.000
min418.000
max418.000
mean0.139-0.152=-0.013
σ0.005-0.008=-0.003
min0.132-0.139=-0.007
max0.147-0.164=-0.017
cache=y
dps=1
iters=10
policies=100
mean43.394-43.396=-0.002
σ0.008-0.008=-0.000
min43.377-43.385=-0.008
max43.405-43.410=-0.005
mean418.000
σ0.000
min418.000
max418.000
mean0.121-0.132=-0.011
σ0.004-0.013=-0.009
min0.118-0.115=0.003
max0.129-0.149=-0.019

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.021-1007.025=-0.004
σ1.195-1.208=-0.013
min1006.453-1006.450=0.002
max1012.031-1012.089=-0.058
mean1055.850-1048.800=7.050
σ316.796-313.857=2.938
min561.000-576.000=-15.000
max1621.000-1642.000=-21.000
mean1.526-1.550=-0.024
σ0.051-0.109=-0.058
min1.459-1.374=0.085
max1.637-1.845=-0.208

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1621.000-1642.000=-21.000
σ0.000
min1621.000-1642.000=-21.000
max1621.000-1642.000=-21.000
mean0.463-0.415=0.048
σ0.199-0.129=0.070
min0.349-0.338=0.012
max0.817-0.642=0.175
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1621.000-1642.000=-21.000
σ0.000
min1621.000-1642.000=-21.000
max1621.000-1642.000=-21.000
mean0.954-0.906=0.048
σ0.184-0.085=0.099
min0.848-0.829=0.018
max1.281-1.049=0.233
name=heavy_item.art
mean1.524-1.524=-0.000
σ0.002-0.002=0.000
min1.522
max1.526
mean1621.000-1642.000=-21.000
σ0.000
min1621.000-1642.000=-21.000
max1621.000-1642.000=-21.000
mean0.552-0.557=-0.005
σ0.046-0.050=-0.004
min0.516-0.518=-0.002
max0.629-0.638=-0.009
name=nested_use.art
mean2.361-2.361=0.000
σ0.002-0.002=0.000
min2.360
max2.364
mean1621.000-1642.000=-21.000
σ0.000
min1621.000-1642.000=-21.000
max1621.000-1642.000=-21.000
mean0.874-0.871=0.003
σ0.035-0.038=-0.003
min0.848-0.850=-0.001
max0.934-0.940=-0.006

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.829-964.833=-0.004
σ0.024-0.029=-0.006
min964.802
max964.858-964.880=-0.022
mean1621.000-1642.000=-21.000
σ0.000
min1621.000-1642.000=-21.000
max1621.000-1642.000=-21.000
mean0.827-0.846=-0.019
σ0.069-0.039=0.031
min0.709-0.777=-0.068
max0.874-0.869=0.004
name=cdr_enhanced_4k_loc.art
mean885.513-885.513=0.000
σ0.009-0.005=0.004
min885.504
max885.524-885.518=0.006
mean1621.000-1642.000=-21.000
σ0.000
min1621.000-1642.000=-21.000
max1621.000-1642.000=-21.000
mean0.741-0.725=0.016
σ0.013-0.030=-0.017
min0.724-0.672=0.052
max0.759-0.746=0.013

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.722=-0.003
mean1621.000-1642.000=-21.000
σ0.000
min1621.000-1642.000=-21.000
max1621.000-1642.000=-21.000
mean4.281-3.569=0.712
σ0.088-0.073=0.015
min4.110-3.423=0.688
max4.618-3.873=0.745
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1621.000-1642.000=-21.000
σ0.000
min1621.000-1642.000=-21.000
max1621.000-1642.000=-21.000
mean4.275-3.534=0.741
σ0.070-0.062=0.008
min4.116-3.406=0.710
max4.504-3.760=0.744
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1621.000-1642.000=-21.000
σ0.000
min1621.000-1642.000=-21.000
max1621.000-1642.000=-21.000
mean0.767-0.767=0.000
σ0.020-0.018=0.002
min0.733-0.737=-0.004
max0.884-0.874=0.010
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1621.000-1642.000=-21.000
σ0.000
min1621.000-1642.000=-21.000
max1621.000-1642.000=-21.000
mean0.724-0.724=-0.000
σ0.016-0.015=0.001
min0.692-0.698=-0.006
max0.793-0.808=-0.015

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.981-297.052=-0.071
σ0.198-0.190=0.007
min296.860-296.868=-0.008
max297.524-297.557=-0.033
mean1906.000-1949.000=-43.000
σ0.000
min1906.000-1949.000=-43.000
max1906.000-1949.000=-43.000
mean0.585-0.592=-0.007
σ0.055-0.040=0.015
min0.504-0.543=-0.039
max0.705-0.692=0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.836-286.837=-0.001
σ0.040-0.043=-0.003
min286.779-286.775=0.005
max286.875-286.883=-0.009
mean1621.000-1642.000=-21.000
σ0.000
min1621.000-1642.000=-21.000
max1621.000-1642.000=-21.000
mean0.392-0.399=-0.007
σ0.005-0.005=0.000
min0.388-0.392=-0.005
max0.400-0.404=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1297.194-1297.231=-0.037
σ0.105-0.106=-0.001
min1297.109-1297.115=-0.006
max1297.366-1297.379=-0.013
mean1621.000-1642.000=-21.000
σ0.000
min1621.000-1642.000=-21.000
max1621.000-1642.000=-21.000
mean1.932-1.880=0.052
σ0.193-0.087=0.106
min1.751-1.788=-0.036
max2.226-2.004=0.222
iters=5
new-facts=6402
prior-facts=1
mean1541.353-1541.356=-0.003
σ6.816-6.833=-0.016
min1538.171-1538.108=0.063
max1553.544-1553.576=-0.032
mean1621.000-1642.000=-21.000
σ0.000
min1621.000-1642.000=-21.000
max1621.000-1642.000=-21.000
mean2.236-2.150=0.086
σ0.204-0.125=0.079
min2.050-2.052=-0.001
max2.563-2.363=0.200
iters=5
new-facts=6402
prior-facts=6402
mean1859.134-1859.145=-0.011
σ0.054-0.063=-0.009
min1859.073-1859.082=-0.009
max1859.203-1859.231=-0.029
mean1769.800-1790.200=-20.400
σ135.234-153.957=-18.723
min1621.000-1642.000=-21.000
max1906.000-1949.000=-43.000
mean3.084-2.875=0.208
σ0.270-0.065=0.205
min2.875-2.800=0.075
max3.539-2.978=0.561

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.389-1.324=0.065
σ0.272-0.234=0.038
min1.234-1.121=0.114
max1.872-1.728=0.144

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.855-448.854=0.001
σ581.372-581.372=-0.000
min158.167-158.164=0.003
max1320.913-1320.912=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1621.000-1642.000=-21.000
σ0.000
min1621.000-1642.000=-21.000
max1621.000-1642.000=-21.000
mean0.551-0.527=0.024
σ0.577-0.534=0.044
min0.259-0.256=0.003
max1.417-1.328=0.089
policies=20
mean1581.959-1581.961=-0.002
σ0.356-0.374=-0.018
min1581.715-1581.698=0.017
max1582.488-1582.516=-0.027
mean920.000
σ0.000
min920.000
max920.000
mean1621.000-1642.000=-21.000
σ0.000
min1621.000-1642.000=-21.000
max1621.000-1642.000=-21.000
mean2.634-2.650=-0.016
σ0.010-0.005=0.005
min2.626-2.643=-0.016
max2.648-2.655=-0.007
policies=200
mean15827.546-15827.608=-0.062
σ0.052-0.114=-0.062
min15827.509-15827.511=-0.002
max15827.623-15827.767=-0.144
mean9200.000
σ0.000
min9200.000
max9200.000
mean1621.000-1642.000=-21.000
σ0.000
min1621.000-1642.000=-21.000
max1621.000-1642.000=-21.000
mean26.602-26.595=0.007
σ0.040-0.079=-0.039
min26.570-26.491=0.079
max26.655-26.684=-0.029