Compare commits

Home / Compare 28aec734 .. a6f8512f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.054=0.000
σ0.369-0.371=-0.001
min53.908-53.908=-0.000
max55.105-55.108=-0.003
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.142-0.138=0.004
σ0.004-0.005=-0.001
min0.139-0.132=0.007
max0.148-0.144=0.004
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=-0.000
σ0.007-0.008=-0.001
min43.384-43.384=0.000
max43.407-43.409=-0.002
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.118-0.121=-0.002
σ0.005-0.005=-0.000
min0.115-0.115=0.000
max0.129-0.129=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1007.002=0.003
σ1.207-1.206=0.002
min1006.431-1006.432=-0.000
max1012.065-1012.061=0.004
mean1056.700-1059.100=-2.400
σ313.846-314.822=-0.976
min587.000-589.000=-2.000
max1617.000-1622.000=-5.000
mean1.536-1.524=0.012
σ0.085-0.047=0.038
min1.465-1.474=-0.009
max1.835-1.631=0.204

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1617.000-1622.000=-5.000
σ0.000
min1617.000-1622.000=-5.000
max1617.000-1622.000=-5.000
mean0.426-0.417=0.009
σ0.104-0.139=-0.036
min0.360-0.323=0.037
max0.609-0.663=-0.054
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1617.000-1622.000=-5.000
σ0.000
min1617.000-1622.000=-5.000
max1617.000-1622.000=-5.000
mean0.889-0.951=-0.062
σ0.059-0.199=-0.140
min0.844-0.835=0.009
max0.991-1.305=-0.314
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1617.000-1622.000=-5.000
σ0.000
min1617.000-1622.000=-5.000
max1617.000-1622.000=-5.000
mean0.539-0.542=-0.003
σ0.045-0.054=-0.009
min0.503-0.504=-0.002
max0.614-0.636=-0.022
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=-0.000
min2.360
max2.364
mean1617.000-1622.000=-5.000
σ0.000
min1617.000-1622.000=-5.000
max1617.000-1622.000=-5.000
mean0.852-0.849=0.003
σ0.047-0.033=0.015
min0.805-0.825=-0.020
max0.930-0.906=0.023

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.839=0.001
σ0.021-0.035=-0.013
min964.825-964.810=0.015
max964.877-964.896=-0.019
mean1617.000-1622.000=-5.000
σ0.000
min1617.000-1622.000=-5.000
max1617.000-1622.000=-5.000
mean0.856-0.815=0.041
σ0.022-0.062=-0.041
min0.827-0.712=0.115
max0.877-0.872=0.005
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.001
σ0.007-0.007=-0.000
min885.505-885.504=0.001
max885.523-885.523=-0.000
mean1617.000-1622.000=-5.000
σ0.000
min1617.000-1622.000=-5.000
max1617.000-1622.000=-5.000
mean0.733-0.708=0.024
σ0.042-0.045=-0.004
min0.661-0.639=0.022
max0.766-0.748=0.018

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.720=0.001
mean1617.000-1622.000=-5.000
σ0.000
min1617.000-1622.000=-5.000
max1617.000-1622.000=-5.000
mean4.302-4.274=0.028
σ0.093-0.074=0.019
min4.143-4.147=-0.005
max4.757-4.546=0.211
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1617.000-1622.000=-5.000
σ0.000
min1617.000-1622.000=-5.000
max1617.000-1622.000=-5.000
mean4.286-4.278=0.008
σ0.092-0.082=0.011
min4.104-4.147=-0.043
max4.644-4.570=0.074
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1617.000-1622.000=-5.000
σ0.000
min1617.000-1622.000=-5.000
max1617.000-1622.000=-5.000
mean0.754-0.764=-0.010
σ0.016-0.037=-0.021
min0.730-0.564=0.166
max0.856-0.931=-0.075
name=record_render_syntax_err.art
mean2.166-2.166=0.000
σ0.002-0.002=-0.000
min2.165
max2.169
mean1617.000-1622.000=-5.000
σ0.000
min1617.000-1622.000=-5.000
max1617.000-1622.000=-5.000
mean0.719-0.723=-0.004
σ0.014-0.021=-0.007
min0.694-0.612=0.082
max0.787-0.799=-0.012

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.042-297.016=0.026
σ0.207-0.280=-0.073
min296.862-296.737=0.125
max297.600-297.721=-0.120
mean1899.000-1956.000=-57.000
σ0.000
min1899.000-1956.000=-57.000
max1899.000-1956.000=-57.000
mean0.569-0.581=-0.012
σ0.050-0.034=0.016
min0.523-0.503=0.020
max0.692-0.621=0.070

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.827-286.825=0.003
σ0.039-0.038=0.001
min286.778-286.779=-0.000
max286.868-286.864=0.005
mean1617.000-1622.000=-5.000
σ0.000
min1617.000-1622.000=-5.000
max1617.000-1622.000=-5.000
mean0.396-0.396=-0.001
σ0.009-0.006=0.003
min0.388-0.389=-0.001
max0.409-0.402=0.007
iters=5
new-facts=1
prior-facts=6402
mean1297.261-1297.265=-0.003
σ0.094-0.107=-0.013
min1297.126-1297.114=0.012
max1297.375-1297.404=-0.030
mean1617.000-1622.000=-5.000
σ0.000
min1617.000-1622.000=-5.000
max1617.000-1622.000=-5.000
mean2.227-2.239=-0.013
σ0.020-0.062=-0.042
min2.210-2.177=0.033
max2.254-2.333=-0.080
iters=5
new-facts=6402
prior-facts=1
mean1541.375-1541.361=0.014
σ6.803-6.809=-0.006
min1538.235-1538.188=0.048
max1553.543-1553.539=0.004
mean1617.000-1622.000=-5.000
σ0.000
min1617.000-1622.000=-5.000
max1617.000-1622.000=-5.000
mean2.332-2.285=0.047
σ0.250-0.230=0.020
min2.166-2.111=0.054
max2.754-2.642=0.112
iters=5
new-facts=6402
prior-facts=6402
mean1859.116-1859.117=-0.002
σ0.063-0.070=-0.006
min1859.031-1859.030=0.001
max1859.190-1859.197=-0.006
mean1764.000-1785.000=-21.000
σ131.564-167.239=-35.676
min1617.000-1622.000=-5.000
max1899.000-1956.000=-57.000
mean3.131-2.988=0.143
σ0.256-0.133=0.123
min2.893-2.857=0.036
max3.498-3.173=0.325

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.158-1.211=-0.052
σ0.250-0.299=-0.048
min0.941-0.945=-0.004
max1.534-1.714=-0.180

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.821=0.000
σ581.372-581.373=-0.000
min158.134-158.131=0.004
max1320.879-1320.879=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1617.000-1622.000=-5.000
σ0.000
min1617.000-1622.000=-5.000
max1617.000-1622.000=-5.000
mean0.537-0.543=-0.006
σ0.543-0.554=-0.012
min0.263-0.259=0.004
max1.351-1.375=-0.024
policies=20
mean1581.633-1581.625=0.008
σ0.369-0.355=0.014
min1581.389-1581.390=-0.001
max1582.182-1582.153=0.030
mean920.000
σ0.000
min920.000
max920.000
mean1617.000-1622.000=-5.000
σ0.000
min1617.000-1622.000=-5.000
max1617.000-1622.000=-5.000
mean2.649-2.637=0.012
σ0.012-0.016=-0.003
min2.634-2.618=0.015
max2.662-2.651=0.012
policies=200
mean15824.242-15824.153=0.090
σ0.091-0.107=-0.016
min15824.157-15824.006=0.152
max15824.359-15824.247=0.112
mean9200.000
σ0.000
min9200.000
max9200.000
mean1617.000-1622.000=-5.000
σ0.000
min1617.000-1622.000=-5.000
max1617.000-1622.000=-5.000
mean26.631-26.690=-0.059
σ0.090-0.022=0.068
min26.544-26.663=-0.119
max26.734-26.717=0.017