Compare commits

Home / Compare 76308004 .. a5e29835

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.966-53.964=0.002
σ0.369-0.368=0.001
min53.822-53.815=0.007
max55.016-55.011=0.005
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.147-0.138=0.010
σ0.012-0.005=0.007
min0.135-0.131=0.004
max0.167-0.147=0.021
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.002
σ0.009-0.007=0.002
min43.313-43.311=0.002
max43.343-43.335=0.008
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.125-0.120=0.005
σ0.011-0.005=0.006
min0.115-0.114=0.001
max0.141-0.129=0.012

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.517-1006.512=0.006
σ1.185-1.180=0.004
min1005.960-1005.948=0.012
max1011.481-1011.464=0.018
mean1049.000-1052.300=-3.300
σ313.051-315.670=-2.619
min600.000-564.000=36.000
max1646.000-1614.000=32.000
mean1.565-1.496=0.069
σ0.066-0.060=0.006
min1.479-1.340=0.139
max1.731-1.586=0.145

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1646.000-1614.000=32.000
σ0.000
min1646.000-1614.000=32.000
max1646.000-1614.000=32.000
mean0.414-0.422=-0.008
σ0.136-0.141=-0.005
min0.333-0.336=-0.003
max0.653-0.672=-0.018
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1646.000-1614.000=32.000
σ0.000
min1646.000-1614.000=32.000
max1646.000-1614.000=32.000
mean0.911-0.900=0.011
σ0.108-0.091=0.017
min0.843-0.839=0.004
max1.102-1.058=0.044
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1646.000-1614.000=32.000
σ0.000
min1646.000-1614.000=32.000
max1646.000-1614.000=32.000
mean0.547-0.546=0.001
σ0.043-0.061=-0.018
min0.517-0.494=0.023
max0.619-0.645=-0.026
name=nested_use.art
mean2.362-2.361=0.001
σ0.001-0.002=-0.000
min2.360-2.360=0.000
max2.364
mean1646.000-1614.000=32.000
σ0.000
min1646.000-1614.000=32.000
max1646.000-1614.000=32.000
mean0.890-0.861=0.028
σ0.032-0.044=-0.012
min0.866-0.822=0.044
max0.945-0.933=0.012

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.837-964.839=-0.001
σ0.028-0.034=-0.006
min964.819-964.811=0.008
max964.887-964.896=-0.009
mean1646.000-1614.000=32.000
σ0.000
min1646.000-1614.000=32.000
max1646.000-1614.000=32.000
mean0.797-0.767=0.030
σ0.065-0.086=-0.021
min0.727-0.634=0.092
max0.861-0.851=0.010
name=cdr_enhanced_4k_loc.art
mean885.510-885.513=-0.003
σ0.006-0.006=-0.000
min885.504-885.506=-0.001
max885.519-885.522=-0.003
mean1646.000-1614.000=32.000
σ0.000
min1646.000-1614.000=32.000
max1646.000-1614.000=32.000
mean0.475-0.704=-0.229
σ0.060-0.031=0.030
min0.387-0.680=-0.293
max0.538-0.753=-0.215

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716
σ0.002
min7.715
max7.719
mean1646.000-1614.000=32.000
σ0.000
min1646.000-1614.000=32.000
max1646.000-1614.000=32.000
mean1.981-3.568=-1.586
σ0.068-0.103=-0.036
min1.867-3.393=-1.526
max2.250-4.082=-1.832
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.669-7.669=0.000
mean1646.000-1614.000=32.000
σ0.000
min1646.000-1614.000=32.000
max1646.000-1614.000=32.000
mean1.957-3.530=-1.574
σ0.080-0.061=0.019
min1.849-3.377=-1.529
max2.529-3.743=-1.214
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1646.000-1614.000=32.000
σ0.000
min1646.000-1614.000=32.000
max1646.000-1614.000=32.000
mean0.303-0.749=-0.446
σ0.009-0.017=-0.008
min0.290-0.715=-0.425
max0.349-0.837=-0.488
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1646.000-1614.000=32.000
σ0.000
min1646.000-1614.000=32.000
max1646.000-1614.000=32.000
mean0.288-0.702=-0.414
σ0.011-0.030=-0.019
min0.273-0.521=-0.248
max0.360-0.792=-0.433

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.482-296.449=0.033
σ0.241-0.246=-0.005
min296.241-296.197=0.044
max297.107-297.093=0.015
mean1914.000-2035.000=-121.000
σ0.000
min1914.000-2035.000=-121.000
max1914.000-2035.000=-121.000
mean0.580-0.549=0.031
σ0.033-0.029=0.004
min0.507-0.504=0.003
max0.611-0.582=0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.026-285.032=-0.007
σ0.038-0.037=0.001
min284.975-284.985=-0.009
max285.064-285.078=-0.013
mean1646.000-1614.000=32.000
σ0.000
min1646.000-1614.000=32.000
max1646.000-1614.000=32.000
mean0.395-0.392=0.003
σ0.009-0.005=0.004
min0.387-0.385=0.002
max0.409-0.397=0.013
iters=5
new-facts=1
prior-facts=6402
mean1295.409-1295.407=0.002
σ0.109-0.106=0.003
min1295.282-1295.290=-0.008
max1295.540-1295.526=0.014
mean1646.000-1614.000=32.000
σ0.000
min1646.000-1614.000=32.000
max1646.000-1614.000=32.000
mean1.981-1.919=0.063
σ0.129-0.110=0.019
min1.825-1.822=0.002
max2.165-2.060=0.105
iters=5
new-facts=6402
prior-facts=1
mean1539.525-1539.529=-0.004
σ6.852-6.812=0.040
min1536.236-1536.269=-0.033
max1551.777-1551.709=0.068
mean1646.000-1614.000=32.000
σ0.000
min1646.000-1614.000=32.000
max1646.000-1614.000=32.000
mean2.227-2.313=-0.086
σ0.191-0.132=0.059
min2.049-2.182=-0.133
max2.516-2.532=-0.016
iters=5
new-facts=6402
prior-facts=6402
mean1857.317-1857.317=0.000
σ0.054-0.067=-0.014
min1857.272-1857.235=0.037
max1857.400-1857.403=-0.003
mean1774.200-1775.400=-1.200
σ134.057-182.796=-48.739
min1646.000-1614.000=32.000
max1914.000-2035.000=-121.000
mean3.079-3.107=-0.028
σ0.275-0.270=0.005
min2.859-2.862=-0.003
max3.556-3.523=0.033

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.267-1.217=0.050
σ0.276-0.321=-0.045
min1.065-0.936=0.129
max1.737-1.721=0.016

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.192-448.189=0.004
σ581.333-581.332=0.001
min157.524-157.520=0.004
max1320.193-1320.187=0.006
mean96.250
σ8.500
min92.000
max109.000
mean1646.000-1614.000=32.000
σ0.000
min1646.000-1614.000=32.000
max1646.000-1614.000=32.000
mean0.560-0.570=-0.010
σ0.597-0.597=0.000
min0.260-0.264=-0.004
max1.456-1.465=-0.010
policies=20
mean1575.574-1575.553=0.021
σ0.360-0.357=0.003
min1575.330-1575.310=0.020
max1576.109-1576.083=0.025
mean920.000
σ0.000
min920.000
max920.000
mean1646.000-1614.000=32.000
σ0.000
min1646.000-1614.000=32.000
max1646.000-1614.000=32.000
mean2.643-2.631=0.012
σ0.009-0.013=-0.003
min2.632-2.615=0.016
max2.654-2.644=0.010
policies=200
mean15763.651-15763.688=-0.037
σ0.110-0.046=0.064
min15763.519-15763.625=-0.106
max15763.781-15763.734=0.047
mean9200.000
σ0.000
min9200.000
max9200.000
mean1646.000-1614.000=32.000
σ0.000
min1646.000-1614.000=32.000
max1646.000-1614.000=32.000
mean26.676-26.545=0.131
σ0.107-0.094=0.013
min26.595-26.472=0.123
max26.833-26.670=0.163