Compare commits

Home / Compare 56195a1c .. 151f98fd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-53.966=0.089
σ0.368-0.369=-0.001
min53.910-53.818=0.092
max55.101-55.014=0.087
mean419.000-413.000=6.000
σ0.000
min419.000-413.000=6.000
max419.000-413.000=6.000
mean0.141-0.138=0.003
σ0.004-0.005=-0.001
min0.135-0.131=0.004
max0.148-0.146=0.002
cache=y
dps=1
iters=10
policies=100
mean43.393-43.321=0.072
σ0.006-0.007=-0.002
min43.385-43.314=0.072
max43.402-43.338=0.064
mean419.000-413.000=6.000
σ0.000
min419.000-413.000=6.000
max419.000-413.000=6.000
mean0.122-0.121=0.001
σ0.004-0.004=-0.000
min0.116-0.114=0.002
max0.128-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1006.517=0.488
σ1.199-1.156=0.043
min1006.439-1005.948=0.492
max1012.035-1011.353=0.682
mean1055.300-1038.050=17.250
σ309.411-310.154=-0.743
min579.000-548.000=31.000
max1653.000-1505.000=148.000
mean1.534-1.513=0.020
σ0.081-0.058=0.023
min1.452-1.435=0.017
max1.771-1.628=0.143

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1653.000-1505.000=148.000
σ0.000
min1653.000-1505.000=148.000
max1653.000-1505.000=148.000
mean0.416-0.423=-0.008
σ0.125-0.145=-0.020
min0.342-0.343=-0.000
max0.636-0.681=-0.045
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1653.000-1505.000=148.000
σ0.000
min1653.000-1505.000=148.000
max1653.000-1505.000=148.000
mean0.877-0.889=-0.012
σ0.092-0.111=-0.019
min0.820-0.821=-0.001
max1.035-1.084=-0.049
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1653.000-1505.000=148.000
σ0.000
min1653.000-1505.000=148.000
max1653.000-1505.000=148.000
mean0.540-0.533=0.007
σ0.049-0.054=-0.005
min0.504-0.496=0.008
max0.620-0.621=-0.000
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1653.000-1505.000=148.000
σ0.000
min1653.000-1505.000=148.000
max1653.000-1505.000=148.000
mean0.836-0.848=-0.012
σ0.047-0.039=0.007
min0.796-0.819=-0.023
max0.910-0.916=-0.006

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.826=0.013
σ0.023-0.034=-0.011
min964.818-964.802=0.016
max964.876-964.886=-0.010
mean1653.000-1505.000=148.000
σ0.000
min1653.000-1505.000=148.000
max1653.000-1505.000=148.000
mean0.826-0.770=0.057
σ0.038-0.099=-0.061
min0.781-0.655=0.126
max0.873-0.862=0.011
name=cdr_enhanced_4k_loc.art
mean885.512-885.510=0.002
σ0.007-0.006=0.001
min885.504
max885.521-885.516=0.005
mean1653.000-1505.000=148.000
σ0.000
min1653.000-1505.000=148.000
max1653.000-1505.000=148.000
mean0.695-0.684=0.011
σ0.051-0.083=-0.032
min0.633-0.538=0.095
max0.742-0.736=0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1653.000-1505.000=148.000
σ0.000
min1653.000-1505.000=148.000
max1653.000-1505.000=148.000
mean3.552-4.228=-0.676
σ0.088-0.093=-0.005
min3.369-4.046=-0.678
max3.831-4.614=-0.783
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668
mean1653.000-1505.000=148.000
σ0.000
min1653.000-1505.000=148.000
max1653.000-1505.000=148.000
mean3.549-4.228=-0.679
σ0.070-0.081=-0.011
min3.421-4.119=-0.698
max3.812-4.517=-0.706
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1653.000-1505.000=148.000
σ0.000
min1653.000-1505.000=148.000
max1653.000-1505.000=148.000
mean0.539-0.741=-0.202
σ0.013-0.016=-0.003
min0.515-0.708=-0.193
max0.614-0.823=-0.209
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1653.000-1505.000=148.000
σ0.000
min1653.000-1505.000=148.000
max1653.000-1505.000=148.000
mean0.512-0.699=-0.187
σ0.011-0.015=-0.004
min0.485-0.669=-0.183
max0.559-0.781=-0.223

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.841-296.210=0.631
σ0.248-0.227=0.021
min296.661-296.047=0.614
max297.503-296.830=0.673
mean1902.000-1909.000=-7.000
σ0.000
min1902.000-1909.000=-7.000
max1902.000-1909.000=-7.000
mean0.601-0.579=0.022
σ0.032-0.044=-0.012
min0.568-0.514=0.054
max0.682-0.682=0.000

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.824-285.035=1.789
σ0.034-0.035=-0.001
min286.782-284.989=1.794
max286.867-285.069=1.798
mean1653.000-1505.000=148.000
σ0.000
min1653.000-1505.000=148.000
max1653.000-1505.000=148.000
mean0.401-0.395=0.006
σ0.013-0.008=0.005
min0.390-0.387=0.003
max0.419-0.405=0.013
iters=5
new-facts=1
prior-facts=6402
mean1297.226-1295.411=1.815
σ0.074-0.115=-0.041
min1297.143-1295.296=1.847
max1297.327-1295.579=1.748
mean1653.000-1505.000=148.000
σ0.000
min1653.000-1505.000=148.000
max1653.000-1505.000=148.000
mean2.079-1.895=0.184
σ0.065-0.078=-0.013
min2.014-1.805=0.209
max2.174-1.995=0.180
iters=5
new-facts=6402
prior-facts=1
mean1541.396-1539.522=1.874
σ6.823-6.853=-0.031
min1538.199-1536.233=1.967
max1553.598-1551.775=1.822
mean1653.000-1505.000=148.000
σ0.000
min1653.000-1505.000=148.000
max1653.000-1505.000=148.000
mean2.397-2.268=0.129
σ0.175-0.202=-0.027
min2.139-2.084=0.054
max2.542-2.493=0.049
iters=5
new-facts=6402
prior-facts=6402
mean1859.117-1857.315=1.801
σ0.063-0.064=-0.002
min1859.040-1857.236=1.804
max1859.193-1857.402=1.791
mean1773.000-1748.000=25.000
σ123.219-171.613=-48.394
min1653.000-1508.000=145.000
max1902.000-1909.000=-7.000
mean3.080-3.069=0.011
σ0.264-0.249=0.015
min2.789-2.870=-0.081
max3.420-3.492=-0.071

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.184-1.665=-0.481
σ0.352-0.260=0.092
min0.926-1.265=-0.339
max1.763-1.869=-0.106

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.191=0.628
σ581.372-581.331=0.040
min158.133-157.523=0.609
max1320.877-1320.188=0.689
mean96.250
σ8.500
min92.000
max109.000
mean1653.000-1505.000=148.000
σ0.000
min1653.000-1505.000=148.000
max1653.000-1505.000=148.000
mean0.537-0.549=-0.012
σ0.551-0.573=-0.022
min0.259-0.260=-0.001
max1.364-1.409=-0.045
policies=20
mean1581.609-1575.569=6.040
σ0.357-0.354=0.003
min1581.369-1575.331=6.039
max1582.140-1576.095=6.044
mean920.000
σ0.000
min920.000
max920.000
mean1653.000-1505.000=148.000
σ0.000
min1653.000-1505.000=148.000
max1653.000-1505.000=148.000
mean2.633-2.622=0.011
σ0.013-0.022=-0.008
min2.620-2.606=0.014
max2.650-2.653=-0.003
policies=200
mean15824.211-15763.756=60.456
σ0.147-0.098=0.049
min15824.075-15763.676=60.400
max15824.416-15763.897=60.519
mean9200.000
σ0.000
min9200.000
max9200.000
mean1653.000-1505.000=148.000
σ0.000
min1653.000-1505.000=148.000
max1653.000-1505.000=148.000
mean26.600-26.464=0.136
σ0.039-0.034=0.005
min26.557-26.418=0.139
max26.645-26.491=0.154