Compare commits

Home / Compare 5eca3fac .. 46bebcfa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-53.965=0.090
σ0.367-0.369=-0.001
min53.915-53.820=0.095
max55.100-55.014=0.086
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.142-0.139=0.002
σ0.004-0.004=0.000
min0.137-0.136=0.001
max0.148-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean43.393-43.322=0.071
σ0.006-0.007=-0.001
min43.387-43.311=0.076
max43.406-43.331=0.075
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.119-0.119=-0.000
σ0.003-0.005=-0.002
min0.116-0.115=0.001
max0.126-0.129=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1006.521=0.485
σ1.189-1.151=0.038
min1006.431-1005.950=0.481
max1011.991-1011.331=0.660
mean1055.500-1051.500=4.000
σ307.822-305.299=2.523
min580.000-594.000=-14.000
max1649.000-1645.000=4.000
mean1.517-1.508=0.009
σ0.099-0.052=0.047
min1.354-1.448=-0.094
max1.820-1.618=0.203

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.000
σ0.002-0.003=-0.000
min0.882
max0.887
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.417-0.415=0.002
σ0.143-0.139=0.004
min0.329-0.333=-0.004
max0.670-0.661=0.009
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.884-0.881=0.003
σ0.094-0.092=0.003
min0.836-0.817=0.020
max1.052-1.038=0.014
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.536-0.532=0.004
σ0.051-0.044=0.007
min0.492-0.486=0.006
max0.622-0.600=0.022
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.846-0.858=-0.012
σ0.048-0.039=0.009
min0.810-0.829=-0.019
max0.928-0.926=0.002

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=-0.001
σ0.034-0.034=-0.000
min964.810-964.810=0.000
max964.895-964.896=-0.001
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.802-0.807=-0.005
σ0.046-0.032=0.013
min0.751-0.768=-0.017
max0.857-0.851=0.006
name=cdr_enhanced_4k_loc.art
mean885.512-885.513=-0.001
σ0.007-0.008=-0.001
min885.505-885.506=-0.000
max885.523-885.524=-0.001
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.723-0.636=0.087
σ0.028-0.131=-0.103
min0.683-0.409=0.273
max0.748-0.723=0.025

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.719
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean4.249-2.644=1.605
σ0.085-0.097=-0.012
min4.096-2.487=1.609
max4.573-2.993=1.581
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean4.229-2.641=1.588
σ0.067-0.106=-0.039
min4.116-2.479=1.637
max4.484-2.965=1.518
name=record_render_success.art
mean2.291-2.291=-0.000
σ0.002-0.002=0.000
min2.290
max2.294
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.754-0.303=0.450
σ0.018-0.008=0.009
min0.723-0.292=0.431
max0.878-0.354=0.524
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.710-0.285=0.425
σ0.017-0.008=0.010
min0.681-0.273=0.408
max0.819-0.319=0.500

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.033-296.324=0.709
σ0.147-0.201=-0.054
min296.852-296.141=0.712
max297.400-296.864=0.536
mean1902.000-2027.000=-125.000
σ0.000
min1902.000-2027.000=-125.000
max1902.000-2027.000=-125.000
mean0.583-0.540=0.043
σ0.024-0.029=-0.005
min0.533-0.506=0.028
max0.616-0.591=0.025

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.823-285.032=1.791
σ0.039-0.039=0.000
min286.773-284.977=1.796
max286.863-285.073=1.790
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.392-0.397=-0.005
σ0.006-0.006=0.000
min0.387-0.389=-0.001
max0.403-0.405=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1297.236-1295.412=1.824
σ0.080-0.108=-0.028
min1297.137-1295.287=1.850
max1297.327-1295.532=1.795
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean2.084-1.907=0.177
σ0.073-0.110=-0.037
min2.000-1.818=0.182
max2.161-2.078=0.083
iters=5
new-facts=6402
prior-facts=1
mean1541.373-1539.523=1.850
σ6.811-6.853=-0.041
min1538.136-1536.230=1.907
max1553.553-1551.775=1.779
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean2.338-2.258=0.080
σ0.151-0.239=-0.087
min2.093-2.040=0.053
max2.455-2.567=-0.112
iters=5
new-facts=6402
prior-facts=6402
mean1859.109-1857.321=1.788
σ0.083-0.049=0.034
min1858.987-1857.268=1.719
max1859.193-1857.392=1.802
mean1785.400-1777.200=8.200
σ121.648-168.435=-46.786
min1649.000-1645.000=4.000
max1902.000-2027.000=-125.000
mean3.085-2.872=0.212
σ0.233-0.038=0.195
min2.899-2.830=0.069
max3.425-2.932=0.493

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.198-1.221=-0.023
σ0.342-0.339=0.004
min0.920-0.934=-0.014
max1.727-1.788=-0.061

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.192=0.629
σ581.372-581.334=0.039
min158.134-157.521=0.613
max1320.880-1320.193=0.687
mean96.250
σ8.500
min92.000
max109.000
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.554-0.539=0.016
σ0.576-0.542=0.034
min0.262-0.264=-0.002
max1.419-1.352=0.067
policies=20
mean1581.628-1575.575=6.053
σ0.351-0.360=-0.009
min1581.392-1575.332=6.059
max1582.150-1576.110=6.039
mean920.000
σ0.000
min920.000
max920.000
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean2.624-2.633=-0.009
σ0.010-0.005=0.005
min2.613-2.629=-0.016
max2.637-2.640=-0.003
policies=200
mean15824.232-15763.713=60.519
σ0.071-0.030=0.042
min15824.147-15763.686=60.461
max15824.305-15763.755=60.550
mean9200.000
σ0.000
min9200.000
max9200.000
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean26.617-26.558=0.059
σ0.050-0.122=-0.072
min26.564-26.465=0.100
max26.684-26.735=-0.051