Compare commits

Home / Compare 15fc6290 .. 3dd87149

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-53.965=0.090
σ0.370-0.369=0.002
min53.909-53.819=0.091
max55.108-55.014=0.095
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.140-0.137=0.003
σ0.004-0.004=0.000
min0.135-0.131=0.004
max0.146-0.142=0.004
cache=y
dps=1
iters=10
policies=100
mean43.398-43.322=0.077
σ0.004-0.008=-0.004
min43.392-43.309=0.083
max43.406-43.332=0.074
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.139-0.121=0.017
σ0.009-0.004=0.005
min0.120-0.116=0.004
max0.150-0.128=0.022

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.007-1006.515=0.493
σ1.204-1.174=0.030
min1006.451-1005.978=0.473
max1012.051-1011.434=0.617
mean1044.900-1053.950=-9.050
σ311.038-321.218=-10.180
min572.000-596.000=-24.000
max1640.000-1634.000=6.000
mean1.569-1.564=0.006
σ0.108-0.123=-0.015
min1.412-1.458=-0.046
max1.836-2.030=-0.193

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.000
σ0.003-0.002=0.000
min0.882
max0.887
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.412-0.421=-0.009
σ0.134-0.140=-0.005
min0.336-0.341=-0.005
max0.650-0.668=-0.019
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.004=-0.001
min2.337
max2.342-2.345=-0.003
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.889-0.895=-0.006
σ0.089-0.094=-0.005
min0.822-0.828=-0.006
max1.044-1.056=-0.012
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.539-0.537=0.002
σ0.049-0.065=-0.016
min0.499-0.485=0.014
max0.623-0.640=-0.018
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.857-0.852=0.005
σ0.038-0.036=0.002
min0.818-0.823=-0.005
max0.919-0.913=0.006

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.838=0.000
σ0.033-0.021=0.013
min964.812-964.819=-0.007
max964.893-964.870=0.023
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.846-0.822=0.024
σ0.026-0.037=-0.010
min0.800-0.772=0.027
max0.864-0.857=0.007
name=cdr_enhanced_4k_loc.art
mean885.512-885.511=0.000
σ0.007-0.004=0.003
min885.504-885.505=-0.001
max885.521-885.515=0.006
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.715-0.689=0.026
σ0.035-0.076=-0.042
min0.676-0.565=0.111
max0.745-0.741=0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.001
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean4.189-3.483=0.706
σ0.087-0.083=0.004
min4.062-3.314=0.748
max4.518-3.851=0.667
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean4.197-3.479=0.717
σ0.085-0.073=0.012
min4.033-3.343=0.690
max4.524-3.684=0.840
name=record_render_success.art
mean2.291-2.291=-0.000
σ0.002-0.002=-0.000
min2.290
max2.294-2.295=-0.002
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.730-0.746=-0.017
σ0.022-0.022=0.000
min0.688-0.711=-0.023
max0.832-0.844=-0.012
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.697-0.702=-0.005
σ0.022-0.016=0.006
min0.661-0.666=-0.005
max0.798-0.776=0.022

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.837-296.502=0.335
σ0.219-0.151=0.067
min296.695-296.356=0.339
max297.417-296.881=0.536
mean1911.000-1891.000=20.000
σ0.000
min1911.000-1891.000=20.000
max1911.000-1891.000=20.000
mean0.593-0.587=0.006
σ0.043-0.037=0.007
min0.514-0.512=0.002
max0.691-0.649=0.042

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.816-285.025=1.791
σ0.036-0.042=-0.006
min286.770-284.984=1.786
max286.856-285.070=1.786
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.394-0.406=-0.012
σ0.007-0.016=-0.009
min0.387-0.386=0.001
max0.403-0.424=-0.020
iters=5
new-facts=1
prior-facts=6402
mean1297.151-1295.418=1.733
σ0.065-0.111=-0.046
min1297.086-1295.300=1.786
max1297.239-1295.555=1.684
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean1.893-1.916=-0.023
σ0.096-0.104=-0.008
min1.822-1.795=0.028
max2.056-2.009=0.046
iters=5
new-facts=6402
prior-facts=1
mean1540.166-1538.335=1.831
σ3.960-4.008=-0.048
min1538.271-1536.376=1.895
max1547.247-1545.498=1.749
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean2.470-2.396=0.073
σ0.229-0.285=-0.056
min2.157-2.132=0.025
max2.717-2.815=-0.098
iters=5
new-facts=6402
prior-facts=6402
mean1859.124-1857.329=1.794
σ0.051-0.064=-0.013
min1859.069-1857.264=1.804
max1859.194-1857.416=1.777
mean1775.400-1773.800=1.600
σ133.392-122.019=11.372
min1640.000-1634.000=6.000
max1911.000-1891.000=20.000
mean3.111-2.902=0.210
σ0.376-0.099=0.277
min2.863-2.775=0.088
max3.774-3.040=0.735

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.231-1.151=0.079
σ0.353-0.210=0.143
min0.915-0.943=-0.028
max1.818-1.476=0.342

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.160-446.528=0.632
σ578.048-578.007=0.041
min158.135-157.523=0.611
max1314.231-1313.538=0.693
mean96.250
σ8.500
min92.000
max109.000
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.541-0.565=-0.023
σ0.555-0.598=-0.042
min0.262-0.261=0.002
max1.374-1.461=-0.087
policies=20
mean1581.637-1575.555=6.082
σ0.377-0.356=0.022
min1581.386-1575.314=6.072
max1582.199-1576.084=6.115
mean920.000
σ0.000
min920.000
max920.000
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean2.663-2.632=0.031
σ0.037-0.016=0.020
min2.636-2.615=0.020
max2.716-2.655=0.061
policies=200
mean15824.188-15763.718=60.470
σ0.029-0.091=-0.062
min15824.147-15763.598=60.549
max15824.212-15763.820=60.393
mean9200.000
σ0.000
min9200.000
max9200.000
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean26.692-26.668=0.024
σ0.075-0.101=-0.026
min26.594-26.579=0.016
max26.776-26.770=0.006