Compare commits

Home / Compare 92209326 .. a6133706

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-53.964=0.090
σ0.369-0.369=-0.000
min53.906-53.828=0.079
max55.103-55.014=0.089
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.138-0.138=0.000
σ0.004-0.005=-0.001
min0.131-0.131=-0.000
max0.143-0.146=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.393-43.322=0.071
σ0.005-0.007=-0.002
min43.386-43.314=0.073
max43.402-43.337=0.065
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.123-0.120=0.003
σ0.003-0.004=-0.001
min0.120-0.115=0.005
max0.129-0.125=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.004-1006.519=0.485
σ1.213-1.163=0.050
min1006.461-1005.947=0.514
max1012.090-1011.384=0.706
mean1052.500-1050.550=1.950
σ307.895-311.794=-3.900
min577.000
max1644.000-1646.000=-2.000
mean1.575-1.557=0.018
σ0.081-0.085=-0.004
min1.482-1.463=0.019
max1.797-1.777=0.021

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean0.410-0.420=-0.010
σ0.132-0.135=-0.003
min0.332-0.323=0.009
max0.646-0.649=-0.003
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean0.887-0.866=0.020
σ0.098-0.087=0.011
min0.822-0.808=0.013
max1.060-1.020=0.040
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean0.537-0.529=0.008
σ0.045-0.054=-0.009
min0.495-0.482=0.013
max0.609-0.621=-0.011
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean0.856-0.839=0.017
σ0.039-0.037=0.002
min0.819-0.811=0.008
max0.923-0.903=0.019

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.840=-0.001
σ0.033-0.034=-0.000
min964.811-964.811=0.001
max964.893-964.895=-0.002
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean0.833-0.829=0.004
σ0.029-0.039=-0.010
min0.789-0.767=0.022
max0.856-0.859=-0.003
name=cdr_enhanced_4k_loc.art
mean885.511-885.512=-0.001
σ0.007-0.007=0.001
min885.504-885.506=-0.001
max885.522-885.521=0.001
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean0.688-0.678=0.010
σ0.050-0.047=0.003
min0.626-0.614=0.012
max0.743-0.747=-0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.719
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean4.246-3.540=0.706
σ0.091-0.090=0.002
min4.119-3.422=0.697
max4.723-4.016=0.707
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.671=-0.003
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean4.246-3.538=0.708
σ0.097-0.074=0.022
min4.125-3.395=0.730
max4.519-3.886=0.633
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean0.745-0.736=0.009
σ0.021-0.016=0.005
min0.714-0.711=0.003
max0.875-0.823=0.052
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean0.697-0.702=-0.006
σ0.016-0.018=-0.002
min0.672-0.649=0.023
max0.796-0.762=0.034

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.880-296.366=0.514
σ0.233-0.150=0.083
min296.622-296.237=0.385
max297.467-296.762=0.705
mean2033.000-2021.000=12.000
σ0.000
min2033.000-2021.000=12.000
max2033.000-2021.000=12.000
mean0.561-0.537=0.024
σ0.042-0.032=0.010
min0.498-0.502=-0.003
max0.606-0.587=0.019

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.824-285.026=1.798
σ0.037-0.036=0.001
min286.773-284.979=1.794
max286.862-285.062=1.801
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean0.396-0.399=-0.003
σ0.008-0.009=-0.001
min0.389-0.385=0.005
max0.406-0.407=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1297.268-1295.418=1.850
σ0.081-0.102=-0.021
min1297.169-1295.299=1.870
max1297.377-1295.539=1.838
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean2.111-1.891=0.219
σ0.100-0.072=0.028
min1.999-1.819=0.179
max2.247-1.986=0.261
iters=5
new-facts=6402
prior-facts=1
mean1541.316-1539.521=1.796
σ6.865-6.853=0.013
min1538.047-1536.227=1.819
max1553.593-1551.774=1.818
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean2.227-2.336=-0.109
σ0.165-0.300=-0.135
min2.117-2.044=0.074
max2.515-2.700=-0.184
iters=5
new-facts=6402
prior-facts=6402
mean1859.108-1857.328=1.780
σ0.079-0.053=0.026
min1858.992-1857.267=1.725
max1859.184-1857.400=1.785
mean1781.600-1776.400=5.200
σ168.580-164.506=4.074
min1644.000-1646.000=-2.000
max2033.000-2021.000=12.000
mean2.996-2.865=0.131
σ0.310-0.093=0.218
min2.772-2.714=0.058
max3.520-2.942=0.578

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.164-1.216=-0.053
σ0.334-0.325=0.009
min0.937-0.932=0.005
max1.739-1.759=-0.020

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.190=0.632
σ581.372-581.331=0.040
min158.134-157.523=0.611
max1320.880-1320.187=0.692
mean96.250
σ8.500
min92.000
max109.000
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean0.548-0.558=-0.010
σ0.567-0.582=-0.015
min0.260-0.262=-0.002
max1.399-1.431=-0.033
policies=20
mean1581.630-1575.560=6.070
σ0.362-0.356=0.006
min1581.390-1575.318=6.072
max1582.168-1576.090=6.079
mean920.000
σ0.000
min920.000
max920.000
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean2.646-2.635=0.010
σ0.012-0.016=-0.004
min2.629-2.621=0.008
max2.657-2.653=0.004
policies=200
mean15824.206-15763.640=60.566
σ0.042-0.072=-0.030
min15824.153-15763.577=60.577
max15824.254-15763.739=60.515
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean26.713-26.642=0.071
σ0.036-0.223=-0.187
min26.680-26.504=0.176
max26.756-26.974=-0.219