Compare commits

Home / Compare 83f162b1 .. 6d2bc7d4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.056=0.001
σ0.368-0.367=0.001
min53.917-53.916=0.001
max55.105-55.100=0.005
mean417.000-412.000=5.000
σ0.000
min417.000-412.000=5.000
max417.000-412.000=5.000
mean0.142-0.143=-0.001
σ0.004-0.004=0.000
min0.139-0.139=-0.001
max0.149-0.148=0.001
cache=y
dps=1
iters=10
policies=100
mean43.394-43.395=-0.001
σ0.005-0.006=-0.001
min43.387-43.385=0.002
max43.406-43.407=-0.001
mean417.000-412.000=5.000
σ0.000
min417.000-412.000=5.000
max417.000-412.000=5.000
mean0.119-0.124=-0.004
σ0.003-0.004=-0.000
min0.114-0.120=-0.006
max0.125-0.130=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.000-1007.002=-0.002
σ1.188-1.254=-0.066
min1006.440-1006.470=-0.029
max1011.982-1012.273=-0.291
mean1047.250-1047.400=-0.150
σ314.968-319.731=-4.762
min589.000-585.000=4.000
max1650.000-1615.000=35.000
mean1.537-1.561=-0.024
σ0.075-0.128=-0.053
min1.469-1.466=0.003
max1.774-2.036=-0.262

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1650.000-1615.000=35.000
σ0.000
min1650.000-1615.000=35.000
max1650.000-1615.000=35.000
mean0.418-0.413=0.005
σ0.127-0.118=0.009
min0.349-0.343=0.005
max0.643-0.622=0.021
name=error_case.art
mean2.339-2.339=0.001
σ0.002-0.003=-0.000
min2.337
max2.342
mean1650.000-1615.000=35.000
σ0.000
min1650.000-1615.000=35.000
max1650.000-1615.000=35.000
mean0.879-0.920=-0.040
σ0.095-0.187=-0.091
min0.821-0.818=0.004
max1.047-1.251=-0.205
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1650.000-1615.000=35.000
σ0.000
min1650.000-1615.000=35.000
max1650.000-1615.000=35.000
mean0.528-0.534=-0.006
σ0.052-0.054=-0.002
min0.485-0.491=-0.006
max0.613-0.628=-0.015
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1650.000-1615.000=35.000
σ0.000
min1650.000-1615.000=35.000
max1650.000-1615.000=35.000
mean0.838-0.835=0.004
σ0.039-0.043=-0.004
min0.811-0.800=0.011
max0.907-0.906=0.001

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=0.000
σ0.035-0.033=0.001
min964.810-964.810=-0.000
max964.896-964.894=0.003
mean1650.000-1615.000=35.000
σ0.000
min1650.000-1615.000=35.000
max1650.000-1615.000=35.000
mean0.850-0.816=0.034
σ0.022-0.036=-0.014
min0.811-0.777=0.035
max0.865-0.858=0.007
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.007-0.007=-0.001
min885.505-885.504=0.001
max885.522-885.522=-0.001
mean1650.000-1615.000=35.000
σ0.000
min1650.000-1615.000=35.000
max1650.000-1615.000=35.000
mean0.727-0.735=-0.007
σ0.034-0.015=0.019
min0.669-0.709=-0.039
max0.756-0.747=0.009

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1650.000-1615.000=35.000
σ0.000
min1650.000-1615.000=35.000
max1650.000-1615.000=35.000
mean3.718-2.763=0.955
σ0.362-0.071=0.292
min3.310-2.634=0.676
max4.524-3.030=1.494
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1650.000-1615.000=35.000
σ0.000
min1650.000-1615.000=35.000
max1650.000-1615.000=35.000
mean4.188-3.448=0.740
σ0.080-0.239=-0.159
min4.062-2.734=1.328
max4.489-4.413=0.076
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1650.000-1615.000=35.000
σ0.000
min1650.000-1615.000=35.000
max1650.000-1615.000=35.000
mean0.740-0.535=0.205
σ0.020-0.014=0.006
min0.703-0.509=0.194
max0.859-0.631=0.228
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1650.000-1615.000=35.000
σ0.000
min1650.000-1615.000=35.000
max1650.000-1615.000=35.000
mean0.703-0.504=0.199
σ0.016-0.013=0.003
min0.673-0.480=0.193
max0.775-0.566=0.209

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.142-297.013=0.129
σ0.200-0.214=-0.014
min297.003-296.858=0.145
max297.684-297.604=0.080
mean1916.000-1896.000=20.000
σ0.000
min1916.000-1896.000=20.000
max1916.000-1896.000=20.000
mean0.577-0.591=-0.014
σ0.040-0.036=0.004
min0.510-0.519=-0.008
max0.644-0.659=-0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.817-286.822=-0.005
σ0.037-0.040=-0.003
min286.766-286.772=-0.006
max286.854-286.863=-0.009
mean1650.000-1615.000=35.000
σ0.000
min1650.000-1615.000=35.000
max1650.000-1615.000=35.000
mean0.397-0.401=-0.003
σ0.005-0.014=-0.009
min0.392-0.389=0.004
max0.403-0.423=-0.020
iters=5
new-facts=1
prior-facts=6402
mean1297.250-1297.225=0.025
σ0.069-0.078=-0.009
min1297.172-1297.125=0.048
max1297.336-1297.303=0.032
mean1650.000-1615.000=35.000
σ0.000
min1650.000-1615.000=35.000
max1650.000-1615.000=35.000
mean2.114-2.040=0.073
σ0.070-0.035=0.035
min2.029-1.992=0.037
max2.188-2.072=0.116
iters=5
new-facts=6402
prior-facts=1
mean1541.323-1541.305=0.018
σ6.841-6.845=-0.004
min1538.098-1538.055=0.042
max1553.557-1553.546=0.011
mean1650.000-1615.000=35.000
σ0.000
min1650.000-1615.000=35.000
max1650.000-1615.000=35.000
mean2.247-2.185=0.062
σ0.150-0.108=0.042
min2.082-2.090=-0.007
max2.429-2.358=0.071
iters=5
new-facts=6402
prior-facts=6402
mean1859.111-1859.113=-0.003
σ0.080-0.081=-0.001
min1858.998-1858.998=-0.000
max1859.193-1859.200=-0.006
mean1776.200-1761.600=14.600
σ133.866-131.728=2.138
min1650.000-1615.000=35.000
max1916.000-1896.000=20.000
mean3.123-3.087=0.036
σ0.196-0.189=0.007
min2.899-2.850=0.049
max3.418-3.317=0.101

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.195-1.188=0.006
σ0.267-0.258=0.009
min0.938-0.936=0.001
max1.583-1.611=-0.028

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.819=0.001
σ581.372-581.372=-0.000
min158.132-158.131=0.001
max1320.878-1320.878=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1650.000-1615.000=35.000
σ0.000
min1650.000-1615.000=35.000
max1650.000-1615.000=35.000
mean0.554-0.568=-0.013
σ0.579-0.609=-0.029
min0.261-0.263=-0.002
max1.423-1.480=-0.057
policies=20
mean1581.610-1581.612=-0.002
σ0.360-0.366=-0.006
min1581.368-1581.359=0.009
max1582.146-1582.156=-0.009
mean920.000
σ0.000
min920.000
max920.000
mean1650.000-1615.000=35.000
σ0.000
min1650.000-1615.000=35.000
max1650.000-1615.000=35.000
mean2.635-2.642=-0.007
σ0.019-0.023=-0.003
min2.610-2.617=-0.007
max2.657-2.664=-0.007
policies=200
mean15824.241-15824.169=0.072
σ0.115-0.146=-0.030
min15824.135-15824.022=0.113
max15824.402-15824.354=0.048
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000-1615.000=35.000
σ0.000
min1650.000-1615.000=35.000
max1650.000-1615.000=35.000
mean26.613-26.637=-0.024
σ0.031-0.070=-0.039
min26.576-26.538=0.038
max26.650-26.701=-0.051