Compare commits

Home / Compare b951a1d7 .. 87adeb72

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.054=0.002
σ0.369-0.369=0.000
min53.906-53.912=-0.006
max55.106-55.103=0.003
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.136-0.138=-0.002
σ0.004-0.005=-0.001
min0.131-0.129=0.002
max0.143-0.146=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.395-43.393=0.002
σ0.006-0.006=-0.001
min43.386-43.387=-0.001
max43.404-43.407=-0.002
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.120-0.121=-0.001
σ0.005-0.004=0.001
min0.114-0.115=-0.001
max0.128-0.125=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.922-1007.001=-0.079
σ0.885-1.213=-0.328
min1006.454-1006.447=0.007
max1010.590-1012.093=-1.503
mean1036.900-1049.700=-12.800
σ301.076-307.867=-6.791
min547.000-574.000=-27.000
max1584.000-1641.000=-57.000
mean1.524-1.552=-0.028
σ0.074-0.080=-0.006
min1.459-1.404=0.055
max1.747-1.781=-0.034

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1584.000-1641.000=-57.000
σ0.000
min1584.000-1641.000=-57.000
max1584.000-1641.000=-57.000
mean0.416-0.415=0.000
σ0.132-0.142=-0.010
min0.331-0.332=-0.001
max0.649-0.666=-0.016
name=error_case.art
mean2.339-2.339=0.000
σ0.002-0.003=-0.000
min2.337
max2.342
mean1584.000-1641.000=-57.000
σ0.000
min1584.000-1641.000=-57.000
max1584.000-1641.000=-57.000
mean0.875-0.881=-0.006
σ0.089-0.095=-0.006
min0.806-0.806=-0.001
max1.031-1.045=-0.014
name=heavy_item.art
mean1.524-1.524=0.000
σ0.002-0.002=0.001
min1.522
max1.527-1.526=0.001
mean1584.000-1641.000=-57.000
σ0.000
min1584.000-1641.000=-57.000
max1584.000-1641.000=-57.000
mean0.565-0.532=0.033
σ0.048-0.051=-0.003
min0.504-0.480=0.024
max0.637-0.611=0.026
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=-0.000
min2.360
max2.364
mean1584.000-1641.000=-57.000
σ0.000
min1584.000-1641.000=-57.000
max1584.000-1641.000=-57.000
mean0.872-0.855=0.017
σ0.052-0.042=0.010
min0.815-0.813=0.001
max0.939-0.921=0.018

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.833-964.835=-0.003
σ0.029-0.030=-0.001
min964.802-964.809=-0.008
max964.872-964.885=-0.013
mean1584.000-1641.000=-57.000
σ0.000
min1584.000-1641.000=-57.000
max1584.000-1641.000=-57.000
mean0.840-0.826=0.014
σ0.018-0.036=-0.019
min0.813-0.787=0.026
max0.854-0.869=-0.016
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.007-0.005=0.002
min885.504-885.505=-0.001
max885.521-885.517=0.004
mean1584.000-1641.000=-57.000
σ0.000
min1584.000-1641.000=-57.000
max1584.000-1641.000=-57.000
mean0.731-0.740=-0.010
σ0.017-0.011=0.006
min0.704-0.732=-0.028
max0.748-0.760=-0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.002
mean1584.000-1641.000=-57.000
σ0.000
min1584.000-1641.000=-57.000
max1584.000-1641.000=-57.000
mean4.217-4.210=0.007
σ0.090-0.081=0.009
min4.075-4.083=-0.008
max4.599-4.603=-0.005
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1584.000-1641.000=-57.000
σ0.000
min1584.000-1641.000=-57.000
max1584.000-1641.000=-57.000
mean4.245-4.212=0.033
σ0.084-0.081=0.003
min4.103-4.073=0.030
max4.568-4.499=0.069
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1584.000-1641.000=-57.000
σ0.000
min1584.000-1641.000=-57.000
max1584.000-1641.000=-57.000
mean0.754-0.678=0.075
σ0.018-0.088=-0.071
min0.728-0.510=0.217
max0.873-0.844=0.029
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1584.000-1641.000=-57.000
σ0.000
min1584.000-1641.000=-57.000
max1584.000-1641.000=-57.000
mean0.712-0.498=0.214
σ0.016-0.042=-0.026
min0.673-0.283=0.389
max0.792-0.652=0.140

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.581-296.933=-1.353
σ0.201-0.232=-0.031
min295.426-296.722=-1.295
max296.092-297.552=-1.460
mean1896.000-1938.000=-42.000
σ0.000
min1896.000-1938.000=-42.000
max1896.000-1938.000=-42.000
mean0.583-0.570=0.013
σ0.057-0.052=0.004
min0.498-0.505=-0.008
max0.708-0.683=0.025

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.357-286.824=-1.467
σ0.037-0.037=-0.000
min285.311-286.774=-1.463
max285.397-286.861=-1.465
mean1584.000-1641.000=-57.000
σ0.000
min1584.000-1641.000=-57.000
max1584.000-1641.000=-57.000
mean0.395-0.394=0.001
σ0.008-0.005=0.003
min0.383-0.388=-0.006
max0.404-0.401=0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.715-1297.265=-1.550
σ0.114-0.092=0.022
min1295.620-1297.131=-1.510
max1295.906-1297.373=-1.466
mean1584.000-1641.000=-57.000
σ0.000
min1584.000-1641.000=-57.000
max1584.000-1641.000=-57.000
mean1.990-2.282=-0.292
σ0.181-0.139=0.042
min1.805-2.133=-0.328
max2.184-2.485=-0.300
iters=5
new-facts=6402
prior-facts=1
mean1539.949-1541.389=-1.440
σ6.834-6.841=-0.007
min1536.765-1538.210=-1.445
max1552.173-1553.626=-1.453
mean1584.000-1641.000=-57.000
σ0.000
min1584.000-1641.000=-57.000
max1584.000-1641.000=-57.000
mean2.363-2.308=0.055
σ0.256-0.234=0.022
min2.114-2.147=-0.033
max2.744-2.704=0.040
iters=5
new-facts=6402
prior-facts=6402
mean1857.656-1859.117=-1.461
σ0.057-0.064=-0.007
min1857.598-1859.040=-1.442
max1857.735-1859.200=-1.465
mean1761.000-1786.800=-25.800
σ140.282-147.955=-7.673
min1584.000-1641.000=-57.000
max1896.000-1938.000=-42.000
mean3.034-3.059=-0.025
σ0.261-0.184=0.077
min2.788-2.887=-0.099
max3.461-3.355=0.105

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.357-1.304=0.053
σ0.392-0.358=0.033
min0.941-0.936=0.005
max1.852-1.828=0.024

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.635-448.968=-3.333
σ580.934-581.664=-0.730
min155.166-158.134=-2.968
max1317.035-1321.463=-4.428
mean96.250
σ8.500
min92.000
max109.000
mean1584.000-1641.000=-57.000
σ0.000
min1584.000-1641.000=-57.000
max1584.000-1641.000=-57.000
mean0.526-0.551=-0.025
σ0.535-0.580=-0.045
min0.257-0.257=0.000
max1.328-1.421=-0.093
policies=20
mean1551.939-1581.630=-29.691
σ0.337-0.363=-0.026
min1551.707-1581.386=-29.678
max1552.439-1582.170=-29.731
mean920.000
σ0.000
min920.000
max920.000
mean1584.000-1641.000=-57.000
σ0.000
min1584.000-1641.000=-57.000
max1584.000-1641.000=-57.000
mean2.597-2.642=-0.045
σ0.034-0.012=0.022
min2.573-2.627=-0.053
max2.648-2.656=-0.008
policies=200
mean15527.602-15824.169=-296.568
σ0.094-0.115=-0.022
min15527.488-15824.081=-296.593
max15527.697-15824.327=-296.630
mean9200.000
σ0.000
min9200.000
max9200.000
mean1584.000-1641.000=-57.000
σ0.000
min1584.000-1641.000=-57.000
max1584.000-1641.000=-57.000
mean26.098-26.753=-0.654
σ0.140-0.095=0.045
min25.985-26.670=-0.685
max26.277-26.880=-0.603