Compare commits

Home / Compare 40856843 .. 219b8d30

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.963-54.015=-0.052
σ0.369-0.370=-0.001
min53.819-53.871=-0.052
max55.012-55.066=-0.054
mean415.700-414.000=1.700
σ0.483-0.000=0.483
min415.000-414.000=1.000
max416.000-414.000=2.000
mean0.139-0.139=-0.000
σ0.003-0.003=-0.000
min0.135-0.136=-0.001
max0.145-0.145=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=0.000
σ0.007-0.008=-0.001
min43.310-43.308=0.003
max43.335-43.334=0.001
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.120-0.118=0.002
σ0.004-0.004=0.000
min0.114-0.113=0.001
max0.125-0.125=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.519-1006.306=0.213
σ1.151-1.167=-0.017
min1005.950-1005.743=0.207
max1011.330-1011.194=0.136
mean1051.000-1041.250=9.750
σ315.136-312.933=2.203
min580.000-593.000=-13.000
max1650.000-1634.000=16.000
mean1.557-1.550=0.007
σ0.102-0.064=0.038
min1.448-1.481=-0.033
max1.815-1.699=0.117

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.866=0.017
σ0.002-0.003=-0.000
min0.882-0.864=0.018
max0.887-0.869=0.017
mean1650.000-1634.000=16.000
σ0.000
min1650.000-1634.000=16.000
max1650.000-1634.000=16.000
mean0.444-0.411=0.033
σ0.183-0.134=0.048
min0.346-0.333=0.013
max0.768-0.650=0.119
name=error_case.art
mean2.339-2.337=0.001
σ0.003
min2.337-2.336=0.001
max2.342-2.341=0.001
mean1650.000-1634.000=16.000
σ0.000
min1650.000-1634.000=16.000
max1650.000-1634.000=16.000
mean0.928-0.861=0.067
σ0.189-0.096=0.094
min0.813-0.782=0.031
max1.263-1.025=0.238
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002
min1.522-1.522=0.001
max1.526-1.526=0.001
mean1650.000-1634.000=16.000
σ0.000
min1650.000-1634.000=16.000
max1650.000-1634.000=16.000
mean0.542-0.536=0.006
σ0.072-0.052=0.020
min0.486-0.496=-0.010
max0.662-0.625=0.037
name=nested_use.art
mean2.361-2.360=0.001
σ0.002-0.002=-0.000
min2.360-2.359=0.001
max2.364-2.363=0.001
mean1650.000-1634.000=16.000
σ0.000
min1650.000-1634.000=16.000
max1650.000-1634.000=16.000
mean0.837-0.870=-0.033
σ0.029-0.060=-0.032
min0.810-0.817=-0.008
max0.882-0.962=-0.080

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.837-964.115=0.722
σ0.019-0.033=-0.015
min964.821-964.086=0.736
max964.870-964.169=0.701
mean1650.000-1634.000=16.000
σ0.000
min1650.000-1634.000=16.000
max1650.000-1634.000=16.000
mean0.794-0.804=-0.010
σ0.057-0.029=0.028
min0.722-0.769=-0.047
max0.864-0.848=0.015
name=cdr_enhanced_4k_loc.art
mean885.514-884.711=0.803
σ0.001-0.007=-0.006
min885.512-884.705=0.807
max885.515-884.721=0.793
mean1650.000-1634.000=16.000
σ0.000
min1650.000-1634.000=16.000
max1650.000-1634.000=16.000
mean0.670-0.722=-0.051
σ0.068-0.031=0.037
min0.567-0.667=-0.100
max0.733-0.744=-0.011

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.715=0.002
σ0.002-0.002=-0.000
min7.715-7.714=0.002
max7.719-7.720=-0.001
mean1650.000-1634.000=16.000
σ0.000
min1650.000-1634.000=16.000
max1650.000-1634.000=16.000
mean3.492-4.205=-0.713
σ0.086-0.086=0.000
min3.340-4.044=-0.705
max3.949-4.542=-0.594
name=record_render_large_syntax_err.art
mean7.665-7.663=0.002
σ0.002-0.002=0.000
min7.664-7.662=0.002
max7.669-7.666=0.003
mean1650.000-1634.000=16.000
σ0.000
min1650.000-1634.000=16.000
max1650.000-1634.000=16.000
mean3.497-4.006=-0.509
σ0.078-0.306=-0.228
min3.333-3.399=-0.065
max3.776-4.566=-0.790
name=record_render_success.art
mean2.291-2.289=0.001
σ0.002
min2.290-2.289=0.001
max2.294-2.292=0.001
mean1650.000-1634.000=16.000
σ0.000
min1650.000-1634.000=16.000
max1650.000-1634.000=16.000
mean0.742-0.728=0.014
σ0.019-0.024=-0.005
min0.709-0.674=0.035
max0.834-0.833=0.001
name=record_render_syntax_err.art
mean2.166-2.165=0.001
σ0.002
min2.165-2.164=0.001
max2.169-2.168=0.001
mean1650.000-1634.000=16.000
σ0.000
min1650.000-1634.000=16.000
max1650.000-1634.000=16.000
mean0.703-0.692=0.011
σ0.016-0.020=-0.004
min0.664-0.662=0.002
max0.770-0.846=-0.076

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.366-296.179=0.188
σ0.240-0.274=-0.035
min296.190-296.035=0.155
max297.024-296.937=0.087
mean1899.000-1900.000=-1.000
σ0.000
min1899.000-1900.000=-1.000
max1899.000-1900.000=-1.000
mean0.587-0.581=0.006
σ0.047-0.040=0.008
min0.516-0.548=-0.032
max0.700-0.686=0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.024-284.694=0.330
σ0.035-0.034=0.001
min284.979-284.649=0.330
max285.067-284.730=0.336
mean1650.000-1634.000=16.000
σ0.000
min1650.000-1634.000=16.000
max1650.000-1634.000=16.000
mean0.391-0.395=-0.003
σ0.008-0.010=-0.003
min0.386-0.382=0.003
max0.403-0.403=0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.387-1295.088=0.299
σ0.111-0.128=-0.017
min1295.289-1294.954=0.335
max1295.572-1295.262=0.310
mean1650.000-1634.000=16.000
σ0.000
min1650.000-1634.000=16.000
max1650.000-1634.000=16.000
mean2.006-1.871=0.135
σ0.194-0.067=0.127
min1.761-1.790=-0.029
max2.170-1.936=0.234
iters=5
new-facts=6402
prior-facts=1
mean1539.605-1539.182=0.422
σ6.790-6.834=-0.044
min1536.464-1535.930=0.533
max1551.749-1551.405=0.344
mean1650.000-1634.000=16.000
σ0.000
min1650.000-1634.000=16.000
max1650.000-1634.000=16.000
mean2.394-2.239=0.155
σ0.233-0.251=-0.018
min2.169-2.045=0.124
max2.750-2.645=0.104
iters=5
new-facts=6402
prior-facts=6402
mean1857.324-1856.977=0.347
σ0.056-0.060=-0.004
min1857.275-1856.903=0.372
max1857.411-1857.062=0.348
mean1770.800-1767.800=3.000
σ122.494-129.947=-7.453
min1650.000-1634.000=16.000
max1899.000-1900.000=-1.000
mean2.990-3.008=-0.018
σ0.236-0.287=-0.050
min2.691-2.762=-0.070
max3.354-3.491=-0.137

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.164-1.190=-0.027
σ0.322-0.289=0.033
min0.928-0.926=0.002
max1.686-1.668=0.018

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.190-447.786=0.405
σ581.332-581.213=0.119
min157.521-157.176=0.345
max1320.188-1319.605=0.583
mean96.250
σ8.500
min92.000
max109.000
mean1650.000-1634.000=16.000
σ0.000
min1650.000-1634.000=16.000
max1650.000-1634.000=16.000
mean0.553-0.528=0.024
σ0.571-0.541=0.030
min0.266-0.257=0.009
max1.409-1.339=0.069
policies=20
mean1575.573-1572.103=3.470
σ0.357-0.361=-0.004
min1575.333-1571.866=3.467
max1576.103-1572.641=3.463
mean920.000
σ0.000
min920.000
max920.000
mean1650.000-1634.000=16.000
σ0.000
min1650.000-1634.000=16.000
max1650.000-1634.000=16.000
mean2.630-2.638=-0.008
σ0.016-0.011=0.006
min2.615-2.623=-0.008
max2.647-2.647=0.000
policies=200
mean15763.767-15729.087=34.679
σ0.138-0.066=0.072
min15763.669-15729.037=34.632
max15763.969-15729.184=34.785
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000-1634.000=16.000
σ0.000
min1650.000-1634.000=16.000
max1650.000-1634.000=16.000
mean26.534-26.480=0.054
σ0.135-0.199=-0.064
min26.456-26.269=0.187
max26.736-26.749=-0.013