Compare commits

Home / Compare 7e0f7a6d .. 7971c1b8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.704-53.705=-0.001
σ0.369-0.366=0.003
min53.561-53.558=0.004
max54.754-54.747=0.007
mean415.800-415.000=0.800
σ0.422-0.000=0.422
min415.000
max416.000-415.000=1.000
mean0.139-0.137=0.002
σ0.004-0.003=0.001
min0.135-0.132=0.003
max0.146-0.142=0.004
cache=y
dps=1
iters=10
policies=100
mean43.059-43.058=0.001
σ0.005-0.006=-0.001
min43.051-43.048=0.003
max43.067-43.066=0.001
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.121-0.121=0.000
σ0.004-0.004=0.000
min0.115-0.114=0.001
max0.129-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.103-1005.110=-0.007
σ0.891-0.879=0.012
min1004.628-1004.639=-0.011
max1008.801-1008.729=0.072
mean1049.050-1059.350=-10.300
σ298.538-327.371=-28.833
min574.000-552.000=22.000
max1475.000-1627.000=-152.000
mean1.603-1.636=-0.033
σ0.052-0.105=-0.053
min1.487-1.456=0.031
max1.706-1.889=-0.184

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.881
max0.886
mean1475.000-1627.000=-152.000
σ0.000
min1475.000-1627.000=-152.000
max1475.000-1627.000=-152.000
mean0.444-0.443=0.001
σ0.171-0.185=-0.014
min0.348-0.340=0.007
max0.747-0.773=-0.026
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1475.000-1627.000=-152.000
σ0.000
min1475.000-1627.000=-152.000
max1475.000-1627.000=-152.000
mean0.928-0.921=0.008
σ0.175-0.186=-0.011
min0.844-0.809=0.035
max1.241-1.251=-0.011
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1475.000-1627.000=-152.000
σ0.000
min1475.000-1627.000=-152.000
max1475.000-1627.000=-152.000
mean0.547-0.543=0.005
σ0.059-0.046=0.013
min0.496-0.500=-0.004
max0.648-0.615=0.033
name=nested_use.art
mean2.355
σ0.002
min2.355
max2.358
mean1475.000-1627.000=-152.000
σ0.000
min1475.000-1627.000=-152.000
max1475.000-1627.000=-152.000
mean0.842-0.841=0.001
σ0.037-0.028=0.009
min0.815-0.822=-0.007
max0.907-0.888=0.019

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.543-963.551=-0.008
σ0.024-0.023=0.002
min963.523-963.533=-0.010
max963.582-963.589=-0.007
mean1475.000-1627.000=-152.000
σ0.000
min1475.000-1627.000=-152.000
max1475.000-1627.000=-152.000
mean0.830-0.819=0.011
σ0.029-0.019=0.010
min0.793-0.799=-0.006
max0.861-0.849=0.011
name=cdr_enhanced_4k_loc.art
mean884.854-884.853=0.000
σ0.007-0.009=-0.002
min884.847
max884.861-884.867=-0.006
mean1475.000-1627.000=-152.000
σ0.000
min1475.000-1627.000=-152.000
max1475.000-1627.000=-152.000
mean0.715-0.708=0.007
σ0.062-0.061=0.001
min0.603-0.600=0.003
max0.749-0.743=0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=-0.000
min7.705
max7.709-7.713=-0.004
mean1475.000-1627.000=-152.000
σ0.000
min1475.000-1627.000=-152.000
max1475.000-1627.000=-152.000
mean4.288-4.211=0.077
σ0.091-0.080=0.011
min4.133-4.083=0.050
max4.595-4.514=0.082
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1475.000-1627.000=-152.000
σ0.000
min1475.000-1627.000=-152.000
max1475.000-1627.000=-152.000
mean4.245-4.208=0.037
σ0.075-0.071=0.004
min4.124-4.059=0.065
max4.539-4.435=0.104
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1475.000-1627.000=-152.000
σ0.000
min1475.000-1627.000=-152.000
max1475.000-1627.000=-152.000
mean0.745-0.746=-0.001
σ0.018-0.019=-0.001
min0.710-0.714=-0.004
max0.864-0.864=-0.000
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1475.000-1627.000=-152.000
σ0.000
min1475.000-1627.000=-152.000
max1475.000-1627.000=-152.000
mean0.704-0.702=0.001
σ0.014-0.014=0.000
min0.674-0.670=0.004
max0.781-0.761=0.020

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.346-294.122=0.224
σ0.221-0.232=-0.011
min294.095-293.936=0.158
max294.879-294.744=0.135
mean1902.000-1938.000=-36.000
σ0.000
min1902.000-1938.000=-36.000
max1902.000-1938.000=-36.000
mean0.579-0.559=0.020
σ0.042-0.046=-0.004
min0.507-0.495=0.012
max0.664-0.648=0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.494-281.496=-0.002
σ0.040-0.036=0.004
min281.441-281.449=-0.008
max281.536-281.535=0.001
mean1475.000-1627.000=-152.000
σ0.000
min1475.000-1627.000=-152.000
max1475.000-1627.000=-152.000
mean0.393-0.395=-0.002
σ0.007-0.007=-0.000
min0.386-0.387=-0.001
max0.399-0.402=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1291.478-1291.476=0.002
σ0.107-0.098=0.008
min1291.354-1291.364=-0.010
max1291.600-1291.585=0.016
mean1475.000-1627.000=-152.000
σ0.000
min1475.000-1627.000=-152.000
max1475.000-1627.000=-152.000
mean2.000-1.988=0.012
σ0.268-0.145=0.123
min1.812-1.815=-0.003
max2.460-2.215=0.245
iters=5
new-facts=6402
prior-facts=1
mean1534.351-1534.334=0.016
σ4.000-4.003=-0.003
min1532.321-1532.322=-0.002
max1541.497-1541.487=0.010
mean1475.000-1627.000=-152.000
σ0.000
min1475.000-1627.000=-152.000
max1475.000-1627.000=-152.000
mean2.363-2.178=0.184
σ0.182-0.162=0.021
min2.052-2.040=0.011
max2.521-2.391=0.130
iters=5
new-facts=6402
prior-facts=6402
mean1853.349-1853.355=-0.006
σ0.058-0.050=0.008
min1853.287-1853.304=-0.016
max1853.431-1853.422=0.009
mean1755.200-1790.600=-35.400
σ168.912-148.616=20.296
min1506.000-1627.000=-121.000
max1902.000-1938.000=-36.000
mean2.971-3.143=-0.172
σ0.179-0.276=-0.097
min2.803-2.892=-0.089
max3.275-3.616=-0.341

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.731-1.425=0.306
σ0.186-0.265=-0.079
min1.589-1.249=0.339
max1.938-1.876=0.062

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.429-442.429=-0.000
σ577.064-577.065=-0.000
min153.895-153.894=0.000
max1308.026-1308.026=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1475.000-1627.000=-152.000
σ0.000
min1475.000-1627.000=-152.000
max1475.000-1627.000=-152.000
mean0.550-0.536=0.014
σ0.571-0.554=0.017
min0.263-0.258=0.004
max1.407-1.367=0.039
policies=20
mean1539.222-1539.233=-0.011
σ0.323-0.335=-0.013
min1539.000-1539.001=-0.001
max1539.701-1539.731=-0.030
mean920.000
σ0.000
min920.000
max920.000
mean1475.000-1627.000=-152.000
σ0.000
min1475.000-1627.000=-152.000
max1475.000-1627.000=-152.000
mean2.582-2.600=-0.017
σ0.010-0.032=-0.022
min2.568-2.568=-0.000
max2.589-2.631=-0.041
policies=200
mean15400.360-15400.448=-0.088
σ0.089-0.095=-0.005
min15400.262-15400.390=-0.127
max15400.459-15400.590=-0.131
mean9200.000
σ0.000
min9200.000
max9200.000
mean1475.000-1627.000=-152.000
σ0.000
min1475.000-1627.000=-152.000
max1475.000-1627.000=-152.000
mean26.095-26.039=0.057
σ0.036-0.050=-0.014
min26.058-25.977=0.081
max26.136-26.100=0.036