Compare commits

Home / Compare 7971c1b8 .. 2e936d30

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.704-53.704=0.000
σ0.369-0.369=0.000
min53.559-53.561=-0.002
max54.754-54.754=0.001
mean418.000-415.800=2.200
σ0.000-0.422=-0.422
min418.000-415.000=3.000
max418.000-416.000=2.000
mean0.140-0.139=0.001
σ0.005-0.004=0.001
min0.136-0.135=0.000
max0.148-0.146=0.002
cache=y
dps=1
iters=10
policies=100
mean43.060-43.059=0.001
σ0.007-0.005=0.002
min43.050-43.051=-0.002
max43.069-43.067=0.002
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.122-0.121=0.001
σ0.004-0.004=-0.000
min0.119-0.115=0.004
max0.130-0.129=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.106-1005.103=0.003
σ0.895-0.891=0.004
min1004.635-1004.628=0.007
max1008.821-1008.801=0.020
mean1056.900-1049.050=7.850
σ309.527-298.538=10.989
min568.000-574.000=-6.000
max1651.000-1475.000=176.000
mean1.612-1.603=0.009
σ0.061-0.052=0.009
min1.526-1.487=0.040
max1.726-1.706=0.020

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.000
σ0.002-0.002=0.000
min0.881
max0.886-0.886=0.000
mean1651.000-1475.000=176.000
σ0.000
min1651.000-1475.000=176.000
max1651.000-1475.000=176.000
mean0.420-0.444=-0.024
σ0.138-0.171=-0.033
min0.338-0.348=-0.010
max0.664-0.747=-0.083
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1651.000-1475.000=176.000
σ0.000
min1651.000-1475.000=176.000
max1651.000-1475.000=176.000
mean0.901-0.928=-0.028
σ0.097-0.175=-0.078
min0.843-0.844=-0.002
max1.072-1.241=-0.168
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1651.000-1475.000=176.000
σ0.000
min1651.000-1475.000=176.000
max1651.000-1475.000=176.000
mean0.548-0.547=0.001
σ0.047-0.059=-0.012
min0.512-0.496=0.016
max0.624-0.648=-0.025
name=nested_use.art
mean2.355
σ0.002
min2.355
max2.358
mean1651.000-1475.000=176.000
σ0.000
min1651.000-1475.000=176.000
max1651.000-1475.000=176.000
mean0.878-0.842=0.036
σ0.055-0.037=0.018
min0.821-0.815=0.006
max0.954-0.907=0.048

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.551-963.543=0.008
σ0.027-0.024=0.002
min963.523
max963.593-963.582=0.010
mean1651.000-1475.000=176.000
σ0.000
min1651.000-1475.000=176.000
max1651.000-1475.000=176.000
mean0.828-0.830=-0.002
σ0.035-0.029=0.006
min0.784-0.793=-0.009
max0.856-0.861=-0.005
name=cdr_enhanced_4k_loc.art
mean884.856-884.854=0.003
σ0.005-0.007=-0.001
min884.847
max884.860-884.861=-0.001
mean1651.000-1475.000=176.000
σ0.000
min1651.000-1475.000=176.000
max1651.000-1475.000=176.000
mean0.717-0.715=0.002
σ0.018-0.062=-0.044
min0.696-0.603=0.092
max0.738-0.749=-0.011

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=0.000
min7.705
max7.712-7.709=0.003
mean1651.000-1475.000=176.000
σ0.000
min1651.000-1475.000=176.000
max1651.000-1475.000=176.000
mean3.529-4.288=-0.759
σ0.075-0.091=-0.016
min3.397-4.133=-0.736
max3.807-4.595=-0.788
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1651.000-1475.000=176.000
σ0.000
min1651.000-1475.000=176.000
max1651.000-1475.000=176.000
mean3.553-4.245=-0.692
σ0.083-0.075=0.008
min3.388-4.124=-0.736
max3.909-4.539=-0.630
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1651.000-1475.000=176.000
σ0.000
min1651.000-1475.000=176.000
max1651.000-1475.000=176.000
mean0.534-0.745=-0.210
σ0.014-0.018=-0.004
min0.512-0.710=-0.199
max0.616-0.864=-0.248
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1651.000-1475.000=176.000
σ0.000
min1651.000-1475.000=176.000
max1651.000-1475.000=176.000
mean0.509-0.704=-0.195
σ0.011-0.014=-0.003
min0.486-0.674=-0.189
max0.561-0.781=-0.220

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.489-294.346=0.143
σ0.239-0.221=0.019
min294.222-294.095=0.127
max295.071-294.879=0.192
mean1903.000-1902.000=1.000
σ0.000
min1903.000-1902.000=1.000
max1903.000-1902.000=1.000
mean0.568-0.579=-0.012
σ0.033-0.042=-0.009
min0.517-0.507=0.011
max0.610-0.664=-0.054

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.497-281.494=0.004
σ0.036-0.040=-0.004
min281.454-281.441=0.013
max281.534-281.536=-0.002
mean1651.000-1475.000=176.000
σ0.000
min1651.000-1475.000=176.000
max1651.000-1475.000=176.000
mean0.393-0.393=-0.000
σ0.006-0.007=-0.000
min0.385-0.386=-0.001
max0.401-0.399=0.001
iters=5
new-facts=1
prior-facts=6402
mean1291.481-1291.478=0.003
σ0.111-0.107=0.004
min1291.355-1291.354=0.001
max1291.620-1291.600=0.020
mean1651.000-1475.000=176.000
σ0.000
min1651.000-1475.000=176.000
max1651.000-1475.000=176.000
mean1.886-2.000=-0.114
σ0.100-0.268=-0.168
min1.789-1.812=-0.023
max2.036-2.460=-0.424
iters=5
new-facts=6402
prior-facts=1
mean1534.372-1534.351=0.021
σ3.975-4.000=-0.025
min1532.365-1532.321=0.045
max1541.474-1541.497=-0.024
mean1651.000-1475.000=176.000
σ0.000
min1651.000-1475.000=176.000
max1651.000-1475.000=176.000
mean2.358-2.363=-0.004
σ0.230-0.182=0.048
min2.028-2.052=-0.023
max2.618-2.521=0.097
iters=5
new-facts=6402
prior-facts=6402
mean1853.354-1853.349=0.006
σ0.052-0.058=-0.007
min1853.312-1853.287=0.024
max1853.430-1853.431=-0.001
mean1774.600-1755.200=19.400
σ122.967-168.912=-45.945
min1651.000-1506.000=145.000
max1903.000-1902.000=1.000
mean3.063-2.971=0.093
σ0.281-0.179=0.101
min2.870-2.803=0.066
max3.557-3.275=0.282

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.400-1.731=-0.331
σ0.271-0.186=0.085
min1.116-1.589=-0.473
max1.812-1.938=-0.126

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.429-442.429=0.000
σ577.064-577.064=-0.000
min153.895-153.895=0.001
max1308.026-1308.026=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1651.000-1475.000=176.000
σ0.000
min1651.000-1475.000=176.000
max1651.000-1475.000=176.000
mean0.546-0.550=-0.004
σ0.578-0.571=0.006
min0.257-0.263=-0.006
max1.412-1.407=0.006
policies=20
mean1539.221-1539.222=-0.001
σ0.313-0.323=-0.010
min1539.003-1539.000=0.002
max1539.685-1539.701=-0.016
mean920.000
σ0.000
min920.000
max920.000
mean1651.000-1475.000=176.000
σ0.000
min1651.000-1475.000=176.000
max1651.000-1475.000=176.000
mean2.565-2.582=-0.018
σ0.018-0.010=0.008
min2.546-2.568=-0.022
max2.589-2.589=-0.000
policies=200
mean15400.360-15400.360=-0.001
σ0.115-0.089=0.026
min15400.237-15400.262=-0.025
max15400.468-15400.459=0.009
mean9200.000
σ0.000
min9200.000
max9200.000
mean1651.000-1475.000=176.000
σ0.000
min1651.000-1475.000=176.000
max1651.000-1475.000=176.000
mean26.043-26.095=-0.052
σ0.154-0.036=0.118
min25.878-26.058=-0.180
max26.247-26.136=0.111