Compare commits

Home / Compare fe1a112c .. 0993aeb0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.016-54.013=0.002
σ0.370-0.369=0.001
min53.873-53.865=0.008
max55.067-55.062=0.005
mean416.700-416.000=0.700
σ0.483-0.000=0.483
min416.000
max417.000-416.000=1.000
mean0.140-0.138=0.001
σ0.004-0.006=-0.002
min0.137-0.129=0.008
max0.147-0.148=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.321-43.322=-0.001
σ0.006-0.006=0.000
min43.313-43.316=-0.002
max43.338-43.333=0.005
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.120-0.120=0.001
σ0.002-0.005=-0.003
min0.118-0.110=0.008
max0.127-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.311-1006.306=0.004
σ1.170-1.168=0.002
min1005.750-1005.774=-0.024
max1011.208-1011.188=0.020
mean1047.350-1054.350=-7.000
σ313.999-319.373=-5.374
min596.000-597.000=-1.000
max1644.000-1621.000=23.000
mean1.568-1.573=-0.005
σ0.080-0.134=-0.054
min1.488-1.483=0.005
max1.794-2.059=-0.266

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1644.000-1621.000=23.000
σ0.000
min1644.000-1621.000=23.000
max1644.000-1621.000=23.000
mean0.388-0.413=-0.025
σ0.125-0.140=-0.016
min0.309-0.330=-0.020
max0.606-0.662=-0.056
name=error_case.art
mean2.337-2.339=-0.002
σ0.003-0.003=-0.000
min2.336
max2.341-2.343=-0.002
mean1644.000-1621.000=23.000
σ0.000
min1644.000-1621.000=23.000
max1644.000-1621.000=23.000
mean0.877-0.884=-0.007
σ0.083-0.104=-0.022
min0.814-0.821=-0.007
max1.021-1.067=-0.046
name=heavy_item.art
mean1.523-1.523=-0.000
σ0.002-0.002=0.000
min1.522
max1.526
mean1644.000-1621.000=23.000
σ0.000
min1644.000-1621.000=23.000
max1644.000-1621.000=23.000
mean0.540-0.543=-0.003
σ0.049-0.052=-0.003
min0.504-0.500=0.005
max0.626-0.622=0.004
name=nested_use.art
mean2.360-2.360=-0.000
σ0.002-0.002=-0.000
min2.359
max2.363
mean1644.000-1621.000=23.000
σ0.000
min1644.000-1621.000=23.000
max1644.000-1621.000=23.000
mean0.835-0.854=-0.019
σ0.038-0.049=-0.011
min0.805-0.814=-0.009
max0.902-0.935=-0.033

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.113-964.112=0.001
σ0.027-0.031=-0.005
min964.095-964.086=0.009
max964.159-964.165=-0.006
mean1644.000-1621.000=23.000
σ0.000
min1644.000-1621.000=23.000
max1644.000-1621.000=23.000
mean0.816-0.847=-0.031
σ0.041-0.024=0.017
min0.760-0.805=-0.045
max0.866-0.866=-0.000
name=cdr_enhanced_4k_loc.art
mean884.713-884.711=0.002
σ0.007-0.005=0.002
min884.703
max884.723-884.717=0.006
mean1644.000-1621.000=23.000
σ0.000
min1644.000-1621.000=23.000
max1644.000-1621.000=23.000
mean0.714-0.684=0.030
σ0.043-0.037=0.006
min0.665-0.638=0.027
max0.749-0.723=0.026

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.720=-0.003
mean1644.000-1621.000=23.000
σ0.000
min1644.000-1621.000=23.000
max1644.000-1621.000=23.000
mean4.273-4.259=0.015
σ0.098-0.099=-0.002
min4.101-4.077=0.024
max4.644-4.569=0.075
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.668-7.666=0.002
mean1644.000-1621.000=23.000
σ0.000
min1644.000-1621.000=23.000
max1644.000-1621.000=23.000
mean4.263-3.600=0.663
σ0.093-0.225=-0.132
min4.092-3.360=0.732
max4.562-4.485=0.077
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1644.000-1621.000=23.000
σ0.000
min1644.000-1621.000=23.000
max1644.000-1621.000=23.000
mean0.739-0.732=0.007
σ0.018-0.026=-0.008
min0.709-0.538=0.170
max0.864-0.836=0.028
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1644.000-1621.000=23.000
σ0.000
min1644.000-1621.000=23.000
max1644.000-1621.000=23.000
mean0.701-0.701=0.000
σ0.015-0.018=-0.004
min0.667-0.665=0.002
max0.791-0.777=0.014

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.299-296.251=0.049
σ0.242-0.241=0.001
min296.046-296.091=-0.045
max296.960-296.918=0.042
mean1903.000-1899.000=4.000
σ0.000
min1903.000-1899.000=4.000
max1903.000-1899.000=4.000
mean0.572-0.575=-0.003
σ0.057-0.038=0.019
min0.500-0.529=-0.028
max0.689-0.655=0.034

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.694-284.691=0.003
σ0.038-0.041=-0.004
min284.638-284.636=0.002
max284.729-284.738=-0.009
mean1644.000-1621.000=23.000
σ0.000
min1644.000-1621.000=23.000
max1644.000-1621.000=23.000
mean0.399-0.397=0.002
σ0.009-0.011=-0.002
min0.386-0.385=0.001
max0.405-0.407=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.082-1295.071=0.011
σ0.111-0.105=0.007
min1294.961-1294.951=0.010
max1295.216-1295.202=0.014
mean1644.000-1621.000=23.000
σ0.000
min1644.000-1621.000=23.000
max1644.000-1621.000=23.000
mean1.913-1.892=0.021
σ0.101-0.111=-0.010
min1.798-1.719=0.079
max2.011-1.998=0.014
iters=5
new-facts=6402
prior-facts=1
mean1539.185-1539.201=-0.016
σ6.857-6.832=0.025
min1535.917-1535.953=-0.035
max1551.447-1551.419=0.028
mean1644.000-1621.000=23.000
σ0.000
min1644.000-1621.000=23.000
max1644.000-1621.000=23.000
mean2.233-2.158=0.074
σ0.239-0.133=0.107
min2.025-2.022=0.004
max2.614-2.369=0.245
iters=5
new-facts=6402
prior-facts=6402
mean1856.982-1856.966=0.016
σ0.054-0.077=-0.023
min1856.928-1856.884=0.044
max1857.070-1857.073=-0.004
mean1772.000-1777.600=-5.600
σ128.410-128.995=-0.586
min1644.000-1621.000=23.000
max1903.000-1899.000=4.000
mean3.030-3.013=0.017
σ0.254-0.227=0.027
min2.842-2.859=-0.017
max3.475-3.407=0.068

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.169-1.304=-0.135
σ0.241-0.314=-0.074
min0.924-0.932=-0.008
max1.545-1.675=-0.130

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.785=0.001
σ581.212-581.212=-0.000
min157.178-157.178=0.000
max1319.604-1319.604=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1644.000-1621.000=23.000
σ0.000
min1644.000-1621.000=23.000
max1644.000-1621.000=23.000
mean0.539-0.534=0.004
σ0.557-0.540=0.018
min0.258-0.261=-0.003
max1.375-1.344=0.031
policies=20
mean1572.099-1572.093=0.006
σ0.346-0.355=-0.008
min1571.863-1571.854=0.009
max1572.614-1572.620=-0.007
mean920.000
σ0.000
min920.000
max920.000
mean1644.000-1621.000=23.000
σ0.000
min1644.000-1621.000=23.000
max1644.000-1621.000=23.000
mean2.617-2.636=-0.019
σ0.023-0.014=0.008
min2.596-2.616=-0.021
max2.646-2.647=-0.001
policies=200
mean15729.000-15728.884=0.116
σ0.111-0.123=-0.011
min15728.850-15728.774=0.076
max15729.086-15729.018=0.068
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000-1621.000=23.000
σ0.000
min1644.000-1621.000=23.000
max1644.000-1621.000=23.000
mean26.508-26.509=-0.000
σ0.013-0.040=-0.027
min26.492-26.479=0.013
max26.522-26.565=-0.043