Compare commits

Home / Compare b8e9d38c .. ac56cc01

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.965-53.963=0.001
σ0.369-0.369=0.001
min53.825-53.820=0.005
max55.016-55.012=0.003
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.140-0.138=0.002
σ0.004-0.004=-0.001
min0.136-0.132=0.004
max0.146-0.146=0.000
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=-0.000
σ0.006-0.006=-0.000
min43.316-43.313=0.003
max43.333-43.334=-0.001
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.122-0.120=0.002
σ0.003-0.004=-0.001
min0.119-0.115=0.005
max0.127-0.125=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.514-1006.517=-0.002
σ1.181-1.163=0.018
min1005.976-1005.948=0.028
max1011.464-1011.385=0.079
mean1048.550-1050.150=-1.600
σ303.917-306.327=-2.410
min584.000-558.000=26.000
max1637.000-1640.000=-3.000
mean1.572-1.546=0.026
σ0.086-0.082=0.005
min1.501-1.479=0.021
max1.823-1.770=0.052

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.000
σ0.003-0.002=0.000
min0.882
max0.887-0.887=0.000
mean1637.000-1640.000=-3.000
σ0.000
min1637.000-1640.000=-3.000
max1637.000-1640.000=-3.000
mean0.421-0.444=-0.023
σ0.133-0.182=-0.049
min0.349-0.344=0.005
max0.657-0.768=-0.111
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1637.000-1640.000=-3.000
σ0.000
min1637.000-1640.000=-3.000
max1637.000-1640.000=-3.000
mean0.894-0.932=-0.038
σ0.089-0.160=-0.071
min0.834-0.834=0.000
max1.051-1.216=-0.165
name=heavy_item.art
mean1.524-1.524=-0.000
σ0.002-0.002=0.000
min1.522
max1.526
mean1637.000-1640.000=-3.000
σ0.000
min1637.000-1640.000=-3.000
max1637.000-1640.000=-3.000
mean0.537-0.538=-0.001
σ0.046-0.048=-0.002
min0.496-0.496=-0.000
max0.610-0.618=-0.008
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1637.000-1640.000=-3.000
σ0.000
min1637.000-1640.000=-3.000
max1637.000-1640.000=-3.000
mean0.837-0.848=-0.012
σ0.048-0.032=0.015
min0.804-0.816=-0.012
max0.916-0.902=0.014

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.839=-0.002
σ0.020-0.034=-0.014
min964.818-964.811=0.007
max964.869-964.895=-0.025
mean1637.000-1640.000=-3.000
σ0.000
min1637.000-1640.000=-3.000
max1637.000-1640.000=-3.000
mean0.832-0.811=0.021
σ0.031-0.046=-0.015
min0.797-0.751=0.047
max0.862-0.861=0.001
name=cdr_enhanced_4k_loc.art
mean885.514-885.511=0.002
σ0.006-0.006=-0.000
min885.504
max885.521-885.519=0.002
mean1637.000-1640.000=-3.000
σ0.000
min1637.000-1640.000=-3.000
max1637.000-1640.000=-3.000
mean0.689-0.701=-0.012
σ0.030-0.040=-0.010
min0.664-0.645=0.019
max0.737-0.742=-0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716
σ0.002
min7.715
max7.719
mean1637.000-1640.000=-3.000
σ0.000
min1637.000-1640.000=-3.000
max1637.000-1640.000=-3.000
mean4.275-3.511=0.764
σ0.099-0.076=0.023
min4.096-3.371=0.725
max4.764-3.814=0.949
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.670-7.671=-0.001
mean1637.000-1640.000=-3.000
σ0.000
min1637.000-1640.000=-3.000
max1637.000-1640.000=-3.000
mean4.266-3.457=0.808
σ0.073-0.070=0.002
min4.116-3.348=0.767
max4.504-3.694=0.810
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1637.000-1640.000=-3.000
σ0.000
min1637.000-1640.000=-3.000
max1637.000-1640.000=-3.000
mean0.746-0.729=0.017
σ0.017-0.018=-0.002
min0.711-0.695=0.016
max0.848-0.845=0.003
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1637.000-1640.000=-3.000
σ0.000
min1637.000-1640.000=-3.000
max1637.000-1640.000=-3.000
mean0.611-0.697=-0.086
σ0.097-0.017=0.080
min0.491-0.663=-0.172
max0.815-0.795=0.020

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.554-296.422=0.132
σ0.201-0.182=0.019
min296.342-296.291=0.050
max297.047-296.924=0.124
mean1905.000-1918.000=-13.000
σ0.000
min1905.000-1918.000=-13.000
max1905.000-1918.000=-13.000
mean0.583-0.578=0.005
σ0.050-0.035=0.015
min0.505-0.500=0.005
max0.682-0.609=0.073

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.029-285.035=-0.006
σ0.036-0.039=-0.003
min284.980-284.990=-0.010
max285.071-285.084=-0.013
mean1637.000-1640.000=-3.000
σ0.000
min1637.000-1640.000=-3.000
max1637.000-1640.000=-3.000
mean0.396-0.396=-0.001
σ0.010-0.016=-0.006
min0.387-0.385=0.002
max0.411-0.420=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1295.416-1295.411=0.004
σ0.107-0.105=0.002
min1295.297-1295.297=0.000
max1295.544-1295.550=-0.005
mean1637.000-1640.000=-3.000
σ0.000
min1637.000-1640.000=-3.000
max1637.000-1640.000=-3.000
mean1.912-1.908=0.004
σ0.087-0.099=-0.012
min1.814-1.797=0.017
max2.030-2.020=0.010
iters=5
new-facts=6402
prior-facts=1
mean1539.584-1539.546=0.038
σ6.829-6.854=-0.025
min1536.305-1536.264=0.041
max1551.795-1551.803=-0.008
mean1637.000-1640.000=-3.000
σ0.000
min1637.000-1640.000=-3.000
max1637.000-1640.000=-3.000
mean2.388-2.180=0.207
σ0.276-0.228=0.048
min1.960-2.018=-0.058
max2.703-2.581=0.122
iters=5
new-facts=6402
prior-facts=6402
mean1857.320-1857.326=-0.006
σ0.057-0.074=-0.017
min1857.265-1857.233=0.031
max1857.402-1857.417=-0.015
mean1770.600-1774.200=-3.600
σ130.494-139.414=-8.919
min1637.000-1640.000=-3.000
max1905.000-1918.000=-13.000
mean3.067-2.989=0.078
σ0.299-0.178=0.122
min2.844-2.697=0.147
max3.582-3.142=0.439

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.141-1.192=-0.051
σ0.250-0.235=0.015
min0.927-0.925=0.003
max1.518-1.543=-0.026

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.191-448.189=0.002
σ581.332-581.332=0.001
min157.521-157.523=-0.002
max1320.189-1320.187=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1637.000-1640.000=-3.000
σ0.000
min1637.000-1640.000=-3.000
max1637.000-1640.000=-3.000
mean0.531-0.544=-0.013
σ0.548-0.559=-0.011
min0.246-0.261=-0.015
max1.353-1.382=-0.029
policies=20
mean1575.576-1575.546=0.030
σ0.366-0.340=0.026
min1575.330-1575.311=0.019
max1576.121-1576.051=0.069
mean920.000
σ0.000
min920.000
max920.000
mean1637.000-1640.000=-3.000
σ0.000
min1637.000-1640.000=-3.000
max1637.000-1640.000=-3.000
mean2.648-2.611=0.036
σ0.016-0.021=-0.006
min2.632-2.587=0.045
max2.668-2.633=0.035
policies=200
mean15763.747-15763.624=0.122
σ0.100-0.305=-0.205
min15763.664-15763.173=0.491
max15763.882-15763.839=0.043
mean9200.000
σ0.000
min9200.000
max9200.000
mean1637.000-1640.000=-3.000
σ0.000
min1637.000-1640.000=-3.000
max1637.000-1640.000=-3.000
mean26.634-26.467=0.168
σ0.121-0.106=0.015
min26.512-26.372=0.140
max26.801-26.618=0.183