Compare commits

Home / Compare 0ffe2de4 .. 6dcd4aed

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.964-53.965=-0.001
σ0.369-0.370=-0.001
min53.818-53.816=0.001
max55.014-55.017=-0.002
mean416.000-420.000=-4.000
σ0.000
min416.000-420.000=-4.000
max416.000-420.000=-4.000
mean0.140-0.139=0.001
σ0.004-0.005=-0.001
min0.137-0.132=0.005
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=-0.000
σ0.007-0.006=0.001
min43.309-43.313=-0.004
max43.332-43.332=0.000
mean416.000-420.000=-4.000
σ0.000
min416.000-420.000=-4.000
max416.000-420.000=-4.000
mean0.122-0.121=0.001
σ0.004-0.004=0.000
min0.115-0.115=-0.000
max0.128-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.511-1006.519=-0.008
σ1.186-1.153=0.033
min1005.975-1005.949=0.026
max1011.483-1011.338=0.145
mean1049.900-1059.300=-9.400
σ314.902-303.819=11.083
min579.000-601.000=-22.000
max1648.000-1458.000=190.000
mean1.554-1.550=0.004
σ0.101-0.086=0.015
min1.463-1.442=0.021
max1.797-1.752=0.045

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1648.000-1458.000=190.000
σ0.000
min1648.000-1458.000=190.000
max1648.000-1458.000=190.000
mean0.424-0.423=0.002
σ0.137-0.144=-0.008
min0.345-0.337=0.008
max0.665-0.678=-0.013
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1648.000-1458.000=190.000
σ0.000
min1648.000-1458.000=190.000
max1648.000-1458.000=190.000
mean0.903-0.905=-0.002
σ0.098-0.091=0.007
min0.831-0.824=0.006
max1.075-1.062=0.013
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1648.000-1458.000=190.000
σ0.000
min1648.000-1458.000=190.000
max1648.000-1458.000=190.000
mean0.532-0.543=-0.011
σ0.054-0.053=0.002
min0.493-0.504=-0.010
max0.626-0.631=-0.005
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1648.000-1458.000=190.000
σ0.000
min1648.000-1458.000=190.000
max1648.000-1458.000=190.000
mean0.861-0.856=0.005
σ0.046-0.047=-0.001
min0.832-0.816=0.016
max0.938-0.930=0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.829=0.009
σ0.037-0.040=-0.003
min964.811-964.802=0.009
max964.901-964.900=0.001
mean1648.000-1458.000=190.000
σ0.000
min1648.000-1458.000=190.000
max1648.000-1458.000=190.000
mean0.809-0.808=0.001
σ0.061-0.079=-0.018
min0.729-0.670=0.059
max0.859-0.855=0.004
name=cdr_enhanced_4k_loc.art
mean885.512-885.510=0.002
σ0.007-0.007=-0.000
min885.506-885.504=0.001
max885.522-885.521=0.002
mean1648.000-1458.000=190.000
σ0.000
min1648.000-1458.000=190.000
max1648.000-1458.000=190.000
mean0.658-0.703=-0.045
σ0.063-0.030=0.033
min0.548-0.672=-0.123
max0.707-0.738=-0.031

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.001
mean1648.000-1458.000=190.000
σ0.000
min1648.000-1458.000=190.000
max1648.000-1458.000=190.000
mean4.216-3.563=0.654
σ0.084-0.086=-0.002
min4.079-3.397=0.683
max4.499-3.910=0.589
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=-0.000
min7.664
max7.668
mean1648.000-1458.000=190.000
σ0.000
min1648.000-1458.000=190.000
max1648.000-1458.000=190.000
mean4.256-3.533=0.723
σ0.091-0.077=0.014
min4.102-3.339=0.763
max4.666-3.785=0.881
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1648.000-1458.000=190.000
σ0.000
min1648.000-1458.000=190.000
max1648.000-1458.000=190.000
mean0.749-0.746=0.003
σ0.028-0.016=0.012
min0.530-0.714=-0.184
max0.869-0.828=0.041
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1648.000-1458.000=190.000
σ0.000
min1648.000-1458.000=190.000
max1648.000-1458.000=190.000
mean0.709-0.693=0.016
σ0.014-0.055=-0.041
min0.684-0.505=0.179
max0.788-0.770=0.017

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.296-296.402=-0.106
σ0.212-0.216=-0.004
min296.055-296.274=-0.220
max296.866-296.985=-0.119
mean2026.000-2031.000=-5.000
σ0.000
min2026.000-2031.000=-5.000
max2026.000-2031.000=-5.000
mean0.526-0.543=-0.017
σ0.029-0.035=-0.006
min0.499-0.502=-0.003
max0.578-0.584=-0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.038-285.033=0.005
σ0.027-0.038=-0.011
min285.011-284.982=0.028
max285.069-285.075=-0.006
mean1648.000-1458.000=190.000
σ0.000
min1648.000-1458.000=190.000
max1648.000-1458.000=190.000
mean0.395-0.396=-0.000
σ0.007-0.006=0.001
min0.387-0.388=-0.001
max0.404-0.401=0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.413-1295.409=0.004
σ0.106-0.111=-0.005
min1295.298-1295.292=0.005
max1295.539-1295.536=0.003
mean1648.000-1458.000=190.000
σ0.000
min1648.000-1458.000=190.000
max1648.000-1458.000=190.000
mean1.933-1.893=0.041
σ0.118-0.077=0.041
min1.828-1.816=0.012
max2.065-1.988=0.077
iters=5
new-facts=6402
prior-facts=1
mean1539.510-1539.521=-0.010
σ6.845-6.840=0.004
min1536.232-1536.230=0.002
max1551.749-1551.753=-0.003
mean1648.000-1458.000=190.000
σ0.000
min1648.000-1458.000=190.000
max1648.000-1458.000=190.000
mean2.260-2.275=-0.015
σ0.227-0.266=-0.038
min1.987-2.033=-0.046
max2.491-2.661=-0.170
iters=5
new-facts=6402
prior-facts=6402
mean1857.336-1857.310=0.026
σ0.059-0.073=-0.015
min1857.265-1857.222=0.043
max1857.404-1857.403=0.001
mean1776.800-1741.400=35.400
σ166.701-225.570=-58.869
min1648.000-1458.000=190.000
max2026.000-2031.000=-5.000
mean2.898-3.109=-0.211
σ0.111-0.319=-0.207
min2.716-2.871=-0.155
max2.993-3.601=-0.608

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.287-1.632=-0.345
σ0.328-0.163=0.165
min1.050-1.355=-0.305
max1.801-1.768=0.033

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.190-448.191=-0.001
σ581.332-581.332=-0.000
min157.523-157.523=0.000
max1320.188-1320.189=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1648.000-1458.000=190.000
σ0.000
min1648.000-1458.000=190.000
max1648.000-1458.000=190.000
mean0.553-0.545=0.008
σ0.577-0.561=0.017
min0.262-0.262=0.000
max1.419-1.386=0.033
policies=20
mean1575.571-1575.575=-0.004
σ0.370-0.358=0.011
min1575.320-1575.334=-0.014
max1576.120-1576.108=0.012
mean920.000
σ0.000
min920.000
max920.000
mean1648.000-1458.000=190.000
σ0.000
min1648.000-1458.000=190.000
max1648.000-1458.000=190.000
mean2.647-2.645=0.003
σ0.031-0.014=0.018
min2.616-2.625=-0.009
max2.689-2.655=0.034
policies=200
mean15763.669-15763.675=-0.006
σ0.079-0.162=-0.083
min15763.563-15763.583=-0.020
max15763.750-15763.917=-0.167
mean9200.000
σ0.000
min9200.000
max9200.000
mean1648.000-1458.000=190.000
σ0.000
min1648.000-1458.000=190.000
max1648.000-1458.000=190.000
mean26.529-26.611=-0.082
σ0.085-0.061=0.024
min26.425-26.560=-0.135
max26.631-26.682=-0.051