Compare commits

Home / Compare 6b4f24e9 .. 4db896ea

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.015=-0.000
σ0.368-0.371=-0.003
min53.871-53.868=0.002
max55.062-55.069=-0.007
mean414.000-415.700=-1.700
σ0.000-0.483=-0.483
min414.000-415.000=-1.000
max414.000-416.000=-2.000
mean0.138-0.137=0.001
σ0.006-0.006=-0.000
min0.130-0.129=0.001
max0.146-0.148=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.321-43.322=-0.001
σ0.008-0.005=0.003
min43.315-43.315=0.000
max43.341-43.330=0.011
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.118-0.122=-0.004
σ0.002-0.004=-0.002
min0.115-0.118=-0.002
max0.121-0.129=-0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.307-1006.312=-0.005
σ1.179-1.164=0.015
min1005.768-1005.744=0.024
max1011.248-1011.181=0.067
mean1051.400-1049.350=2.050
σ306.992-303.784=3.208
min584.000-597.000=-13.000
max1642.000-1640.000=2.000
mean1.566-1.556=0.010
σ0.087-0.091=-0.004
min1.484-1.454=0.030
max1.787-1.837=-0.050

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1642.000-1640.000=2.000
σ0.000
min1642.000-1640.000=2.000
max1642.000-1640.000=2.000
mean0.419-0.414=0.005
σ0.152-0.166=-0.014
min0.323-0.311=0.013
max0.688-0.706=-0.018
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1642.000-1640.000=2.000
σ0.000
min1642.000-1640.000=2.000
max1642.000-1640.000=2.000
mean0.933-0.924=0.009
σ0.154-0.164=-0.011
min0.831-0.831=0.000
max1.202-1.217=-0.015
name=heavy_item.art
mean1.523-1.523=-0.000
σ0.002-0.002=0.000
min1.522
max1.526
mean1642.000-1640.000=2.000
σ0.000
min1642.000-1640.000=2.000
max1642.000-1640.000=2.000
mean0.548-0.534=0.014
σ0.046-0.049=-0.002
min0.514-0.489=0.024
max0.624-0.613=0.011
name=nested_use.art
mean2.360-2.361=-0.001
σ0.002-0.003=-0.001
min2.359
max2.363-2.365=-0.002
mean1642.000-1640.000=2.000
σ0.000
min1642.000-1640.000=2.000
max1642.000-1640.000=2.000
mean0.837-0.844=-0.006
σ0.037-0.033=0.004
min0.809-0.816=-0.007
max0.897-0.897=0.000

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.113-964.112=0.001
σ0.035-0.022=0.013
min964.086-964.090=-0.003
max964.171-964.145=0.026
mean1642.000-1640.000=2.000
σ0.000
min1642.000-1640.000=2.000
max1642.000-1640.000=2.000
mean0.795-0.810=-0.015
σ0.065-0.043=0.022
min0.684-0.739=-0.055
max0.845-0.850=-0.005
name=cdr_enhanced_4k_loc.art
mean884.713-884.713=0.000
σ0.001-0.001=0.000
min884.712-884.712=0.001
max884.715-884.714=0.001
mean1642.000-1640.000=2.000
σ0.000
min1642.000-1640.000=2.000
max1642.000-1640.000=2.000
mean0.733-0.708=0.025
σ0.021-0.036=-0.015
min0.695-0.666=0.029
max0.747-0.739=0.008

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.714-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.719=-0.001
mean1642.000-1640.000=2.000
σ0.000
min1642.000-1640.000=2.000
max1642.000-1640.000=2.000
mean3.500-4.277=-0.777
σ0.087-0.090=-0.003
min3.369-4.134=-0.765
max3.833-4.695=-0.862
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.667-7.666=0.001
mean1642.000-1640.000=2.000
σ0.000
min1642.000-1640.000=2.000
max1642.000-1640.000=2.000
mean3.465-4.246=-0.781
σ0.066-0.071=-0.006
min3.344-4.133=-0.790
max3.668-4.539=-0.871
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1642.000-1640.000=2.000
σ0.000
min1642.000-1640.000=2.000
max1642.000-1640.000=2.000
mean0.719-0.732=-0.014
σ0.054-0.017=0.037
min0.524-0.705=-0.181
max0.847-0.834=0.013
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1642.000-1640.000=2.000
σ0.000
min1642.000-1640.000=2.000
max1642.000-1640.000=2.000
mean0.499-0.691=-0.193
σ0.013-0.017=-0.004
min0.475-0.649=-0.174
max0.546-0.780=-0.234

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.401-296.193=0.208
σ0.192-0.190=0.003
min296.274-296.010=0.264
max296.933-296.705=0.228
mean1904.000-1906.000=-2.000
σ0.000
min1904.000-1906.000=-2.000
max1904.000-1906.000=-2.000
mean0.568-0.594=-0.026
σ0.064-0.035=0.030
min0.504-0.550=-0.046
max0.706-0.680=0.026

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.690-284.693=-0.002
σ0.035-0.038=-0.003
min284.643-284.642=0.000
max284.727-284.736=-0.009
mean1642.000-1640.000=2.000
σ0.000
min1642.000-1640.000=2.000
max1642.000-1640.000=2.000
mean0.399-0.395=0.004
σ0.013-0.011=0.003
min0.385-0.383=0.002
max0.418-0.407=0.011
iters=5
new-facts=1
prior-facts=6402
mean1295.077-1295.074=0.003
σ0.109-0.109=-0.000
min1294.951-1294.963=-0.012
max1295.204-1295.207=-0.003
mean1642.000-1640.000=2.000
σ0.000
min1642.000-1640.000=2.000
max1642.000-1640.000=2.000
mean1.934-1.915=0.019
σ0.108-0.100=0.008
min1.809-1.798=0.011
max2.037-2.020=0.017
iters=5
new-facts=6402
prior-facts=1
mean1539.192-1539.186=0.006
σ6.883-6.840=0.043
min1535.918-1535.924=-0.006
max1551.500-1551.419=0.081
mean1642.000-1640.000=2.000
σ0.000
min1642.000-1640.000=2.000
max1642.000-1640.000=2.000
mean2.244-2.240=0.004
σ0.248-0.263=-0.014
min2.041-2.040=0.001
max2.621-2.666=-0.045
iters=5
new-facts=6402
prior-facts=6402
mean1856.985-1856.980=0.005
σ0.052-0.063=-0.012
min1856.937-1856.907=0.030
max1857.061-1857.069=-0.008
mean1772.600-1773.200=-0.600
σ128.926-130.433=-1.507
min1642.000-1640.000=2.000
max1904.000-1906.000=-2.000
mean3.044-3.061=-0.016
σ0.283-0.289=-0.005
min2.858-2.851=0.007
max3.546-3.566=-0.021

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.189-1.137=0.052
σ0.296-0.254=0.043
min0.941-0.936=0.006
max1.571-1.526=0.044

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.785=0.001
σ581.212-581.212=0.000
min157.179-157.177=0.001
max1319.605-1319.603=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1642.000-1640.000=2.000
σ0.000
min1642.000-1640.000=2.000
max1642.000-1640.000=2.000
mean0.545-0.535=0.009
σ0.564-0.549=0.015
min0.261-0.258=0.003
max1.391-1.359=0.032
policies=20
mean1572.102-1572.103=-0.001
σ0.353-0.355=-0.002
min1571.862-1571.867=-0.005
max1572.626-1572.631=-0.005
mean920.000
σ0.000
min920.000
max920.000
mean1642.000-1640.000=2.000
σ0.000
min1642.000-1640.000=2.000
max1642.000-1640.000=2.000
mean2.628-2.629=-0.001
σ0.010-0.024=-0.014
min2.619-2.607=0.012
max2.638-2.655=-0.017
policies=200
mean15728.953-15728.972=-0.019
σ0.182-0.076=0.106
min15728.808-15728.902=-0.094
max15729.219-15729.050=0.169
mean9200.000
σ0.000
min9200.000
max9200.000
mean1642.000-1640.000=2.000
σ0.000
min1642.000-1640.000=2.000
max1642.000-1640.000=2.000
mean26.634-26.535=0.099
σ0.072-0.082=-0.010
min26.556-26.470=0.086
max26.726-26.654=0.071