Compare commits

Home / Compare 5ae30d1b .. db5f05dc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.015=-0.001
σ0.368-0.371=-0.003
min53.871-53.869=0.001
max55.062-55.069=-0.008
mean414.000
σ0.000
min414.000
max414.000
mean0.138-0.140=-0.002
σ0.006-0.004=0.001
min0.130-0.136=-0.006
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.321-43.322=-0.001
σ0.008-0.007=0.001
min43.315-43.308=0.007
max43.341-43.333=0.008
mean414.000
σ0.000
min414.000
max414.000
mean0.118-0.120=-0.002
σ0.002-0.001=0.001
min0.115-0.118=-0.003
max0.121-0.122=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.307-1006.311=-0.004
σ1.179-1.159=0.020
min1005.768-1005.742=0.026
max1011.248-1011.161=0.088
mean1051.400-1045.350=6.050
σ306.992-313.737=-6.745
min584.000-595.000=-11.000
max1642.000
mean1.566-1.537=0.029
σ0.087-0.078=0.009
min1.484-1.448=0.036
max1.787-1.758=0.029

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1642.000
σ0.000
min1642.000
max1642.000
mean0.419-0.391=0.028
σ0.152-0.109=0.043
min0.323-0.321=0.002
max0.688-0.583=0.105
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1642.000
σ0.000
min1642.000
max1642.000
mean0.933-0.882=0.050
σ0.154-0.094=0.060
min0.831-0.816=0.015
max1.202-1.045=0.157
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1642.000
σ0.000
min1642.000
max1642.000
mean0.548-0.540=0.008
σ0.046-0.054=-0.008
min0.514-0.490=0.024
max0.624-0.632=-0.008
name=nested_use.art
mean2.360-2.360=0.000
σ0.002-0.002=0.000
min2.359
max2.363
mean1642.000
σ0.000
min1642.000
max1642.000
mean0.837-0.834=0.003
σ0.037-0.030=0.007
min0.809-0.809=0.001
max0.897-0.881=0.016

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.113-964.115=-0.002
σ0.035-0.034=0.001
min964.086-964.086=0.000
max964.171-964.171=-0.000
mean1642.000
σ0.000
min1642.000
max1642.000
mean0.795-0.839=-0.044
σ0.065-0.032=0.033
min0.684-0.789=-0.105
max0.845-0.871=-0.026
name=cdr_enhanced_4k_loc.art
mean884.713-884.711=0.002
σ0.001-0.008=-0.007
min884.712-884.703=0.009
max884.715-884.723=-0.008
mean1642.000
σ0.000
min1642.000
max1642.000
mean0.733-0.721=0.012
σ0.021-0.011=0.010
min0.695-0.708=-0.012
max0.747-0.738=0.009

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.714-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718
mean1642.000
σ0.000
min1642.000
max1642.000
mean3.500-4.254=-0.754
σ0.087-0.077=0.010
min3.369-4.124=-0.755
max3.833-4.478=-0.645
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.667-7.666=0.001
mean1642.000
σ0.000
min1642.000
max1642.000
mean3.465-4.238=-0.774
σ0.066-0.153=-0.087
min3.344-4.077=-0.733
max3.668-5.452=-1.784
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1642.000
σ0.000
min1642.000
max1642.000
mean0.719-0.758=-0.039
σ0.054-0.041=0.013
min0.524-0.542=-0.019
max0.847-0.868=-0.021
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1642.000
σ0.000
min1642.000
max1642.000
mean0.499-0.715=-0.216
σ0.013-0.032=-0.020
min0.475-0.654=-0.178
max0.546-0.815=-0.269

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.401-296.263=0.138
σ0.192-0.253=-0.061
min296.274-296.085=0.189
max296.933-296.961=-0.028
mean1904.000-1915.000=-11.000
σ0.000
min1904.000-1915.000=-11.000
max1904.000-1915.000=-11.000
mean0.568-0.572=-0.004
σ0.064-0.038=0.026
min0.504-0.516=-0.012
max0.706-0.630=0.076

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.690-284.695=-0.005
σ0.035-0.033=0.003
min284.643-284.661=-0.018
max284.727-284.737=-0.010
mean1642.000
σ0.000
min1642.000
max1642.000
mean0.399-0.402=-0.003
σ0.013-0.017=-0.004
min0.385-0.386=-0.001
max0.418-0.428=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1295.077-1295.076=0.000
σ0.109-0.106=0.003
min1294.951-1294.953=-0.002
max1295.204-1295.203=0.001
mean1642.000
σ0.000
min1642.000
max1642.000
mean1.934-1.943=-0.009
σ0.108-0.124=-0.016
min1.809-1.805=0.004
max2.037-2.134=-0.097
iters=5
new-facts=6402
prior-facts=1
mean1539.192-1539.230=-0.037
σ6.883-6.844=0.039
min1535.918-1535.929=-0.012
max1551.500-1551.467=0.034
mean1642.000
σ0.000
min1642.000
max1642.000
mean2.244-2.367=-0.123
σ0.248-0.231=0.018
min2.041-2.058=-0.017
max2.621-2.687=-0.066
iters=5
new-facts=6402
prior-facts=6402
mean1856.985-1856.979=0.006
σ0.052-0.060=-0.008
min1856.937-1856.923=0.014
max1857.061-1857.064=-0.002
mean1772.600
σ128.926-137.136=-8.211
min1642.000
max1904.000-1915.000=-11.000
mean3.044-3.068=-0.024
σ0.283-0.263=0.020
min2.858-2.861=-0.003
max3.546-3.525=0.021

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.189-1.190=-0.001
σ0.296-0.360=-0.064
min0.941-0.924=0.017
max1.571-1.788=-0.217

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.786=0.000
σ581.212-581.212=-0.000
min157.179-157.178=0.000
max1319.605-1319.605=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1642.000
σ0.000
min1642.000
max1642.000
mean0.545-0.534=0.011
σ0.564-0.546=0.018
min0.261-0.257=0.004
max1.391-1.353=0.038
policies=20
mean1572.102-1572.102=-0.000
σ0.353-0.352=0.000
min1571.862-1571.864=-0.002
max1572.626-1572.626=0.000
mean920.000
σ0.000
min920.000
max920.000
mean1642.000
σ0.000
min1642.000
max1642.000
mean2.628-2.619=0.008
σ0.010-0.022=-0.013
min2.619-2.591=0.028
max2.638-2.646=-0.007
policies=200
mean15728.953-15729.050=-0.098
σ0.182-0.053=0.129
min15728.808-15728.977=-0.169
max15729.219-15729.103=0.116
mean9200.000
σ0.000
min9200.000
max9200.000
mean1642.000
σ0.000
min1642.000
max1642.000
mean26.634-26.511=0.123
σ0.072-0.048=0.023
min26.556-26.477=0.078
max26.726-26.582=0.143