Compare commits

Home / Compare c63db3cc .. c20b4d54

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.016=-0.002
σ0.369-0.369=0.000
min53.870-53.876=-0.006
max55.065-55.065=-0.000
mean416.000-416.900=-0.900
σ0.000-0.316=-0.316
min416.000
max416.000-417.000=-1.000
mean0.140-0.140=0.000
σ0.004-0.004=-0.000
min0.137-0.133=0.004
max0.146-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=-0.000
σ0.008-0.006=0.002
min43.309-43.314=-0.005
max43.338-43.337=0.001
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.123-0.120=0.003
σ0.004-0.003=0.001
min0.119-0.115=0.004
max0.129-0.124=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.306-1006.309=-0.004
σ1.182-1.162=0.020
min1005.767-1005.741=0.026
max1011.260-1011.177=0.083
mean1043.700-1044.400=-0.700
σ311.595-312.550=-0.955
min596.000-577.000=19.000
max1631.000-1634.000=-3.000
mean1.575-1.564=0.011
σ0.088-0.094=-0.006
min1.498-1.473=0.026
max1.834-1.833=0.001

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1631.000-1634.000=-3.000
σ0.000
min1631.000-1634.000=-3.000
max1631.000-1634.000=-3.000
mean0.406-0.408=-0.002
σ0.114-0.136=-0.022
min0.347-0.327=0.020
max0.610-0.649=-0.039
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1631.000-1634.000=-3.000
σ0.000
min1631.000-1634.000=-3.000
max1631.000-1634.000=-3.000
mean0.889-0.890=-0.002
σ0.096-0.088=0.008
min0.828-0.838=-0.009
max1.056-1.047=0.010
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1631.000-1634.000=-3.000
σ0.000
min1631.000-1634.000=-3.000
max1631.000-1634.000=-3.000
mean0.550-0.544=0.006
σ0.054-0.054=0.000
min0.502-0.512=-0.010
max0.643-0.639=0.004
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1631.000-1634.000=-3.000
σ0.000
min1631.000-1634.000=-3.000
max1631.000-1634.000=-3.000
mean0.850-0.850=0.000
σ0.037-0.039=-0.002
min0.818-0.825=-0.006
max0.911-0.919=-0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.115=0.000
σ0.034-0.035=-0.000
min964.086
max964.172-964.173=-0.001
mean1631.000-1634.000=-3.000
σ0.000
min1631.000-1634.000=-3.000
max1631.000-1634.000=-3.000
mean0.809-0.832=-0.023
σ0.066-0.043=0.022
min0.736-0.765=-0.029
max0.860-0.867=-0.007
name=cdr_enhanced_4k_loc.art
mean884.711-884.711=-0.000
σ0.007-0.008=-0.001
min884.705-884.703=0.001
max884.722-884.723=-0.000
mean1631.000-1634.000=-3.000
σ0.000
min1631.000-1634.000=-3.000
max1631.000-1634.000=-3.000
mean0.706-0.683=0.023
σ0.044-0.073=-0.029
min0.648-0.595=0.053
max0.741-0.742=-0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715
σ0.002
min7.714
max7.718
mean1631.000-1634.000=-3.000
σ0.000
min1631.000-1634.000=-3.000
max1631.000-1634.000=-3.000
mean4.216-4.261=-0.045
σ0.068-0.102=-0.034
min4.105-4.103=0.002
max4.452-4.732=-0.279
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.670-7.666=0.004
mean1631.000-1634.000=-3.000
σ0.000
min1631.000-1634.000=-3.000
max1631.000-1634.000=-3.000
mean4.204-4.211=-0.007
σ0.064-0.086=-0.022
min4.051-4.065=-0.014
max4.375-4.467=-0.093
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1631.000-1634.000=-3.000
σ0.000
min1631.000-1634.000=-3.000
max1631.000-1634.000=-3.000
mean0.677-0.742=-0.065
σ0.098-0.020=0.078
min0.514-0.719=-0.205
max0.864-0.895=-0.031
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1631.000-1634.000=-3.000
σ0.000
min1631.000-1634.000=-3.000
max1631.000-1634.000=-3.000
mean0.501-0.705=-0.204
σ0.012-0.016=-0.003
min0.476-0.671=-0.195
max0.563-0.791=-0.228

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.464-296.324=0.141
σ0.220-0.165=0.055
min296.324-296.191=0.133
max297.048-296.751=0.297
mean1916.000-1899.000=17.000
σ0.000
min1916.000-1899.000=17.000
max1916.000-1899.000=17.000
mean0.576-0.603=-0.027
σ0.039-0.016=0.024
min0.517-0.574=-0.056
max0.659-0.635=0.024

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.697-284.694=0.003
σ0.035-0.038=-0.003
min284.652-284.640=0.012
max284.738-284.732=0.006
mean1631.000-1634.000=-3.000
σ0.000
min1631.000-1634.000=-3.000
max1631.000-1634.000=-3.000
mean0.398-0.398=0.001
σ0.010-0.009=0.002
min0.385-0.389=-0.004
max0.407-0.407=0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.081-1295.071=0.009
σ0.110-0.107=0.002
min1294.961-1294.946=0.016
max1295.211-1295.213=-0.002
mean1631.000-1634.000=-3.000
σ0.000
min1631.000-1634.000=-3.000
max1631.000-1634.000=-3.000
mean1.931-2.008=-0.076
σ0.096-0.122=-0.026
min1.829-1.833=-0.004
max2.023-2.168=-0.145
iters=5
new-facts=6402
prior-facts=1
mean1539.191-1539.206=-0.015
σ6.855-6.839=0.016
min1535.925-1535.958=-0.032
max1551.450-1551.437=0.013
mean1631.000-1634.000=-3.000
σ0.000
min1631.000-1634.000=-3.000
max1631.000-1634.000=-3.000
mean2.260-2.155=0.106
σ0.268-0.139=0.130
min2.028-2.043=-0.016
max2.658-2.391=0.268
iters=5
new-facts=6402
prior-facts=6402
mean1856.987-1856.980=0.006
σ0.053-0.052=0.000
min1856.930-1856.936=-0.006
max1857.061-1857.058=0.003
mean1771.400-1779.600=-8.200
σ140.030-125.532=14.498
min1631.000-1634.000=-3.000
max1916.000-1899.000=17.000
mean3.101-2.987=0.115
σ0.316-0.099=0.217
min2.883-2.832=0.050
max3.657-3.107=0.550

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.213-1.224=-0.010
σ0.273-0.212=0.061
min0.954-0.954=0.000
max1.652-1.511=0.141

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.786=0.000
σ581.213-581.213=0.000
min157.176-157.179=-0.003
max1319.605-1319.604=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1631.000-1634.000=-3.000
σ0.000
min1631.000-1634.000=-3.000
max1631.000-1634.000=-3.000
mean0.532-0.543=-0.012
σ0.538-0.566=-0.028
min0.261-0.254=0.007
max1.339-1.393=-0.054
policies=20
mean1572.102-1572.103=-0.002
σ0.353-0.355=-0.002
min1571.868-1571.863=0.004
max1572.626-1572.630=-0.004
mean920.000
σ0.000
min920.000
max920.000
mean1631.000-1634.000=-3.000
σ0.000
min1631.000-1634.000=-3.000
max1631.000-1634.000=-3.000
mean2.629-2.631=-0.002
σ0.018-0.009=0.009
min2.607-2.622=-0.015
max2.645-2.639=0.006
policies=200
mean15729.078-15729.033=0.045
σ0.107-0.047=0.060
min15728.998-15728.976=0.022
max15729.233-15729.077=0.156
mean9200.000
σ0.000
min9200.000
max9200.000
mean1631.000-1634.000=-3.000
σ0.000
min1631.000-1634.000=-3.000
max1631.000-1634.000=-3.000
mean26.545-26.501=0.044
σ0.033-0.032=0.001
min26.513-26.459=0.055
max26.581-26.535=0.047