Compare commits

Home / Compare 40bc0d93 .. 324cd598

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.964-54.016=-0.052
σ0.368-0.369=-0.001
min53.815-53.876=-0.061
max55.011-55.065=-0.054
mean414.000-416.900=-2.900
σ0.000-0.316=-0.316
min414.000-416.000=-2.000
max414.000-417.000=-3.000
mean0.138-0.140=-0.002
σ0.005-0.004=0.001
min0.131-0.133=-0.002
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=-0.000
σ0.007-0.006=0.001
min43.311-43.314=-0.003
max43.335-43.337=-0.003
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.120-0.120=0.001
σ0.005-0.003=0.002
min0.114-0.115=-0.002
max0.129-0.124=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.512-1006.309=0.202
σ1.180-1.162=0.018
min1005.948-1005.741=0.207
max1011.464-1011.177=0.287
mean1052.300-1044.400=7.900
σ315.670-312.550=3.120
min564.000-577.000=-13.000
max1614.000-1634.000=-20.000
mean1.496-1.564=-0.068
σ0.060-0.094=-0.034
min1.340-1.473=-0.132
max1.586-1.833=-0.247

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.866=0.018
σ0.003
min0.882-0.864=0.018
max0.887-0.869=0.018
mean1614.000-1634.000=-20.000
σ0.000
min1614.000-1634.000=-20.000
max1614.000-1634.000=-20.000
mean0.422-0.408=0.014
σ0.141-0.136=0.005
min0.336-0.327=0.009
max0.672-0.649=0.022
name=error_case.art
mean2.339-2.337=0.001
σ0.003
min2.337-2.336=0.001
max2.342-2.341=0.001
mean1614.000-1634.000=-20.000
σ0.000
min1614.000-1634.000=-20.000
max1614.000-1634.000=-20.000
mean0.900-0.890=0.010
σ0.091-0.088=0.003
min0.839-0.838=0.001
max1.058-1.047=0.012
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002
min1.522-1.522=0.001
max1.526-1.526=0.001
mean1614.000-1634.000=-20.000
σ0.000
min1614.000-1634.000=-20.000
max1614.000-1634.000=-20.000
mean0.546-0.544=0.002
σ0.061-0.054=0.007
min0.494-0.512=-0.018
max0.645-0.639=0.006
name=nested_use.art
mean2.361-2.360=0.001
σ0.002
min2.360-2.359=0.001
max2.364-2.363=0.001
mean1614.000-1634.000=-20.000
σ0.000
min1614.000-1634.000=-20.000
max1614.000-1634.000=-20.000
mean0.861-0.850=0.012
σ0.044-0.039=0.005
min0.822-0.825=-0.003
max0.933-0.919=0.014

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.115=0.723
σ0.034-0.035=-0.001
min964.811-964.086=0.724
max964.896-964.173=0.723
mean1614.000-1634.000=-20.000
σ0.000
min1614.000-1634.000=-20.000
max1614.000-1634.000=-20.000
mean0.767-0.832=-0.065
σ0.086-0.043=0.042
min0.634-0.765=-0.130
max0.851-0.867=-0.016
name=cdr_enhanced_4k_loc.art
mean885.513-884.711=0.802
σ0.006-0.008=-0.002
min885.506-884.703=0.802
max885.522-884.723=0.800
mean1614.000-1634.000=-20.000
σ0.000
min1614.000-1634.000=-20.000
max1614.000-1634.000=-20.000
mean0.704-0.683=0.022
σ0.031-0.073=-0.042
min0.680-0.595=0.084
max0.753-0.742=0.011

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.715=0.002
σ0.002-0.002=0.000
min7.715-7.714=0.002
max7.719-7.718=0.002
mean1614.000-1634.000=-20.000
σ0.000
min1614.000-1634.000=-20.000
max1614.000-1634.000=-20.000
mean3.568-4.261=-0.693
σ0.103-0.102=0.001
min3.393-4.103=-0.710
max4.082-4.732=-0.650
name=record_render_large_syntax_err.art
mean7.665-7.663=0.002
σ0.002-0.002=0.000
min7.664-7.662=0.002
max7.669-7.666=0.003
mean1614.000-1634.000=-20.000
σ0.000
min1614.000-1634.000=-20.000
max1614.000-1634.000=-20.000
mean3.530-4.211=-0.681
σ0.061-0.086=-0.026
min3.377-4.065=-0.687
max3.743-4.467=-0.724
name=record_render_success.art
mean2.291-2.289=0.001
σ0.002
min2.290-2.289=0.001
max2.294-2.292=0.001
mean1614.000-1634.000=-20.000
σ0.000
min1614.000-1634.000=-20.000
max1614.000-1634.000=-20.000
mean0.749-0.742=0.007
σ0.017-0.020=-0.003
min0.715-0.719=-0.004
max0.837-0.895=-0.058
name=record_render_syntax_err.art
mean2.166-2.165=0.001
σ0.002
min2.165-2.164=0.001
max2.169-2.168=0.001
mean1614.000-1634.000=-20.000
σ0.000
min1614.000-1634.000=-20.000
max1614.000-1634.000=-20.000
mean0.702-0.705=-0.003
σ0.030-0.016=0.014
min0.521-0.671=-0.150
max0.792-0.791=0.001

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.449-296.324=0.125
σ0.246-0.165=0.081
min296.197-296.191=0.006
max297.093-296.751=0.341
mean2035.000-1899.000=136.000
σ0.000
min2035.000-1899.000=136.000
max2035.000-1899.000=136.000
mean0.549-0.603=-0.054
σ0.029-0.016=0.013
min0.504-0.574=-0.069
max0.582-0.635=-0.053

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.032-284.694=0.339
σ0.037-0.038=-0.001
min284.985-284.640=0.344
max285.078-284.732=0.346
mean1614.000-1634.000=-20.000
σ0.000
min1614.000-1634.000=-20.000
max1614.000-1634.000=-20.000
mean0.392-0.398=-0.006
σ0.005-0.009=-0.004
min0.385-0.389=-0.004
max0.397-0.407=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1295.407-1295.071=0.336
σ0.106-0.107=-0.001
min1295.290-1294.946=0.344
max1295.526-1295.213=0.313
mean1614.000-1634.000=-20.000
σ0.000
min1614.000-1634.000=-20.000
max1614.000-1634.000=-20.000
mean1.919-2.008=-0.089
σ0.110-0.122=-0.012
min1.822-1.833=-0.010
max2.060-2.168=-0.108
iters=5
new-facts=6402
prior-facts=1
mean1539.529-1539.206=0.323
σ6.812-6.839=-0.027
min1536.269-1535.958=0.311
max1551.709-1551.437=0.272
mean1614.000-1634.000=-20.000
σ0.000
min1614.000-1634.000=-20.000
max1614.000-1634.000=-20.000
mean2.313-2.155=0.158
σ0.132-0.139=-0.007
min2.182-2.043=0.138
max2.532-2.391=0.141
iters=5
new-facts=6402
prior-facts=6402
mean1857.317-1856.980=0.336
σ0.067-0.052=0.015
min1857.235-1856.936=0.299
max1857.403-1857.058=0.345
mean1775.400-1779.600=-4.200
σ182.796-125.532=57.264
min1614.000-1634.000=-20.000
max2035.000-1899.000=136.000
mean3.107-2.987=0.120
σ0.270-0.099=0.171
min2.862-2.832=0.029
max3.523-3.107=0.416

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.217-1.224=-0.006
σ0.321-0.212=0.109
min0.936-0.954=-0.018
max1.721-1.511=0.211

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.189-447.786=0.403
σ581.332-581.213=0.119
min157.520-157.179=0.341
max1320.187-1319.604=0.582
mean96.250
σ8.500
min92.000
max109.000
mean1614.000-1634.000=-20.000
σ0.000
min1614.000-1634.000=-20.000
max1614.000-1634.000=-20.000
mean0.570-0.543=0.027
σ0.597-0.566=0.031
min0.264-0.254=0.010
max1.465-1.393=0.073
policies=20
mean1575.553-1572.103=3.449
σ0.357-0.355=0.003
min1575.310-1571.863=3.447
max1576.083-1572.630=3.453
mean920.000
σ0.000
min920.000
max920.000
mean1614.000-1634.000=-20.000
σ0.000
min1614.000-1634.000=-20.000
max1614.000-1634.000=-20.000
mean2.631-2.631=-0.000
σ0.013-0.009=0.003
min2.615-2.622=-0.007
max2.644-2.639=0.005
policies=200
mean15763.688-15729.033=34.655
σ0.046-0.047=-0.001
min15763.625-15728.976=34.648
max15763.734-15729.077=34.658
mean9200.000
σ0.000
min9200.000
max9200.000
mean1614.000-1634.000=-20.000
σ0.000
min1614.000-1634.000=-20.000
max1614.000-1634.000=-20.000
mean26.545-26.501=0.044
σ0.094-0.032=0.062
min26.472-26.459=0.014
max26.670-26.535=0.136