Compare commits

Home / Compare a0725c4b .. fc73132c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.016-54.014=0.001
σ0.369-0.368=0.001
min53.876-53.869=0.007
max55.065-55.061=0.005
mean416.900-415.000=1.900
σ0.316-0.000=0.316
min416.000-415.000=1.000
max417.000-415.000=2.000
mean0.140-0.138=0.001
σ0.004-0.004=-0.000
min0.133-0.132=0.001
max0.146-0.144=0.003
cache=y
dps=1
iters=10
policies=100
mean43.322-43.325=-0.003
σ0.006-0.005=0.001
min43.314-43.319=-0.005
max43.337-43.333=0.005
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.120-0.125=-0.005
σ0.003-0.005=-0.002
min0.115-0.119=-0.004
max0.124-0.135=-0.011

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1006.309=0.001
σ1.162-1.175=-0.013
min1005.741-1005.764=-0.023
max1011.177-1011.227=-0.050
mean1044.400-1043.500=0.900
σ312.550-312.030=0.520
min577.000-595.000=-18.000
max1634.000-1633.000=1.000
mean1.564-1.554=0.010
σ0.094-0.078=0.016
min1.473-1.471=0.001
max1.833-1.789=0.044

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1634.000-1633.000=1.000
σ0.000
min1634.000-1633.000=1.000
max1634.000-1633.000=1.000
mean0.408-0.407=0.001
σ0.136-0.144=-0.008
min0.327-0.323=0.004
max0.649-0.661=-0.012
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1634.000-1633.000=1.000
σ0.000
min1634.000-1633.000=1.000
max1634.000-1633.000=1.000
mean0.890-0.906=-0.016
σ0.088-0.103=-0.015
min0.838-0.805=0.033
max1.047-1.056=-0.009
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1634.000-1633.000=1.000
σ0.000
min1634.000-1633.000=1.000
max1634.000-1633.000=1.000
mean0.544-0.534=0.010
σ0.054-0.044=0.010
min0.512-0.490=0.022
max0.639-0.603=0.036
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1634.000-1633.000=1.000
σ0.000
min1634.000-1633.000=1.000
max1634.000-1633.000=1.000
mean0.850-0.834=0.016
σ0.039-0.039=0.000
min0.825-0.793=0.032
max0.919-0.897=0.022

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.115=-0.000
σ0.035-0.035=0.000
min964.086-964.087=-0.000
max964.173-964.172=0.001
mean1634.000-1633.000=1.000
σ0.000
min1634.000-1633.000=1.000
max1634.000-1633.000=1.000
mean0.832-0.795=0.037
σ0.043-0.033=0.010
min0.765-0.762=0.003
max0.867-0.846=0.021
name=cdr_enhanced_4k_loc.art
mean884.711-884.712=-0.000
σ0.008-0.008=0.000
min884.703
max884.723-884.722=0.001
mean1634.000-1633.000=1.000
σ0.000
min1634.000-1633.000=1.000
max1634.000-1633.000=1.000
mean0.683-0.714=-0.032
σ0.073-0.025=0.048
min0.595-0.683=-0.088
max0.742-0.745=-0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718
mean1634.000-1633.000=1.000
σ0.000
min1634.000-1633.000=1.000
max1634.000-1633.000=1.000
mean4.261-4.272=-0.011
σ0.102-0.079=0.024
min4.103-4.140=-0.036
max4.732-4.525=0.207
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.666
mean1634.000-1633.000=1.000
σ0.000
min1634.000-1633.000=1.000
max1634.000-1633.000=1.000
mean4.211-4.259=-0.048
σ0.086-0.085=0.001
min4.065-4.108=-0.043
max4.467-4.573=-0.106
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1634.000-1633.000=1.000
σ0.000
min1634.000-1633.000=1.000
max1634.000-1633.000=1.000
mean0.742-0.740=0.002
σ0.020-0.022=-0.001
min0.719-0.708=0.011
max0.895-0.871=0.025
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1634.000-1633.000=1.000
σ0.000
min1634.000-1633.000=1.000
max1634.000-1633.000=1.000
mean0.705-0.707=-0.002
σ0.016-0.015=0.001
min0.671-0.678=-0.007
max0.791-0.777=0.013

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.324-296.314=0.009
σ0.165-0.239=-0.075
min296.191-296.131=0.060
max296.751-296.931=-0.179
mean1899.000-1916.000=-17.000
σ0.000
min1899.000-1916.000=-17.000
max1899.000-1916.000=-17.000
mean0.603-0.581=0.022
σ0.016-0.042=-0.026
min0.574-0.524=0.050
max0.635-0.684=-0.049

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.694-284.698=-0.005
σ0.038-0.029=0.009
min284.640-284.665=-0.025
max284.732-284.733=-0.002
mean1634.000-1633.000=1.000
σ0.000
min1634.000-1633.000=1.000
max1634.000-1633.000=1.000
mean0.398-0.397=0.001
σ0.009-0.010=-0.001
min0.389-0.386=0.003
max0.407-0.407=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.071-1295.076=-0.005
σ0.107-0.107=0.000
min1294.946-1294.962=-0.016
max1295.213-1295.206=0.007
mean1634.000-1633.000=1.000
σ0.000
min1634.000-1633.000=1.000
max1634.000-1633.000=1.000
mean2.008-1.917=0.090
σ0.122-0.097=0.026
min1.833-1.817=0.016
max2.168-2.050=0.118
iters=5
new-facts=6402
prior-facts=1
mean1539.206-1539.185=0.021
σ6.839-6.869=-0.030
min1535.958-1535.935=0.022
max1551.437-1551.469=-0.032
mean1634.000-1633.000=1.000
σ0.000
min1634.000-1633.000=1.000
max1634.000-1633.000=1.000
mean2.155-2.261=-0.106
σ0.139-0.252=-0.113
min2.043-2.016=0.028
max2.391-2.554=-0.163
iters=5
new-facts=6402
prior-facts=6402
mean1856.980-1856.988=-0.007
σ0.052-0.054=-0.001
min1856.936-1856.931=0.006
max1857.058-1857.063=-0.005
mean1779.600-1773.200=6.400
σ125.532-138.700=-13.168
min1634.000-1633.000=1.000
max1899.000-1916.000=-17.000
mean2.987-3.088=-0.101
σ0.099-0.296=-0.197
min2.832-2.872=-0.039
max3.107-3.599=-0.492

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.224-1.226=-0.003
σ0.212-0.343=-0.131
min0.954-0.932=0.022
max1.511-1.807=-0.296

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.785=0.000
σ581.213-581.211=0.001
min157.179-157.178=0.000
max1319.604-1319.602=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1634.000-1633.000=1.000
σ0.000
min1634.000-1633.000=1.000
max1634.000-1633.000=1.000
mean0.543-0.557=-0.014
σ0.566-0.594=-0.028
min0.254-0.260=-0.005
max1.393-1.448=-0.056
policies=20
mean1572.103-1572.101=0.002
σ0.355-0.349=0.005
min1571.863-1571.863=0.001
max1572.630-1572.620=0.010
mean920.000
σ0.000
min920.000
max920.000
mean1634.000-1633.000=1.000
σ0.000
min1634.000-1633.000=1.000
max1634.000-1633.000=1.000
mean2.631-2.617=0.014
σ0.009-0.020=-0.011
min2.622-2.589=0.033
max2.639-2.632=0.007
policies=200
mean15729.033-15729.012=0.021
σ0.047-0.053=-0.006
min15728.976-15728.933=0.043
max15729.077-15729.047=0.030
mean9200.000
σ0.000
min9200.000
max9200.000
mean1634.000-1633.000=1.000
σ0.000
min1634.000-1633.000=1.000
max1634.000-1633.000=1.000
mean26.501-26.488=0.013
σ0.032-0.111=-0.080
min26.459-26.373=0.086
max26.535-26.637=-0.102