Compare commits

Home / Compare a7a5e0a7 .. 8e32add1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.703-53.705=-0.002
σ0.367-0.368=-0.001
min53.559-53.568=-0.009
max54.748-54.754=-0.006
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.137-0.138=-0.002
σ0.004-0.004=0.000
min0.131-0.135=-0.004
max0.143-0.145=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.058-43.059=-0.001
σ0.005-0.006=-0.001
min43.052-43.050=0.001
max43.067-43.070=-0.003
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.120-0.120=-0.000
σ0.005-0.004=0.001
min0.113-0.114=-0.001
max0.128-0.126=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.111-1005.108=0.003
σ0.866-0.885=-0.019
min1004.618-1004.638=-0.020
max1008.684-1008.776=-0.092
mean1053.900-1050.250=3.650
σ321.349-315.021=6.328
min553.000-594.000=-41.000
max1633.000-1654.000=-21.000
mean1.638-1.615=0.024
σ0.089-0.086=0.003
min1.558-1.499=0.059
max1.853-1.867=-0.014

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.882=0.000
σ0.002-0.002=0.000
min0.881
max0.886-0.886=-0.000
mean1633.000-1654.000=-21.000
σ0.000
min1633.000-1654.000=-21.000
max1633.000-1654.000=-21.000
mean0.440-0.422=0.017
σ0.171-0.135=0.036
min0.337-0.344=-0.007
max0.744-0.663=0.081
name=error_case.art
mean2.333-2.335=-0.001
σ0.003-0.003=-0.000
min2.332
max2.337-2.339=-0.002
mean1633.000-1654.000=-21.000
σ0.000
min1633.000-1654.000=-21.000
max1633.000-1654.000=-21.000
mean0.932-0.876=0.057
σ0.168-0.093=0.075
min0.842-0.818=0.025
max1.232-1.040=0.192
name=heavy_item.art
mean1.521-1.521=0.001
σ0.002-0.001=0.000
min1.520
max1.524-1.523=0.001
mean1633.000-1654.000=-21.000
σ0.000
min1633.000-1654.000=-21.000
max1633.000-1654.000=-21.000
mean0.548-0.550=-0.001
σ0.051-0.043=0.008
min0.516-0.519=-0.004
max0.639-0.626=0.013
name=nested_use.art
mean2.355-2.356=-0.001
σ0.002-0.002=-0.000
min2.355
max2.358
mean1633.000-1654.000=-21.000
σ0.000
min1633.000-1654.000=-21.000
max1633.000-1654.000=-21.000
mean0.854-0.850=0.004
σ0.033-0.040=-0.006
min0.819-0.822=-0.003
max0.906-0.917=-0.011

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.553-963.551=0.002
σ0.024-0.024=0.000
min963.523
max963.582-963.580=0.002
mean1633.000-1654.000=-21.000
σ0.000
min1633.000-1654.000=-21.000
max1633.000-1654.000=-21.000
mean0.855-0.839=0.016
σ0.013-0.028=-0.015
min0.832-0.791=0.040
max0.865-0.861=0.003
name=cdr_enhanced_4k_loc.art
mean884.855-884.857=-0.001
σ0.008-0.003=0.004
min884.847-884.852=-0.005
max884.865-884.860=0.005
mean1633.000-1654.000=-21.000
σ0.000
min1633.000-1654.000=-21.000
max1633.000-1654.000=-21.000
mean0.698-0.744=-0.045
σ0.039-0.009=0.031
min0.663-0.735=-0.072
max0.744-0.756=-0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=-0.000
min7.705
max7.709
mean1633.000-1654.000=-21.000
σ0.000
min1633.000-1654.000=-21.000
max1633.000-1654.000=-21.000
mean4.237-4.276=-0.039
σ0.085-0.089=-0.005
min4.118-4.167=-0.049
max4.553-4.656=-0.103
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1633.000-1654.000=-21.000
σ0.000
min1633.000-1654.000=-21.000
max1633.000-1654.000=-21.000
mean4.221-4.262=-0.041
σ0.075-0.072=0.003
min4.085-4.128=-0.043
max4.514-4.489=0.026
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1633.000-1654.000=-21.000
σ0.000
min1633.000-1654.000=-21.000
max1633.000-1654.000=-21.000
mean0.741-0.591=0.150
σ0.017-0.097=-0.080
min0.707-0.516=0.191
max0.831-0.858=-0.027
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1633.000-1654.000=-21.000
σ0.000
min1633.000-1654.000=-21.000
max1633.000-1654.000=-21.000
mean0.706-0.506=0.200
σ0.013-0.021=-0.008
min0.681-0.329=0.353
max0.775-0.548=0.228

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.182-294.261=-0.079
σ0.241-0.191=0.051
min294.009-294.059=-0.050
max294.852-294.734=0.117
mean1935.000-1904.000=31.000
σ0.000
min1935.000-1904.000=31.000
max1935.000-1904.000=31.000
mean0.583-0.609=-0.027
σ0.050-0.037=0.013
min0.518-0.570=-0.052
max0.695-0.707=-0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.493-281.496=-0.003
σ0.043-0.035=0.008
min281.439-281.452=-0.013
max281.537-281.533=0.004
mean1633.000-1654.000=-21.000
σ0.000
min1633.000-1654.000=-21.000
max1633.000-1654.000=-21.000
mean0.388-0.387=0.001
σ0.006-0.006=0.000
min0.379-0.379=0.000
max0.394-0.391=0.002
iters=5
new-facts=1
prior-facts=6402
mean1291.481-1291.484=-0.003
σ0.113-0.115=-0.002
min1291.359-1291.365=-0.006
max1291.619-1291.652=-0.033
mean1633.000-1654.000=-21.000
σ0.000
min1633.000-1654.000=-21.000
max1633.000-1654.000=-21.000
mean1.932-1.874=0.057
σ0.106-0.082=0.024
min1.810-1.804=0.006
max2.019-2.005=0.014
iters=5
new-facts=6402
prior-facts=1
mean1534.394-1534.358=0.036
σ3.999-3.978=0.022
min1532.408-1532.410=-0.002
max1541.539-1541.469=0.070
mean1633.000-1654.000=-21.000
σ0.000
min1633.000-1654.000=-21.000
max1633.000-1654.000=-21.000
mean2.427-2.132=0.295
σ0.316-0.192=0.124
min2.110-1.874=0.236
max2.830-2.359=0.471
iters=5
new-facts=6402
prior-facts=6402
mean1853.354-1853.362=-0.008
σ0.055-0.052=0.002
min1853.306-1853.304=0.002
max1853.434-1853.430=0.004
mean1779.600-1775.400=4.200
σ151.320-122.796=28.524
min1633.000-1654.000=-21.000
max1935.000-1904.000=31.000
mean3.049-3.083=-0.034
σ0.136-0.273=-0.137
min2.881-2.855=0.026
max3.212-3.550=-0.338

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.348-1.340=0.008
σ0.344-0.250=0.094
min1.113-1.112=0.001
max1.945-1.768=0.177

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.429-442.429=0.000
σ577.064-577.065=-0.001
min153.896-153.894=0.002
max1308.025-1308.026=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1633.000-1654.000=-21.000
σ0.000
min1633.000-1654.000=-21.000
max1633.000-1654.000=-21.000
mean0.537-0.550=-0.014
σ0.551-0.583=-0.032
min0.257-0.257=0.000
max1.363-1.425=-0.062
policies=20
mean1539.226-1539.222=0.003
σ0.325-0.315=0.009
min1539.001-1539.004=-0.003
max1539.707-1539.690=0.017
mean920.000
σ0.000
min920.000
max920.000
mean1633.000-1654.000=-21.000
σ0.000
min1633.000-1654.000=-21.000
max1633.000-1654.000=-21.000
mean2.586-2.569=0.017
σ0.013-0.010=0.003
min2.571-2.560=0.011
max2.598-2.583=0.015
policies=200
mean15400.460-15400.350=0.110
σ0.092-0.088=0.004
min15400.364-15400.221=0.143
max15400.585-15400.406=0.179
mean9200.000
σ0.000
min9200.000
max9200.000
mean1633.000-1654.000=-21.000
σ0.000
min1633.000-1654.000=-21.000
max1633.000-1654.000=-21.000
mean26.158-26.194=-0.036
σ0.065-0.263=-0.198
min26.108-26.055=0.053
max26.254-26.589=-0.335