Compare commits

Home / Compare 2bcf8d7a .. f09182b6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.014=0.001
σ0.371-0.368=0.003
min53.869-53.869=0.001
max55.069-55.061=0.009
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.140-0.138=0.002
σ0.004-0.004=0.000
min0.136-0.132=0.004
max0.146-0.144=0.002
cache=y
dps=1
iters=10
policies=100
mean43.322-43.325=-0.003
σ0.007-0.005=0.002
min43.308-43.319=-0.011
max43.333-43.333=0.000
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.120-0.125=-0.005
σ0.001-0.005=-0.004
min0.118-0.119=-0.001
max0.122-0.135=-0.013

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.311-1006.309=0.003
σ1.159-1.175=-0.016
min1005.742-1005.764=-0.021
max1011.161-1011.227=-0.066
mean1045.350-1043.500=1.850
σ313.737-312.030=1.707
min595.000
max1642.000-1633.000=9.000
mean1.537-1.554=-0.017
σ0.078-0.078=0.000
min1.448-1.471=-0.023
max1.758-1.789=-0.031

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1642.000-1633.000=9.000
σ0.000
min1642.000-1633.000=9.000
max1642.000-1633.000=9.000
mean0.391-0.407=-0.017
σ0.109-0.144=-0.035
min0.321-0.323=-0.002
max0.583-0.661=-0.078
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1642.000-1633.000=9.000
σ0.000
min1642.000-1633.000=9.000
max1642.000-1633.000=9.000
mean0.882-0.906=-0.024
σ0.094-0.103=-0.010
min0.816-0.805=0.012
max1.045-1.056=-0.010
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1642.000-1633.000=9.000
σ0.000
min1642.000-1633.000=9.000
max1642.000-1633.000=9.000
mean0.540-0.534=0.006
σ0.054-0.044=0.010
min0.490-0.490=0.001
max0.632-0.603=0.029
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1642.000-1633.000=9.000
σ0.000
min1642.000-1633.000=9.000
max1642.000-1633.000=9.000
mean0.834-0.834=0.000
σ0.030-0.039=-0.009
min0.809-0.793=0.016
max0.881-0.897=-0.015

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.115=-0.000
σ0.034-0.035=-0.001
min964.086-964.087=-0.001
max964.171-964.172=-0.001
mean1642.000-1633.000=9.000
σ0.000
min1642.000-1633.000=9.000
max1642.000-1633.000=9.000
mean0.839-0.795=0.044
σ0.032-0.033=-0.001
min0.789-0.762=0.028
max0.871-0.846=0.025
name=cdr_enhanced_4k_loc.art
mean884.711-884.712=-0.001
σ0.008-0.008=0.000
min884.703
max884.723-884.722=0.001
mean1642.000-1633.000=9.000
σ0.000
min1642.000-1633.000=9.000
max1642.000-1633.000=9.000
mean0.721-0.714=0.007
σ0.011-0.025=-0.014
min0.708-0.683=0.025
max0.738-0.745=-0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.718
mean1642.000-1633.000=9.000
σ0.000
min1642.000-1633.000=9.000
max1642.000-1633.000=9.000
mean4.254-4.272=-0.018
σ0.077-0.079=-0.002
min4.124-4.140=-0.016
max4.478-4.525=-0.047
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1642.000-1633.000=9.000
σ0.000
min1642.000-1633.000=9.000
max1642.000-1633.000=9.000
mean4.238-4.259=-0.020
σ0.153-0.085=0.068
min4.077-4.108=-0.031
max5.452-4.573=0.878
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1642.000-1633.000=9.000
σ0.000
min1642.000-1633.000=9.000
max1642.000-1633.000=9.000
mean0.758-0.740=0.017
σ0.041-0.022=0.019
min0.542-0.708=-0.166
max0.868-0.871=-0.003
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1642.000-1633.000=9.000
σ0.000
min1642.000-1633.000=9.000
max1642.000-1633.000=9.000
mean0.715-0.707=0.008
σ0.032-0.015=0.017
min0.654-0.678=-0.025
max0.815-0.777=0.037

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.263-296.314=-0.051
σ0.253-0.239=0.014
min296.085-296.131=-0.046
max296.961-296.931=0.031
mean1915.000-1916.000=-1.000
σ0.000
min1915.000-1916.000=-1.000
max1915.000-1916.000=-1.000
mean0.572-0.581=-0.009
σ0.038-0.042=-0.004
min0.516-0.524=-0.008
max0.630-0.684=-0.054

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.695-284.698=-0.003
σ0.033-0.029=0.003
min284.661-284.665=-0.004
max284.737-284.733=0.004
mean1642.000-1633.000=9.000
σ0.000
min1642.000-1633.000=9.000
max1642.000-1633.000=9.000
mean0.402-0.397=0.005
σ0.017-0.010=0.008
min0.386-0.386=-0.001
max0.428-0.407=0.020
iters=5
new-facts=1
prior-facts=6402
mean1295.076-1295.076=0.000
σ0.106-0.107=-0.001
min1294.953-1294.962=-0.009
max1295.203-1295.206=-0.003
mean1642.000-1633.000=9.000
σ0.000
min1642.000-1633.000=9.000
max1642.000-1633.000=9.000
mean1.943-1.917=0.025
σ0.124-0.097=0.027
min1.805-1.817=-0.012
max2.134-2.050=0.084
iters=5
new-facts=6402
prior-facts=1
mean1539.230-1539.185=0.045
σ6.844-6.869=-0.025
min1535.929-1535.935=-0.006
max1551.467-1551.469=-0.002
mean1642.000-1633.000=9.000
σ0.000
min1642.000-1633.000=9.000
max1642.000-1633.000=9.000
mean2.367-2.261=0.106
σ0.231-0.252=-0.021
min2.058-2.016=0.042
max2.687-2.554=0.133
iters=5
new-facts=6402
prior-facts=6402
mean1856.979-1856.988=-0.008
σ0.060-0.054=0.006
min1856.923-1856.931=-0.008
max1857.064-1857.063=0.001
mean1772.600-1773.200=-0.600
σ137.136-138.700=-1.564
min1642.000-1633.000=9.000
max1915.000-1916.000=-1.000
mean3.068-3.088=-0.019
σ0.263-0.296=-0.033
min2.861-2.872=-0.010
max3.525-3.599=-0.074

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.190-1.226=-0.036
σ0.360-0.343=0.017
min0.924-0.932=-0.008
max1.788-1.807=-0.019

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.785=0.001
σ581.212-581.211=0.001
min157.178-157.178=0.000
max1319.605-1319.602=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1642.000-1633.000=9.000
σ0.000
min1642.000-1633.000=9.000
max1642.000-1633.000=9.000
mean0.534-0.557=-0.023
σ0.546-0.594=-0.048
min0.257-0.260=-0.003
max1.353-1.448=-0.095
policies=20
mean1572.102-1572.101=0.000
σ0.352-0.349=0.003
min1571.864-1571.863=0.001
max1572.626-1572.620=0.006
mean920.000
σ0.000
min920.000
max920.000
mean1642.000-1633.000=9.000
σ0.000
min1642.000-1633.000=9.000
max1642.000-1633.000=9.000
mean2.619-2.617=0.002
σ0.022-0.020=0.003
min2.591-2.589=0.002
max2.646-2.632=0.013
policies=200
mean15729.050-15729.012=0.039
σ0.053-0.053=0.000
min15728.977-15728.933=0.044
max15729.103-15729.047=0.056
mean9200.000
σ0.000
min9200.000
max9200.000
mean1642.000-1633.000=9.000
σ0.000
min1642.000-1633.000=9.000
max1642.000-1633.000=9.000
mean26.511-26.488=0.023
σ0.048-0.111=-0.063
min26.477-26.373=0.105
max26.582-26.637=-0.055