Compare commits

Home / Compare bcf47afd .. 8f1714fe

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.799-53.800=-0.001
σ0.350-0.348=0.001
min53.660-53.670=-0.010
max54.793-54.791=0.002
mean413.000-420.000=-7.000
σ0.000
min413.000-420.000=-7.000
max413.000-420.000=-7.000
mean0.138-0.137=0.001
σ0.005-0.005=0.000
min0.134-0.130=0.004
max0.146-0.144=0.003
cache=y
dps=1
iters=10
policies=100
mean43.079-43.079=0.000
σ0.005-0.007=-0.002
min43.072-43.072=-0.000
max43.087-43.094=-0.007
mean413.000-420.000=-7.000
σ0.000
min413.000-420.000=-7.000
max413.000-420.000=-7.000
mean0.122-0.120=0.002
σ0.004-0.005=-0.001
min0.118-0.114=0.004
max0.130-0.128=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.105-1005.108=-0.002
σ0.880-0.895=-0.014
min1004.634-1004.643=-0.009
max1008.752-1008.818=-0.066
mean1061.450-1052.250=9.200
σ328.675-314.070=14.605
min549.000-597.000=-48.000
max1629.000-1654.000=-25.000
mean1.596-1.622=-0.026
σ0.089-0.080=0.008
min1.521-1.544=-0.023
max1.846-1.862=-0.016

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.882=0.001
σ0.002-0.002=0.000
min0.881
max0.886
mean1629.000-1654.000=-25.000
σ0.000
min1629.000-1654.000=-25.000
max1629.000-1654.000=-25.000
mean0.430-0.423=0.007
σ0.123-0.131=-0.009
min0.351-0.350=0.001
max0.646-0.656=-0.010
name=error_case.art
mean2.333-2.335=-0.001
σ0.003-0.003=-0.000
min2.332
max2.337-2.339=-0.002
mean1629.000-1654.000=-25.000
σ0.000
min1629.000-1654.000=-25.000
max1629.000-1654.000=-25.000
mean0.896-0.895=0.000
σ0.060-0.095=-0.035
min0.856-0.841=0.015
max1.002-1.065=-0.063
name=heavy_item.art
mean1.521-1.521=0.001
σ0.002-0.001=0.001
min1.520
max1.524-1.523=0.001
mean1629.000-1654.000=-25.000
σ0.000
min1629.000-1654.000=-25.000
max1629.000-1654.000=-25.000
mean0.547-0.554=-0.007
σ0.040-0.039=0.001
min0.516-0.518=-0.002
max0.614-0.613=0.001
name=nested_use.art
mean2.356-2.356=-0.000
σ0.002-0.002=-0.000
min2.355
max2.358
mean1629.000-1654.000=-25.000
σ0.000
min1629.000-1654.000=-25.000
max1629.000-1654.000=-25.000
mean0.857-0.854=0.003
σ0.031-0.034=-0.004
min0.838-0.833=0.005
max0.912-0.914=-0.003

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.557-963.551=0.006
σ0.029-0.027=0.002
min963.523
max963.603-963.593=0.010
mean1629.000-1654.000=-25.000
σ0.000
min1629.000-1654.000=-25.000
max1629.000-1654.000=-25.000
mean0.812-0.838=-0.026
σ0.062-0.036=0.026
min0.740-0.795=-0.055
max0.860-0.876=-0.016
name=cdr_enhanced_4k_loc.art
mean884.856-884.858=-0.002
σ0.006-0.008=-0.003
min884.847
max884.862-884.869=-0.007
mean1629.000-1654.000=-25.000
σ0.000
min1629.000-1654.000=-25.000
max1629.000-1654.000=-25.000
mean0.743-0.728=0.014
σ0.009-0.030=-0.021
min0.727-0.680=0.047
max0.750-0.748=0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=-0.000
min7.705
max7.711-7.710=0.001
mean1629.000-1654.000=-25.000
σ0.000
min1629.000-1654.000=-25.000
max1629.000-1654.000=-25.000
mean4.252-3.588=0.664
σ0.085-0.076=0.009
min4.110-3.462=0.648
max4.610-3.936=0.674
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1629.000-1654.000=-25.000
σ0.000
min1629.000-1654.000=-25.000
max1629.000-1654.000=-25.000
mean4.247-3.576=0.672
σ0.088-0.093=-0.005
min4.126-3.433=0.693
max4.663-4.240=0.423
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1629.000-1654.000=-25.000
σ0.000
min1629.000-1654.000=-25.000
max1629.000-1654.000=-25.000
mean0.751-0.761=-0.010
σ0.022-0.025=-0.003
min0.662-0.720=-0.059
max0.884-0.914=-0.030
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1629.000-1654.000=-25.000
σ0.000
min1629.000-1654.000=-25.000
max1629.000-1654.000=-25.000
mean0.711-0.721=-0.010
σ0.017-0.019=-0.002
min0.676-0.607=0.069
max0.792-0.780=0.012

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.276-294.217=0.058
σ0.200-0.234=-0.034
min294.140-294.076=0.064
max294.817-294.860=-0.043
mean1932.000-1906.000=26.000
σ0.000
min1932.000-1906.000=26.000
max1932.000-1906.000=26.000
mean0.594-0.577=0.016
σ0.027-0.048=-0.020
min0.539-0.502=0.037
max0.647-0.674=-0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.499-281.493=0.006
σ0.039-0.037=0.002
min281.454-281.441=0.013
max281.540-281.531=0.010
mean1629.000-1654.000=-25.000
σ0.000
min1629.000-1654.000=-25.000
max1629.000-1654.000=-25.000
mean0.386-0.389=-0.003
σ0.007-0.005=0.002
min0.376-0.385=-0.008
max0.392-0.398=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1291.488-1291.480=0.009
σ0.113-0.105=0.009
min1291.367-1291.365=0.002
max1291.630-1291.594=0.036
mean1629.000-1654.000=-25.000
σ0.000
min1629.000-1654.000=-25.000
max1629.000-1654.000=-25.000
mean1.905-1.903=0.003
σ0.097-0.085=0.012
min1.802-1.810=-0.008
max2.019-1.988=0.031
iters=5
new-facts=6402
prior-facts=1
mean1534.353-1534.346=0.007
σ4.008-3.988=0.020
min1532.323-1532.339=-0.015
max1541.512-1541.471=0.041
mean1629.000-1654.000=-25.000
σ0.000
min1629.000-1654.000=-25.000
max1629.000-1654.000=-25.000
mean2.359-2.333=0.026
σ0.204-0.145=0.058
min2.110-2.141=-0.031
max2.566-2.505=0.061
iters=5
new-facts=6402
prior-facts=6402
mean1853.377-1853.358=0.019
σ0.088-0.056=0.032
min1853.276-1853.302=-0.026
max1853.470-1853.437=0.033
mean1777.200-1776.600=0.600
σ151.680-123.733=27.947
min1629.000-1654.000=-25.000
max1932.000-1906.000=26.000
mean2.934-3.091=-0.157
σ0.110-0.375=-0.266
min2.837-2.872=-0.036
max3.093-3.758=-0.665

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.330-1.426=-0.096
σ0.247-0.329=-0.082
min1.112-1.105=0.007
max1.705-1.869=-0.164

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.430-442.432=-0.002
σ577.065-577.064=0.000
min153.896-153.898=-0.002
max1308.027-1308.028=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1629.000-1654.000=-25.000
σ0.000
min1629.000-1654.000=-25.000
max1629.000-1654.000=-25.000
mean0.537-0.543=-0.006
σ0.555-0.574=-0.020
min0.258-0.242=0.016
max1.369-1.404=-0.035
policies=20
mean1539.227-1539.254=-0.027
σ0.316-0.324=-0.008
min1539.008-1539.030=-0.022
max1539.696-1539.735=-0.039
mean920.000
σ0.000
min920.000
max920.000
mean1629.000-1654.000=-25.000
σ0.000
min1629.000-1654.000=-25.000
max1629.000-1654.000=-25.000
mean2.564-2.591=-0.027
σ0.010-0.033=-0.023
min2.556-2.572=-0.016
max2.576-2.640=-0.064
policies=200
mean15400.706-15400.727=-0.022
σ0.141-0.122=0.019
min15400.565-15400.614=-0.048
max15400.902-15400.899=0.003
mean9200.000
σ0.000
min9200.000
max9200.000
mean1629.000-1654.000=-25.000
σ0.000
min1629.000-1654.000=-25.000
max1629.000-1654.000=-25.000
mean26.058-26.034=0.024
σ0.127-0.075=0.052
min25.957-25.946=0.011
max26.228-26.128=0.100