Compare commits

Home / Compare 92a49110 .. bcf47afd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.800-54.126=-0.326
σ0.348-0.350=-0.001
min53.670-53.985=-0.315
max54.791-55.121=-0.330
mean420.000-418.000=2.000
σ0.000
min420.000-418.000=2.000
max420.000-418.000=2.000
mean0.137-0.140=-0.003
σ0.005-0.004=0.001
min0.130-0.137=-0.007
max0.144-0.147=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.079-43.403=-0.325
σ0.007-0.006=0.001
min43.072-43.395=-0.323
max43.094-43.411=-0.317
mean420.000-418.000=2.000
σ0.000
min420.000-418.000=2.000
max420.000-418.000=2.000
mean0.120-0.121=-0.001
σ0.005-0.005=0.000
min0.114-0.114=0.000
max0.128-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.108-1006.335=-1.228
σ0.895-0.873=0.022
min1004.643-1005.837=-1.194
max1008.818-1009.946=-1.128
mean1052.250-1049.850=2.400
σ314.070-310.455=3.615
min597.000-566.000=31.000
max1654.000-1641.000=13.000
mean1.622-1.522=0.100
σ0.080-0.066=0.015
min1.544-1.452=0.092
max1.862-1.644=0.219

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.882-0.882=0.000
σ0.002-0.002=-0.000
min0.881
max0.886
mean1654.000-1641.000=13.000
σ0.000
min1654.000-1641.000=13.000
max1654.000-1641.000=13.000
mean0.423-0.428=-0.005
σ0.131-0.134=-0.003
min0.350-0.339=0.011
max0.656-0.665=-0.009
name=error_case.art
mean2.335-2.334=0.000
σ0.003-0.003=0.001
min2.332
max2.339-2.337=0.002
mean1654.000-1641.000=13.000
σ0.000
min1654.000-1641.000=13.000
max1654.000-1641.000=13.000
mean0.895-0.882=0.014
σ0.095-0.090=0.005
min0.841-0.822=0.019
max1.065-1.040=0.025
name=heavy_item.art
mean1.521
σ0.001
min1.520
max1.523
mean1654.000-1641.000=13.000
σ0.000
min1654.000-1641.000=13.000
max1654.000-1641.000=13.000
mean0.554-0.544=0.010
σ0.039-0.054=-0.015
min0.518-0.500=0.018
max0.613-0.636=-0.022
name=nested_use.art
mean2.356
σ0.002
min2.355
max2.358
mean1654.000-1641.000=13.000
σ0.000
min1654.000-1641.000=13.000
max1654.000-1641.000=13.000
mean0.854-0.844=0.010
σ0.034-0.036=-0.001
min0.833-0.815=0.019
max0.914-0.901=0.013

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.551-963.552=-0.002
σ0.027-0.025=0.002
min963.523-963.535=-0.012
max963.593-963.592=0.002
mean1654.000-1641.000=13.000
σ0.000
min1654.000-1641.000=13.000
max1654.000-1641.000=13.000
mean0.838-0.853=-0.015
σ0.036-0.027=0.009
min0.795-0.805=-0.010
max0.876-0.871=0.005
name=cdr_enhanced_4k_loc.art
mean884.858-884.854=0.004
σ0.008-0.007=0.002
min884.847-884.848=-0.001
max884.869-884.864=0.005
mean1654.000-1641.000=13.000
σ0.000
min1654.000-1641.000=13.000
max1654.000-1641.000=13.000
mean0.728-0.730=-0.002
σ0.030-0.030=-0.001
min0.680-0.690=-0.010
max0.748-0.769=-0.020

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=-0.000
min7.705
max7.710-7.712=-0.003
mean1654.000-1641.000=13.000
σ0.000
min1654.000-1641.000=13.000
max1654.000-1641.000=13.000
mean3.588-4.293=-0.705
σ0.076-0.098=-0.023
min3.462-4.102=-0.640
max3.936-4.781=-0.845
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1654.000-1641.000=13.000
σ0.000
min1654.000-1641.000=13.000
max1654.000-1641.000=13.000
mean3.576-4.290=-0.714
σ0.093-0.114=-0.022
min3.433-4.133=-0.700
max4.240-5.016=-0.776
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1654.000-1641.000=13.000
σ0.000
min1654.000-1641.000=13.000
max1654.000-1641.000=13.000
mean0.761-0.763=-0.003
σ0.025-0.016=0.009
min0.720-0.730=-0.010
max0.914-0.850=0.064
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1654.000-1641.000=13.000
σ0.000
min1654.000-1641.000=13.000
max1654.000-1641.000=13.000
mean0.721-0.532=0.189
σ0.019-0.037=-0.018
min0.607-0.503=0.104
max0.780-0.790=-0.010

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.217-295.533=-1.316
σ0.234-0.190=0.044
min294.076-295.353=-1.277
max294.860-295.967=-1.107
mean1906.000-1913.000=-7.000
σ0.000
min1906.000-1913.000=-7.000
max1906.000-1913.000=-7.000
mean0.577-0.568=0.010
σ0.048-0.061=-0.014
min0.502-0.509=-0.007
max0.674-0.700=-0.026

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.493-285.254=-3.761
σ0.037-0.039=-0.001
min281.441-285.201=-3.760
max281.531-285.296=-3.765
mean1654.000-1641.000=13.000
σ0.000
min1654.000-1641.000=13.000
max1654.000-1641.000=13.000
mean0.389-0.401=-0.012
σ0.005-0.006=-0.001
min0.385-0.392=-0.007
max0.398-0.410=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1291.480-1295.199=-3.719
σ0.105-0.105=-0.001
min1291.365-1295.084=-3.719
max1291.594-1295.327=-3.733
mean1654.000-1641.000=13.000
σ0.000
min1654.000-1641.000=13.000
max1654.000-1641.000=13.000
mean1.903-1.911=-0.008
σ0.085-0.102=-0.017
min1.810-1.800=0.011
max1.988-2.034=-0.046
iters=5
new-facts=6402
prior-facts=1
mean1534.346-1538.128=-3.782
σ3.988-4.015=-0.027
min1532.339-1536.143=-3.804
max1541.471-1545.303=-3.832
mean1654.000-1641.000=13.000
σ0.000
min1654.000-1641.000=13.000
max1654.000-1641.000=13.000
mean2.333-2.362=-0.028
σ0.145-0.267=-0.122
min2.141-2.041=0.101
max2.505-2.618=-0.113
iters=5
new-facts=6402
prior-facts=6402
mean1853.358-1857.111=-3.753
σ0.056-0.055=0.001
min1853.302-1857.052=-3.750
max1853.437-1857.183=-3.745
mean1776.600-1779.800=-3.200
σ123.733-132.602=-8.869
min1654.000-1641.000=13.000
max1906.000-1913.000=-7.000
mean3.091-3.094=-0.003
σ0.375-0.319=0.056
min2.872-2.865=0.007
max3.758-3.653=0.105

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.426-1.430=-0.004
σ0.329-0.235=0.095
min1.105-1.128=-0.022
max1.869-1.719=0.150

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.432-443.613=-1.181
σ577.064-577.065=-0.001
min153.898-155.080=-1.181
max1308.028-1309.211=-1.182
mean96.250
σ8.500
min92.000
max109.000
mean1654.000-1641.000=13.000
σ0.000
min1654.000-1641.000=13.000
max1654.000-1641.000=13.000
mean0.543-0.551=-0.008
σ0.574-0.584=-0.009
min0.242-0.253=-0.010
max1.404-1.426=-0.022
policies=20
mean1539.254-1551.076=-11.821
σ0.324-0.337=-0.013
min1539.030-1550.848=-11.818
max1539.735-1551.576=-11.841
mean920.000
σ0.000
min920.000
max920.000
mean1654.000-1641.000=13.000
σ0.000
min1654.000-1641.000=13.000
max1654.000-1641.000=13.000
mean2.591-2.603=-0.012
σ0.033-0.022=0.010
min2.572-2.580=-0.008
max2.640-2.632=0.008
policies=200
mean15400.727-15518.809=-118.081
σ0.122-0.096=0.026
min15400.614-15518.728=-118.115
max15400.899-15518.928=-118.029
mean9200.000
σ0.000
min9200.000
max9200.000
mean1654.000-1641.000=13.000
σ0.000
min1654.000-1641.000=13.000
max1654.000-1641.000=13.000
mean26.034-26.170=-0.136
σ0.075-0.209=-0.134
min25.946-25.984=-0.039
max26.128-26.469=-0.341