Compare commits

Home / Compare 3137fbaf .. 20a990e7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.706-54.037=-0.332
σ0.367-0.368=-0.000
min53.565-53.891=-0.326
max54.751-55.083=-0.332
mean416.700-414.000=2.700
σ0.483-0.000=0.483
min416.000-414.000=2.000
max417.000-414.000=3.000
mean0.140-0.155=-0.015
σ0.003-0.012=-0.008
min0.136-0.138=-0.001
max0.146-0.169=-0.023
cache=y
dps=1
iters=10
policies=100
mean43.059-43.384=-0.325
σ0.006-0.006=0.000
min43.048-43.376=-0.328
max43.067-43.395=-0.328
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.123-0.123=0.000
σ0.004-0.005=-0.001
min0.118-0.116=0.003
max0.129-0.132=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.105-1006.331=-1.226
σ0.888-0.915=-0.028
min1004.637-1005.858=-1.221
max1008.782-1010.137=-1.355
mean1055.100-1048.600=6.500
σ321.597-310.201=11.395
min553.000-552.000=1.000
max1632.000-1642.000=-10.000
mean1.628-1.569=0.060
σ0.090-0.117=-0.027
min1.556-1.481=0.074
max1.879-1.866=0.012

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.882=0.001
σ0.002-0.002=0.000
min0.881
max0.886
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean0.418-0.421=-0.003
σ0.135-0.126=0.009
min0.335-0.340=-0.006
max0.658-0.644=0.014
name=error_case.art
mean2.333-2.334=-0.001
σ0.003-0.003=0.000
min2.332
max2.337
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean0.878-0.880=-0.002
σ0.086-0.080=0.006
min0.830-0.829=0.001
max1.031-1.019=0.012
name=heavy_item.art
mean1.521-1.521=0.001
σ0.002-0.001=0.001
min1.520
max1.524-1.523=0.001
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean0.542-0.537=0.005
σ0.057-0.053=0.003
min0.485-0.483=0.002
max0.636-0.625=0.012
name=nested_use.art
mean2.355-2.356=-0.001
σ0.002-0.002=-0.000
min2.355
max2.358
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean0.840-0.844=-0.003
σ0.039-0.038=0.002
min0.808-0.800=0.008
max0.904-0.901=0.003

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.554-963.551=0.003
σ0.026-0.025=0.001
min963.535-963.523=0.012
max963.599-963.584=0.015
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean0.827-0.845=-0.018
σ0.039-0.015=0.024
min0.773-0.819=-0.046
max0.860-0.856=0.005
name=cdr_enhanced_4k_loc.art
mean884.853-884.856=-0.003
σ0.008-0.007=0.001
min884.847
max884.866-884.865=0.001
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean0.713-0.739=-0.026
σ0.065-0.008=0.058
min0.596-0.730=-0.134
max0.746-0.751=-0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=0.000
min7.705
max7.712-7.709=0.003
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean4.266-4.254=0.012
σ0.067-0.081=-0.014
min4.148-4.116=0.031
max4.538-4.540=-0.002
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean4.265-4.229=0.036
σ0.069-0.069=-0.000
min4.144-4.078=0.066
max4.636-4.446=0.190
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean0.745-0.746=-0.001
σ0.016-0.018=-0.002
min0.717-0.715=0.002
max0.863-0.860=0.003
name=record_render_syntax_err.art
mean2.163-2.163=-0.000
σ0.002-0.002=0.000
min2.163
max2.166
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean0.703-0.690=0.013
σ0.016-0.069=-0.054
min0.678-0.502=0.175
max0.803-0.895=-0.092

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.342-295.603=-1.260
σ0.279-0.242=0.037
min294.065-295.430=-1.366
max295.075-296.271=-1.196
mean1974.000-1959.000=15.000
σ0.000
min1974.000-1959.000=15.000
max1974.000-1959.000=15.000
mean0.570-0.585=-0.015
σ0.067-0.016=0.051
min0.495-0.549=-0.055
max0.717-0.599=0.118

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.493-285.250=-3.757
σ0.036-0.042=-0.006
min281.453-285.198=-3.745
max281.529-285.297=-3.768
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean0.379-0.400=-0.021
σ0.001-0.011=-0.010
min0.378-0.388=-0.010
max0.380-0.411=-0.031
iters=5
new-facts=1
prior-facts=6402
mean1291.479-1295.192=-3.713
σ0.117-0.108=0.008
min1291.352-1295.067=-3.716
max1291.646-1295.327=-3.681
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean1.928-1.934=-0.006
σ0.109-0.058=0.051
min1.788-1.855=-0.067
max2.046-2.001=0.044
iters=5
new-facts=6402
prior-facts=1
mean1534.344-1538.085=-3.742
σ4.031-4.041=-0.010
min1532.322-1536.035=-3.713
max1541.543-1545.303=-3.760
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean2.349-2.308=0.041
σ0.263-0.130=0.133
min2.093-2.106=-0.013
max2.705-2.438=0.267
iters=5
new-facts=6402
prior-facts=6402
mean1853.374-1857.125=-3.751
σ0.078-0.083=-0.005
min1853.284-1857.023=-3.740
max1853.469-1857.223=-3.755
mean1802.800-1796.400=6.400
σ168.869-158.765=10.104
min1632.000-1642.000=-10.000
max1974.000-1959.000=15.000
mean3.253-3.220=0.033
σ0.334-0.338=-0.004
min2.892-2.895=-0.004
max3.656-3.688=-0.032

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.424-1.365=0.060
σ0.305-0.248=0.057
min1.102-1.107=-0.005
max1.873-1.764=0.109

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.429-443.609=-1.180
σ577.063-577.066=-0.002
min153.895-155.073=-1.178
max1308.024-1309.207=-1.184
mean96.250
σ8.500
min92.000
max109.000
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean0.521-0.536=-0.016
σ0.515-0.554=-0.040
min0.261-0.258=0.002
max1.293-1.368=-0.075
policies=20
mean1539.224-1551.037=-11.812
σ0.321-0.333=-0.012
min1538.999-1550.808=-11.809
max1539.700-1551.531=-11.831
mean920.000
σ0.000
min920.000
max920.000
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean2.573-2.591=-0.018
σ0.016-0.017=-0.001
min2.554-2.571=-0.017
max2.589-2.611=-0.023
policies=200
mean15400.365-15518.398=-118.033
σ0.085-0.062=0.023
min15400.270-15518.341=-118.071
max15400.467-15518.463=-117.996
mean9200.000
σ0.000
min9200.000
max9200.000
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean25.961-26.116=-0.155
σ0.075-0.056=0.019
min25.862-26.050=-0.189
max26.035-26.175=-0.141