Module TokenStream
In: tokenstream.rb
doc-tmp/rdoc/tokenstream.rb

A TokenStream is a list of tokens, gathered during the parse of some entity (say a method). Entities populate these streams by being registered with the lexer. Any class can collect tokens by including TokenStream. From the outside, you use such an object by calling the start_collecting_tokens method, followed by calls to add_token and pop_token

Methods

add_token   add_token   add_tokens   add_tokens   pop_token   pop_token   start_collecting_tokens   start_collecting_tokens   token_stream   token_stream  

Public Instance methods

add_token(tk)

[Source]

    # File doc-tmp/rdoc/tokenstream.rb, line 16
16:   def add_token(tk)
17:     @token_stream << tk
18:   end
add_token(tk)

[Source]

    # File tokenstream.rb, line 16
16:   def add_token(tk)
17:     @token_stream << tk
18:   end
add_tokens(tks)

[Source]

    # File doc-tmp/rdoc/tokenstream.rb, line 19
19:   def add_tokens(tks)
20:     tks.each  {|tk| add_token(tk)}
21:   end
add_tokens(tks)

[Source]

    # File tokenstream.rb, line 19
19:   def add_tokens(tks)
20:     tks.each  {|tk| add_token(tk)}
21:   end
pop_token()

[Source]

    # File tokenstream.rb, line 22
22:   def pop_token
23:     @token_stream.pop
24:   end
pop_token()

[Source]

    # File doc-tmp/rdoc/tokenstream.rb, line 22
22:   def pop_token
23:     @token_stream.pop
24:   end
start_collecting_tokens()

[Source]

    # File doc-tmp/rdoc/tokenstream.rb, line 13
13:   def start_collecting_tokens
14:     @token_stream = []
15:   end
start_collecting_tokens()

[Source]

    # File tokenstream.rb, line 13
13:   def start_collecting_tokens
14:     @token_stream = []
15:   end
token_stream()

[Source]

    # File doc-tmp/rdoc/tokenstream.rb, line 9
 9:   def token_stream
10:     @token_stream
11:   end
token_stream()

[Source]

    # File tokenstream.rb, line 9
 9:   def token_stream
10:     @token_stream
11:   end

[Validate]