Class Dhaka::LexerRun
In: ../trunk/lib/dhaka/lexer/lexer_run.rb
Parent: Object

Represents a run of a lexer on a given input string.

Methods

create_token   each   new  

Included Modules

Enumerable

Attributes

current_lexeme  [R] 

Public Class methods

Public Instance methods

Constructs a token of type symbol_name from the current_lexeme.

Yields each token as it is recognized. Returns a TokenizerErrorResult if an error occurs during tokenization.

[Validate]