Class Dhaka::TokenizerState
In: ../trunk/lib/dhaka/tokenizer/tokenizer.rb
Parent: Object

A tokenizer state encapsulates actions that should be performed upon encountering each permissible character for that state.



actions  [R] 
default_action  [R] 

Public Class methods

Public Instance methods

for_character(characters, &blk)

Alias for for_characters

Define the action (blk) to be performed when encountering any of characters in the token stream.

define the action (blk) to be performed for any characters that don‘t have an action to perform.