- 3.0.1 core module.
cpp.tokenize.Token Class Reference
Inheritance diagram for cpp.tokenize.Token:

Public Member Functions

def __init__ (self, token_type, name, start, end)
 
def __str__ (self)
 

Public Attributes

 token_type
 
 name
 
 start
 
 end
 
 whence
 

Detailed Description

Data container to represent a C++ token.

Tokens can be identifiers, syntax char(s), constants, or
pre-processor directives.

start contains the index of the first char of the token in the source
end contains the index of the last char of the token in the source

Constructor & Destructor Documentation

def cpp.tokenize.Token.__init__ (   self,
  token_type,
  name,
  start,
  end 
)

Member Function Documentation

Member Data Documentation

cpp.tokenize.Token.token_type
cpp.tokenize.Token.name
cpp.tokenize.Token.start
cpp.tokenize.Token.end
cpp.tokenize.Token.whence

The documentation for this class was generated from the following file: