Package aterm :: Module lexer :: Class TokenStream
[frames] | no frames]

Class TokenStream




Instance Methods
 
__init__(self, buf=None, pos=0, filename=None, fp=None)
x.__init__(...) initializes x; see x.__class__.__doc__ for signature
 
nextToken(self)
 
getpos(self)
 
filterToken(self, type, text)

Inherited from antlr.TokenStream: __iter__

Inherited from object: __delattr__, __getattribute__, __hash__, __new__, __reduce__, __reduce_ex__, __repr__, __setattr__, __str__

Class Variables
  tokenizer = None
  newline_re = re.compile(r'\r\n?|\n')
  tabsize = 8
Properties

Inherited from object: __class__

Method Details

__init__(self, buf=None, pos=0, filename=None, fp=None)
(Constructor)

 
x.__init__(...) initializes x; see x.__class__.__doc__ for signature
Overrides: object.__init__
(inherited documentation)

nextToken(self)

 
Overrides: antlr.TokenStream.nextToken