Package aterm :: Module lexer :: Class TokenStream

Class TokenStream

Instance Methods

__init__(self, buf=None, pos=0, filename=None, fp=None)
x.__init__(...) initializes x; see x.__class__.__doc__ for signature

nextToken(self)

getpos(self)

filterToken(self, type, text)

Inherited from antlr.TokenStream: __iter__

Inherited from object: __delattr__, __getattribute__, __hash__, __new__, __reduce__, __reduce_ex__, __repr__, __setattr__, __str__

Class Variables
	tokenizer = `None`
	newline_re = `re.compile(r'\r\n?\|\n')`
	tabsize = `8`

Properties
Inherited from `object`: `__class__`

Method Details

init(self, buf=None, pos=0, filename=None, fp=None)
(Constructor)

x.__init__(...) initializes x; see x.__class__.__doc__ for signature

Overrides: object.__init__: (inherited documentation)

nextToken(self)

Overrides: antlr.TokenStream.nextToken

Class TokenStream

__init__(self, buf=None, pos=0, filename=None, fp=None) (Constructor)

nextToken(self)

init(self, buf=None, pos=0, filename=None, fp=None)
(Constructor)