Package aterm :: Module lexer :: Class Tokenizer

Class Tokenizer

Instance Methods

__init__(self, tokens=(), symbols=None)
x.__init__(...) initializes x; see x.__class__.__doc__ for signature

next(self, buf, pos)

Inherited from object: __delattr__, __getattribute__, __hash__, __new__, __reduce__, __reduce_ex__, __repr__, __setattr__, __str__

Properties
Inherited from `object`: `__class__`

Method Details

init(self, tokens=(), symbols=None)
(Constructor)

x.__init__(...) initializes x; see x.__class__.__doc__ for signature

Overrides: object.__init__: (inherited documentation)

Class Tokenizer

__init__(self, tokens=(), symbols=None) (Constructor)

init(self, tokens=(), symbols=None)
(Constructor)