Package aterm :: Module lexer :: Class Lexer
[frames] | no frames]

Class Lexer




Lexer for scanning terms.

Instance Methods
 
filterToken(self, type, text)

Inherited from TokenStream: __init__, getpos, nextToken

Inherited from antlr.TokenStream: __iter__

Inherited from object: __delattr__, __getattribute__, __hash__, __new__, __reduce__, __reduce_ex__, __repr__, __setattr__, __str__

Class Variables
  tokenizer = Tokenizer(tokens= [(parser.SKIP, r'[ \t\f\r\n]+'),...

Inherited from TokenStream: newline_re, tabsize

Properties

Inherited from object: __class__

Method Details

filterToken(self, type, text)

 
Overrides: TokenStream.filterToken

Class Variable Details

tokenizer

Value:
Tokenizer(tokens= [(parser.SKIP, r'[ \t\f\r\n]+'), (parser.REAL, r'-?(\
?:' r'(?:[0-9]+\.[0-9]*|\.[0-9]+)(?:[eE][-+]?[0-9]+)?|' r'[0-9]+[eE][-\
+]?[0-9]+' r')'), (parser.INT, r'-?[0-9]+'), (parser.STR, r'"[^"\\]*(?\
:\\.[^"\\]*)*"'), (parser.CONS, r'[A-Z][a-zA-Z0-9_]*'), (parser.VAR, r\
'[a-z][a-zA-Z0-9_]*'),], symbols= {'_': parser.WILDCARD, '(': parser.L\
PAREN, ')': parser.RPAREN, '[': parser.LSQUARE, ']': parser.RSQUARE, '\
{': parser.LCURLY, '}': parser.RCURLY, ',': parser.COMMA, '*': parser.\
STAR,})