![]() Ints specifying the row and column where the token ends in the source and Token string a 2-tuple (srow, scol) of ints specifying the row andĬolumn where the token begins in the source a 2-tuple (erow, ecol) of The generator produces 5-tuples with these members: the token type the Each call to theįunction should return one line of input as bytes. Io.IOBase.readline() method of file objects. Must be a callable object which provides the same interface as the The tokenize() generator requires one argument, readline, which ![]() ![]() The primary entry point is a generator: tokenize. Named tuple returned from tokenize.tokenize(). Type can be determined by checking the exact_type property on the To simplify token stream handling, all operator andĭelimiter tokens and Ellipsis are returned using The scanner in this module returns comments as tokensĪs well, making it useful for implementing “pretty-printers”, including The tokenize module provides a lexical scanner for Python source code,
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |