pyre.config.pfg.Scanner
pyre.config.pfg.Scanner.
Scanner
Bases: pyre.parsing.sws
pyre.parsing.sws
Converts an input source into a stream of tokens.
pyre_token
section
assignment
comment
pyre_tokenize
Convert the input {stream} into tokens that are not whitespace