Description: From the input source, and identify the various independent significance of the mark, including the reserved words, identifiers, constants, operators, separators, etc., and sequentially outputting each sequence of tokens
To Search:
File list (Check if you may need any files):
lm
lm\ParseException.java
lm\SimpleCharStream.java
lm\T.java
lm\T.jj
lm\TConstants.java
lm\TTokenManager.java
lm\Token.java
lm\TokenMgrError.java