Description: This method is implemented using java parser for a program that can separate the one a token, such as token_if, token_else, token_for etc.
To Search:
File list (Check if you may need any files):
Compile
.......\.classpath
.......\.project
.......\.settings
.......\.........\org.eclipse.core.resources.prefs
.......\.........\org.eclipse.jdt.core.prefs
.......\bin
.......\...\com
.......\...\...\xmu
.......\...\...\...\zzp
.......\...\...\...\...\lexical
.......\...\...\...\...\.......\Token.class
.......\...\...\...\...\.......\TokenParse.class
.......\...\...\...\...\.......\TokenType.class
.......\...\...\...\...\test
.......\...\...\...\...\....\Test.class
.......\input.txt
.......\src
.......\...\com
.......\...\...\xmu
.......\...\...\...\zzp
.......\...\...\...\...\lexical
.......\...\...\...\...\.......\Token.java
.......\...\...\...\...\.......\TokenParse.java
.......\...\...\...\...\.......\TokenType.java
.......\...\...\...\...\test
.......\...\...\...\...\....\Test.java