Description: General purpose string tokenizer (C++ string version). The default delimiters are space (" " ), tab (\ t, \ v), newline (\ n), carriage return (\ r), and form feed (\ f). If you want to use different delimiters, then use setDelimiter () to override the delimiters. Note that the delimiter string can hold multiple characters.
To Search:
File list (Check if you may need any files):
tokenizer
.........\bin
.........\...\tokenizer.exe
.........\src
.........\...\main.cpp
.........\...\Makefile.mac
.........\...\Makefile.unix
.........\...\Makefile.windows
.........\...\tokenizer.cbp
.........\...\Tokenizer.cpp
.........\...\tokenizer.dev
.........\...\Tokenizer.h