Description: Title: Lexical Analyzer
-Parses forwards and backwards.
-Scans forwards and backwards.
-Get the delimiter that was found.
-Get the offset at where the token was started.
-Get the current offset of the parser.
-Add any number of delimiters.
-Support for delimiter lists. Instead of removing all delimiters and adding one by one, just set the delimiter list. Can be used for easier parsing out of comments.
-Unicode/Ansi Support
Included is also 5 tests showing all the functions in action. Sample text is mostly a snippet of C++ source code except for one test. Shows the ease of use for parsing with support multiple delimiters.
To Search:
File list (Check if you may need any files):
@PSC_ReadMe_11295_3.txt
Lexical Analyzer
................\LA_Test1
................\........\LA_Test1.cpp
................\........\LA_Test1.vcproj
................\........\ReadMe.txt
................\........\stdafx.cpp
................\........\stdafx.h
................\LA_Test2
................\........\LA_Test2.cpp
................\........\LA_Test2.vcproj
................\........\ReadMe.txt
................\........\stdafx.cpp
................\........\stdafx.h
................\LA_Test3
................\........\LA_Test3.cpp
................\........\LA_Test3.vcproj
................\........\ReadMe.txt
................\........\stdafx.cpp
................\........\stdafx.h
................\LA_Test4
................\........\LA_Test4.cpp
................\........\LA_Test4.vcproj
................\........\ReadMe.txt
................\........\stdafx.cpp
................\........\stdafx.h
................\LA_Test5
................\........\LA_Test5.cpp
................\........\LA_Test5.vcproj
................\........\ReadMe.txt
................\........\stdafx.cpp
................\........\stdafx.h
................\Lexical Analyzer
................\................\LA_Lexer.cpp
................\................\LA_Lexer.h
................\................\LA_Predefines.h
................\................\Lexical Analyzer.vcproj
................\................\LexicalAnalyzer.cpp
................\................\LexicalAnalyzer.h
................\Lexical Analyzer.sln
................\scrnshot.jpg
Download