Lexical analysis. The process of processing the input symbol sequence in order to get the output sequence of symbols called lexemes (or "tokens"). Each lexeme can be for convenience viewed as a structure containing the lexeme's type and, if necessary, the corresponding value.
- Wikipedia. "Lexical analysis"