noun
Meaning 1
The conversion of a stream of characters to a stream of meaningful tokens; normally to simplify parsing.
Definition source: English Wiktionary via Wiktextract
Usage: countable, uncountable
Topics: computer, computing, engineering, mathematics, natural-sciences, physical-sciences, science, sciences
Examples
- While it's often not difficult to identify tokens while parsing, having a separate stage for lexical analysis simplifies the structure of your compiler.
Meaning relationships
Synonyms: none provided
Antonyms: none provided