In this video, we continue building our own programming language from the ground up. Previously, we covered how terminal symbols fit into a grammar. Now we move one layer deeper: the lexer.
The lexer is the part of the parsing pipeline that operates on terminal symbols. It takes a raw input stream and turns it into a sequence of tokens — classifying lexemes into meaningful units. This process, as you know, is called tokenization. We won’t stop at theory. During the webinar, we’ll walk through how a lexer is actually implemented in code. This session is aimed at developers who want to go beyond using languages and start understanding how they work under the hood.
----------------------------------------------------------------------------------------------
🎁 Get the PVS-Studio month free trial
0