Introduction to Tokenization | Writing a Custom Language Parser in Golang

Video Description

This is the first video in my series covering modern parsing techniques for language & compiler development. In this video we begin writing the lexer which we use for the remainder of the series. Lexing is the process of transforming the raw source code into meaningful tokens which can later be used by the parser. This process will involve using regular expressions for pattern matching and helper handling functions to simplify the process compared to simpler forms of tokenization. ⭐⭐ GitHub Repo ⭐⭐ - https://github.com/tlaceby/parser-series 🔔 JOIN THE COMMUNITY 🔔 https://www.youtube.com/@tylerlaceby ---------------------------------------- -- Social Links -- Discord - https://discord.gg/KEfHqZ3zn7 GitHub - https://github.com/tlaceby/