Package Usage: go: modernc.org/lexer
Package lexer provides generating actionless scanners (lexeme recognizers) at run time.
Scanners are defined by regular expressions
and/or lexical grammars, mapping between those definitions, token numeric identifiers and
an optional set of starting id sets, providing simmilar functionality as switching start states in *nix LEX.
The generated FSMs are Unicode arune based and all unicode.Categories and unicode.Scripts are supported by the
regexp syntax using the \p{name} construct.
Syntax supported by ParseRE (ATM a very basic subset of RE2, docs bellow are a mod of: http://code.google.com/p/re2/wiki/Syntax, original docs license unclear)
Single characters:
Composites:
Repetitions:
Grouping:
Empty strings:
Escape sequences:
Character class elements:
Unicode character class names--general category:
Unicode character class names--scripts:
6 versions
Latest release: almost 2 years ago
15 dependent packages
View more package details: https://packages.ecosystem.code.gouv.fr/registries/proxy.golang.org/packages/modernc.org/lexer