sql-tokenizer

A lightweight SQL tokenizer that converts SQL statements into a list of tokens. Current stable version is 1.0.5, released in 2023. It is a simple, dependency-free package for basic SQL tokenization, handling whitespace, quotes, and indentation preservation. Ships TypeScript definitions. Useful for SQL parsing or syntax highlighting. Updates are infrequent. Unlike full SQL parsers, it only tokenizes without building an AST.