Preparing for system design interviews?  Try bugzed.com →

segtok: Sentence Segmentation and Word Tokenization

JSON →
library 1.5.11 ·python maintenance
verified Jun 28, 2026

Segtok is a fast, rule-based Python library for sentence segmentation and word tokenization. It is designed for well-orthographed texts, particularly in English, German, and Romance languages, offering high precision and Unicode support. The current version is 1.5.11. While functional, it is largely superseded by 'syntok' (segtok v2) which offers improved performance and handles more edge cases. It is in a maintenance phase with no active development.

total hits 17
actors 4 distinct systems
last hit 6d ago AhrefsBot
ByteDance
6
GPTBot
4
Script
1
Humans
2

top countries 🇸🇬 Singapore · 🇺🇸 United States · 🇨🇦 Canada · 🇩🇪 Germany