Preparing for system design interviews?  Try bugzed.com →

Konoha: Japanese Tokenizer Wrapper

JSON →
library 5.7.0 ·python
verified Jun 28, 2026

Konoha is a Python library (v5.7.0) that provides a unified, easy-to-use interface for various Japanese tokenizers, including MeCab, Sudachi, and Sentencepiece. It allows developers to seamlessly switch between different tokenizers and also offers rule-based tokenizers (whitespace, character) and a sentence splitter. The library is actively maintained with its latest release in March 2026.

total hits 15
actors 7 distinct systems
last hit 16d ago AhrefsBot
GPTBot
4
ChatGPT-User
2
Script
1
ByteDance
1
OAI-SearchBot
1

top countries 🇺🇸 United States · 🇨🇦 Canada · 🇩🇪 Germany · 🇫🇷 France · 🇰🇷 South Korea