Byte-Pair Embeddings (BPEmb)
JSON →BPEmb provides byte-pair encodings (BPE) from raw text and maps subword units to pre-trained embeddings for 275 languages. It's designed for NLP tasks requiring efficient subword tokenization and embedding. The current version is 0.3.6, with releases occurring sporadically based on updates to models or features.
Traffic · last 30 days stale · no recent hits
total hits 19
actors 4 distinct systems
last hit 16d ago ByteDance
top countries 🇸🇬 Singapore · VN · 🇺🇸 United States · 🇨🇦 Canada · 🇬🇧 United Kingdom
API endpoints
full doc /v1/registry/bpemb
install /v1/registry/bpemb/install
compatibility /v1/registry/bpemb/compatibility