Transformer Smaller Training Vocab

JSON →
library 0.4.2 ·python
verified May 25, 2026

transformer-smaller-training-vocab is a Python library designed to optimize transformer model training by temporarily reducing the vocabulary size to only include tokens present in the training dataset. This process helps save RAM and speeds up training, especially for domain-specific fine-tuning. The library is currently at version 0.4.2 and has an active, though infrequent, release cadence, with recent updates addressing compatibility and bug fixes.

total hits 19
actors 7 distinct systems
last hit 1d ago ByteDance
GPTBot
6
MetaBot
4
Script
2
ByteDance
2
Search engines
1

top countries 🇺🇸 United States · 🇨🇦 Canada · 🇸🇬 Singapore · 🇩🇪 Germany · 🇫🇷 France