Transformer Smaller Training Vocab
JSON →transformer-smaller-training-vocab is a Python library designed to optimize transformer model training by temporarily reducing the vocabulary size to only include tokens present in the training dataset. This process helps save RAM and speeds up training, especially for domain-specific fine-tuning. The library is currently at version 0.4.2 and has an active, though infrequent, release cadence, with recent updates addressing compatibility and bug fixes.
Traffic · last 30 days stale · no recent hits
total hits 17
actors 4 distinct systems
last hit 17d ago ByteDance
top countries 🇸🇬 Singapore · 🇺🇸 United States · 🇨🇦 Canada · VN · BD