{"title":"Encoding Integrity: Solving Character & Tokenization Errors","region":"Global","category":"Reliability","description":"Ensuring agents don't fail due to BPE tokenization issues or non-UTF-8 characters.","lastUpdated":"2026-02-23","steps":["Force UTF-8 encoding across the entire stack.","Use a token-aware string slicer for context pruning.","Sanitize input for poison tokens or control characters.","Validate character counts vs. token counts.","Avoid splitting multi-byte characters mid-stream."],"url":"https://checklist.day/agent-tokenization-encoding"}