Does punctuation count as a token? Yes. Most tokenizers treat each mark as its own token, carrying structure the model needs: sentence boundaries, pauses, questions. Agents that read or write code, JSON, or structured data pay this cost on every bracket and comma.
⬇ Non-Word Tokens worksheet (1 page)
Next:
4. Token Ratio