Input or Output?

Token problems: 8 of 20

Token problems: the workbook

1. Count the Tokens

2. Subword Splitting

3. Punctuation Counts

4. Tokens per Word

5. Will It Fit?

6. The Price of a Call

7. Two Kinds of Token

8. Input or Output?

9. The Two-Part Bill

10. End-to-End Call Cost

11. Comparing Three Calls

12. The Average Call

13. The System Prompt

14. The System Prompt Tax

15. Calls in a Budget

16. Tokens on a Budget

17. How Long Will It Take?

18. The Split Matters

19. Pricing per Million Tokens

20. Tokens from the Bill

Are all the tokens in a call billed the same way? No. Every token is either input (what you send) or output (what the model generates), each billed at its own rate. The boundary between them is the dividing line between two different prices. Labeling each token is the first step to seeing where an agent's cost comes from.

Problem

A model receives the question what is the plan and replies first gather data then analyze results. Label each token I for input or O for output.

Label each token I or O

Count the tokens of each kind

Practice 1

A model receives the task summarize the meeting notes and replies the team agreed to ship by Friday. Label each token I for input or O for output.

Label each token I or O

Count the tokens of each kind

Practice 2

A model receives the request list the tasks assigned to Alice and replies Alice has three open tasks. Label each token I for input or O for output.

Label each token I or O

Count the tokens of each kind

---

Next:
9. The Two-Part Bill