Stateless API

Resending the Context

Library › Context Problems

1. The Context Window

2. Window Occupancy

3. Growth per Turn

4. Remaining Space

5. Turn Budget

6. Retrieval Footprint

7. Retrieval per Turn

8. Search Rounds

9. Window Sizing

10. Truncation

11. Compaction

12. The Compaction Bill

13. Compacted Retrieval

14. The Compaction Threshold

15. Verbatim Tail

16. Stateless API

17. Retrieval Cost

18. Context Tax

19. Quadratic Cost

20. Cost Forecast

The API keeps nothing between turns, so every request carries the whole conversation again. The model does not remember turn one, it reads it a second time. Written out chunk by chunk, each request contains the one before it entire, with a new question on the end. That is the shape the bill follows, and it is why a conversation costs more than the sum of its turns.

---

⬇ Stateless API worksheet (2 pages)

---

Next:
17. Retrieval Cost