AI by Hand ✍️

AI by Hand ✍️

Outputs

RNNs by Hand, in Excel

Prof. Tom Yeh's avatar
Prof. Tom Yeh
Sep 27, 2026
∙ Paid

Library › RNNs by Hand, in Excel

  1. Recurrence

  2. Size

  3. Outputs

  4. Depth

  5. Seq2Seq

  6. Tokens

  7. Autoregressive

  8. Loss

  9. Small Language Model

In the last two articles, every step gave one output. In this article, we change what comes out. What if each step gave several outputs, or the whole sequence gave just one? Most examples start from the h=2 network of the last article. They change only what comes after the hidden state.

d=1, h=2, y=2, seq=5

We ask each step for two outputs. The hidden states do not change. Each output reads the same hₜ, with its own row of weights. Compare the first output with the h=2 example, and you will see they match.

This post is for paid subscribers

Already a paid subscriber? Sign in
© 2026 Tom Yeh · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture