1. LLaMA 3
Download the blank slides and grab a pen to follow along:
I am pleased to join Ravi Theja Desetty (LlamaIndex) and Eduardo Ordax (Amazon Web Services) to host a live panel and Q/A to share what we know about LLaMA 3 and answer your questions.
Preview:
Date:
April 24 (Wednesday)
Time:
Denver: 9am (Tom)
Madrid: 5pm (Edurado)
Bengaluru: 8:30pm (Ravi)
Link to the LinkedIn Live Event:
https://www.linkedin.com/events/llama3-livepanelandq-a7187158659506831360/theater/
2. Sora
Deep Dive into Sora’s Diffusion Transformer (DiT) by Hand ✍️ - Explore the secret behind Sora’s state-of-the-art videos
by Srijanie Dey
“In the ancient land of DiTharos, there once lived a legend, called Sora. A legend that embodied the very essence of unlimited potential, encompassing the vastness and the magnificence of the skies.”
This is a story I told my son about a mythical dragon that lived in a far away land. We called it ‘The Legend of Sora’. He really enjoyed it because Sora is big and strong, and illuminated the sky. Now of course, he doesn’t understand the idea of transformers and diffusion yet, he’s only four, but he does understand the idea of a magnanimous dragon that uses the power of light and rules over DiTharos.
And that story very closely resembles how our world’s Sora, Open AI’s text-to-video model emerged in the realm of AI and has taken the world by storm. In principle, Sora is a diffusion transformer (DiT) developed by William Peebles and Saining Xie in 2023.
Read the full article: https://towardsdatascience.com/deep-dive-into-soras-diffusion-transformer-dit-by-hand-%EF%B8%8E-1e4d84ec865d
3. Artificial Neuron
Artificial Neuron: AI by Hand ✍ Workbook - 25 Exercises 🏋️
by Tom Yeh
This workbook is comprised of 25 exercises. Every exercise features one or two "missing" values, highlighted in a soft shade of blue or red.
Can you calculate these missing values by hand? ✍
Download the workbook:
4. RLHF
I Taught RLHF by hand ✍️
I Taught RLHF by hand.. at our SPJAIN Sydney campus for students of the DS stream with both UG and PG folks attending
We had a blast of a time with the participants of this LLM Workshop where I taught Fine tuning Concepts with PEFT methods along with RLHF.
We had a very engaging discussion on the some interesting questions post class with some of the participants
The AI by hand exercise this Time on RLHF ( In collaboration with Prof Tom Yeh ) was extremely engaging with the participants. What was more interesting is some of the post class questions
Read the original LinkedIn post by Dr. Anish Roychowdhury:
https://www.linkedin.com/posts/activity-7187462822434365440--jor
5. Transformer
Transformer by Hand ✍️ in Five Minutes
by Anna Rahn