How does AI actually work? Transformers explained
How GPT and other large language models (LLMs) work. Transformers deep dive. #ai #llm #machinelearning #datascience #agi
Thanks to our sponsor Genspark. Try it for free https://bit.ly/4uM3PLS
Attention is all you need https://arxiv.org/html/1706.03762v7
0:00 Intro
0:33 The transformer model
1:30 Predicting the next word
2:30 Tokenization
5:06 Representing meaning
7:17 Positional encoding
9:17 Attention head
14:49 Genspark
16:35 Multiple heads
19:30 Add and norm
21:45 Feed forward neural net
24:08 Multiple decoder blocks
24:50 Final layer
27:03 Training the model
Newsletter: https://aisearch.substack.com/
Find AI tools & jobs: https://ai-search.io/
Support: https://ko-fi.com/aisearch
Here’s my equipment, in case you’re wondering:
Lenovo Thinkbook: https://amzn.to/4jWeKwH
Dell Precision 5690: https://www.dell.com/en-us/dt/ai-technologies/index.htm?utm_source=AISearchTools&utm_medium=youtube&utm_campaign=precisionai#tab0=0
GPU: Nvidia RTX 5000 Ada https://nvda.ws/3zfqGqS
Mic: Shure SM7B https://amzn.to/3DErjt1
Audio interface: Scarlett Solo https://amzn.to/3qELMeu
Bundle of PETLIBRO Cat Water Fountain, Cordless Pet Water Fountain Battery Operated+8 Packs Replacement Filters for Dockstream Cat Water Fountain WF005 WF115 WF105, 4 Months Set of Replacement Filters
$62.41 (as of March 25, 2026 02:13 GMT +00:00 - More infoProduct prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on [relevant Amazon Site(s), as applicable] at the time of purchase will apply to the purchase of this product.)
Amazon Echo Pop Kids (newest model), Designed for kids, Designed for Alexa+, parental controls, Includes 6 months of Amazon Kids+, Anthro Pup
$29.99 (as of March 25, 2026 02:16 GMT +00:00 - More infoProduct prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on [relevant Amazon Site(s), as applicable] at the time of purchase will apply to the purchase of this product.)
Apple iPad 11-inch: A16 chip, 11-inch Model, Liquid Retina Display, 128GB, Wi-Fi 6, 12MP Front/12MP Back Camera, Touch ID, All-Day Battery Life — Blue
$299.00 (as of March 25, 2026 02:13 GMT +00:00 - More infoProduct prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on [relevant Amazon Site(s), as applicable] at the time of purchase will apply to the purchase of this product.)
Nutrish Rachael Ray Dry Dog Food Puppy, Real Chicken & Brown Rice Recipe, 5 lb. Bag
$9.97 (as of March 25, 2026 02:13 GMT +00:00 - More infoProduct prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on [relevant Amazon Site(s), as applicable] at the time of purchase will apply to the purchase of this product.)
Post Comment