Implementing Self-Attention - A step-by-step guide using PyTorch
From last couple of months I have been learning the core building blocks of LLM’s using a well known book called Build Large Language Model from Scratch. The book is very well written and highly recommended for someone who is interested in learning the internal architecture of LLM’s, but please note you will need to put some serious time & effort to get hold of it. This writing is inspired by the book hence full credit to the author Sebastian Raschka. ...