Posts

A few weeks ago I have implemented Self Attention mechanism from scratch using PyTorch and this post is a sequel to the first one. If not already, do read that article from here Building Self-Attention from scratch. In this post we will explore various steps involved in building Multi-Head Attention, how it’s different from Self-Attention and why it’s needed. What is a Multi-Head Attention In simple words, Multi-Head Attention is an extension of Self-Attention but the main idea here is to use the Self-Attention multiple times in parallel on a same input sequence to understand the hidden intricate relationships. ...

From last couple of months I have been learning the core building blocks of LLM’s using a well known book called Build Large Language Model from Scratch. The book is very well written and highly recommended for someone who is interested in learning the internal architecture of LLM’s, but please note you will need to put some serious time & effort to get hold of it. This writing is inspired by the book hence full credit to the author Sebastian Raschka. ...

With the popularity of ChatGPT there has been a lot of buzz around generative AI and its capabilities. I’ve been using tools like BingChat and I can confidently say that I’m very impressed with our progress in the field of Generative AI. But, please remember AI aka “Deep Learning” is not just limited to Generative AI we can also use it for various tasks such as Computer Vision, Tabular Analysis, Collaborative Filtering etc. ...

Probability and Proportion are not the same. Although they appear to be the same however there is a very thin line between these two concepts. Let me explain! Probability vs Proportion What is probability? Wikipedia definition “Numerical descriptions of how likely an event is to occur or how likely the proportion is ture” Simply put, it’s a way of measuring an expected outcome of an event. For example, if I flip a fair coin what are the chances of getting a Head. ...

Very often we use Best-case and Worst-case scenarios to explain uncertainty. If you are into Sales or Revenue forecasting then you should be familiar with these terms. To understand further you can read the scenario planning article here. In this tutorial, I’ll show you how to create a nice little Best case and Worst case chart in excel to explain the underlying uncertainty. Excel chart for best & worst case If you know how to create a Line chart in excel then it will be very quick and easy. ...