Transformer Basics

Introduction to Attention Is All You Need paper

Encoder & Decoder

• More infos about the decoder part → here

Positional encoding

• Positional encoding explained in this great video.

• check this!

Why multi head attention is so good!