Introduction

Apply attention to the word vectors (no weights needed)

Keys, Values & Query

• Apply math to it : A step-by-step guide to self-attention with illustrations and code

Introducing 3 Matrix (as some kind of weights)

Re-draw into building blocks which can be trained