General Idea of Attention (for timeseries)

We are looking for a way to apply attention to text

• Check this!

Similarity in words

Self Attention (intuition)