LLM (Large Language Model)

Whiteboard Transformers & Attention

Transformer Videos from StatQuest

• The massive impact of transformers in the world of AI → video
• Jeremy Howard explains LLMs

Kurze Zusammenfassung zu Transformers

• Es macht Sinn, zuvor ein high overview Video zu schauen, welches eine simple Erklärung gibt für Self-Attention and positional encoding. Hier mein Vorschlag.

https://www.youtube.com/watch?v=_UVfwBqcnbM&ab_channel=AssemblyAI

Language Models

• What is a language model?
• Handling dependencies is a crucial property. The model needs to remember what it just said and it should know how certain words are coupled with each other.
• Autocorrect with **Recurrent Neural Networks (**RNN)
• Attention
• Transformer

https://www.youtube.com/watch?v=rURRYI66E54&ab_channel=Computerphile

Details about transformer architecture

Whiteboard Transformers & Attention

Transformer Videos from StatQuest