Training and Fine-tuning LLMs

Frameworks to fine-tune LLMs

60+ videos and tutorials about training, fine-tuning, and deploying LLMs for production applications.

The course will take approximately 40 hours. It combines theory, foundational concepts, novel techniques, and real-world training.

Here are some of the highlights:

• You'll train an LLM from scratch • You'll work on 10+ practical projects • You'll fine-tune custom models to solve real-world use cases • You'll learn how to use CPUs for LLM workflows amid GPU shortages

→ Link to the course and twitter-review

Fine-tuning LLMs with PEFT and LoRA

Fine-tuning a large model takes time, care, and lots of money. Many companies can't afford the process. Some can't pay for the hardware. Some can't hire people who know how to do it. Most companies can't do either. And then LoRA came in…. (see tweet)

https://www.youtube.com/watch?v=Us5ZFp16PaU