LLM Fine-Tuning

Objective: Learn when and how to apply fine-tuning techniques to customize LLMs for specific tasks. Students will understand different fine-tuning approaches and their practical applications.

Case Study

Fine Tuning by the course's AI App Developers

Required Readings

• Using CUDA on Modal
• How Much Does It Cost to Train a Large Language Model?
• Practical Tips for Finetuning LLMs Using LoRA

Optional Reading

• Estimating vRAM
• How QLoRA, a Revolutionary Fine-Tuning Method, Works