GPU/Fine Tuning

Date: October 17 (Class 9)

Presenters: AI Application Developer

Required Readings

• Using CUDA on Modal
• How Much Does It Cost to Train a Large Language Model? A Guide
• Practical Tips for Finetuning LLMs Using LoRA

Optional Reading

• Estimating vRAM
• How QLoRA, a Revolutionary Fine-Tuning Method, Works