LLMs in Production

Date: November 7 (Class 12)

Presenters: LLMOps Developers

Required Readings

• The Shift from Models to Compound AI Systems
• Optimizing Latency
• A Visual Guide to Quantization

Optional Reading

• Every Way To Get Structured Output From LLMs
• Berkeley Function-Calling Leaderboard