Introduction to Large Language Models

Objective: Learn the fundamentals of accessing and querying common LLM APIs and local models. Students will gain hands-on experience with different ways of interacting with LLMs through APIs and local deployment.

Required Resources

• OpenAI Playground
• Fireworks AI Inference Platform
• Ollama
• Modal

Repositories

• Modal Llama 3 8B Serving Repo
• Modal Streamlit Chat App Repo

Optional Resources

• Simon Willison's llm package
• 📺 Simon Willison's LLMs on the command line