Skip to main content

Large Language Models

GPT, LLaMA, Claude - architecture, training, and applications.

Course Duration: 12 hours​

What You'll Learn​

  • LLM architectures
  • Pre-training and scaling
  • Instruction tuning
  • RLHF (Reinforcement Learning from Human Feedback)
  • Open-source vs proprietary models
  • LLM applications

Prerequisites​

  • Transformers & Attention
  • NLP fundamentals

Course Modules​

  1. Introduction to LLMs
  2. GPT Architecture
  3. Scaling Laws
  4. Pre-training Process
  5. Instruction Tuning
  6. RLHF
  7. GPT-4 and Capabilities
  8. Claude and Constitutional AI
  9. LLaMA and Open Models
  10. Mistral and Mixtral
  11. LLM Benchmarks
  12. Building Applications with LLMs

Models Covered​

  • GPT-3.5 / GPT-4
  • Claude 2 / Claude 3
  • LLaMA 2 / LLaMA 3
  • Mistral / Mixtral
  • Gemini