Skip to main content

Small Language Models (SLMs)

Deploy efficient Small Language Models for production.

Course Duration: 8 hours​

What You'll Learn​

  • SLMs vs LLMs trade-offs
  • Model selection criteria
  • Quantization techniques
  • Edge deployment
  • Fine-tuning SLMs
  • Cost optimization

Prerequisites​

  • LLM fundamentals
  • Python programming

Course Modules​

  1. Introduction to SLMs
  2. Phi-3 (Microsoft)
  3. Gemma (Google)
  4. Mistral 7B / Mixtral
  5. Qwen (Alibaba)
  6. LLaMA 3 8B
  7. Quantization (GGUF, AWQ, GPTQ)
  8. Memory Optimization
  9. Edge Deployment
  10. Fine-tuning SLMs
  11. Benchmarking
  12. Project: Deploy SLM on Raspberry Pi

Models Covered​

  • Phi-3 Mini/Small/Medium
  • Gemma 2B/7B
  • Mistral 7B
  • Qwen 2.5
  • LLaMA 3 8B