Skip to main content

Recap and final exam

Ten modules to go from "a raw provider SDK call" to a tool-using expense assistant with retrieval, memory and a traced evaluation loop. Here is the course condensed, then the threads running through it, then the exam.

The course at a glance

ModuleThe essential point
1. What LangChain addsCommon interface, LCEL, coordinated ecosystem; useful the moment you have two of retrieval, memory, tools, multi-model or streaming
2. Models, prompts, parsersRunnable interface everywhere; with_structured_output + Pydantic beats regex; treat parse failures as first-class events
3. Composing chainsPipe `
4. Loaders and splittingDocument carries content plus metadata; RecursiveCharacterTextSplitter at 600–1000 chars with 10–20 % overlap; prepend heading trail
5. Vector stores and retrieversOne embedding model per collection; similarity threshold turns "no answer" into a real outcome; retrieval + RunnablePassthrough + prompt = RAG chain
6. MemoryRunnableWithMessageHistory keyed by session_id; window + rolling summary; persist to Redis/Postgres with a TTL
7. ToolsTyped function + docstring is what the model reads; bind_tools makes the model produce intents, your code executes; ToolException for typed failures
8. AgentsPrompt in a while loop; create_react_agent for the simple case, LangGraph when you need explicit branches, retries or human-in-the-loop; always cap recursion_limit
9. Tracing and evaluationTrace beats log; 20 real questions frozen as a benchmark; faithfulness + citations + abstention as reference-free evaluators; rerun on every change
10. End-to-end projectRetrieval-as-tool inside the agent; four failure modes (tool error, agent loop, empty retrieval, out-of-scope); ship behind a feature flag

The threads running through the course

Everything is a Runnable. A model, a prompt, a parser, a retriever, a chain, an agent — all implement the same four methods. That single fact is why the pipe operator works across arbitrary combinations, why swapping a provider is one import, and why streaming and batching are always available. Understanding that interface is more valuable than memorising any specific class.

The framework is worth its cost only when at least two of the five joints are present: retrieval, memory, tools, multi-model comparison, or streaming coordination. Below that threshold, direct SDK calls are shorter, faster to debug and cheaper to maintain. LangChain is not a religion; it is a tool with a break-even point.

Every layer needs a failure-mode discipline. Parsers need a retry policy. Retrievers need a similarity threshold. Memories need a token budget. Tools need typed exceptions and idempotency keys. Agents need a recursion limit. The trace-and-evaluate loop of module 9 is what makes those disciplines visible; without it, quality drifts silently.

Structured outputs are the pipe that connects LLMs to real code. with_structured_output + Pydantic is the abstraction that lets the model be creative in its reasoning and rigorous in its outputs — one JSON, one type, one exception on violation. Every serious production chain in 2026 uses it, and the ones that do not spend their time patching regex.

The final exam

The exam has 40 questions covering all ten modules: when to reach for LangChain and when not to, the Runnable interface, structured outputs and parse-failure handling, the pipe operator with RunnableParallel and RunnablePassthrough, document loaders and splitter parameters, vector stores and similarity thresholds, MultiQueryRetriever, memory strategies and session isolation, typed tool declarations and bind_tools, the agent loop with LangGraph and human-in-the-loop, tracing and evaluation datasets, and the end-to-end assistant with its failure modes.

Several questions present situations to diagnose: a chain that returns confident wrong answers on out-of-corpus questions, an agent stuck in a loop calling the same tool with the same arguments, a memory that has forgotten a fact from turn 3 by turn 20, a tool that silently duplicates a spreadsheet row on retry, an evaluation regression after a prompt tweak that "should not have changed anything". Judgement is what gets assessed, not memorised API signatures.

On success, your certificate of completion is issued immediately; its number can be verified by any third party on the platform.

Before you start

Re-read the table above and, for each row, ask yourself "what symptom would I see if I got this wrong?". If you can explain why one embedding model per collection is a hard rule, why an agent without recursion_limit is a footgun, why a tool with side effects needs an idempotency key, and why a frozen evaluation set beats any leaderboard, you are ready. Good luck!

Final exam

Ready to validate this course?

40 questions drawn at random from the course bank · passing score 70% · verifiable PDF certificate issued immediately on success.

Start the exam

You need to be signed in to your InSkillML account with an active subscription. You can also start the exam from My courses.