World's Fair 2025
Case Study + Deep Dive: Telemedicine Support Agents with LangGraph/MCP - Dan Mason
Overview
This talk presents a case study and deep dive into building telemedicine support agents using LangGraph and MCP. The core thesis is that LLM-powered agents can significantly enhance flexibility and capability in healthcare support systems, moving beyond traditional software limitations. The system aims to provide scalable, automated patient support while maintaining human oversight for complex or sensitive situations.
Who should watch
- AI Engineers
- Product Managers
- Builders working on agentic workflows
- Developers interested in healthcare AI applications
- Those exploring LangGraph and MCP for complex systems
Key takeaways
- LangGraph and MCP tools were used to build an agentic system for telemedicine support, specifically for early pregnancy loss treatment.
- The system acts as a virtual operations associate, assessing patient interactions, determining responses, and managing treatment state.
- A hybrid approach combines LLM capabilities with human oversight, escalating complex cases to a physician's assistant.
- The system allows for flexible addition of new treatments and workflows without extensive recoding, primarily through maintaining blueprints and knowledge bases.
- Evaluation is handled through a custom harness and an LLM-as-a-judge approach, with a focus on identifying deviations from expected behavior.
- State management within LangGraph involves serializing and passing state to the LLM, with updates managed by the Python code.
- The system prioritizes human readability and maintainability for client-side updates, using structured documents like Google Docs for blueprints.
- Model selection criteria included steerability and transparency, with Claude being used for its capabilities, though the architecture is designed to be model-agnostic.
Notable quotes
The core idea is that an LLM controls the flow of the application.
Agents in production require knowing what they're doing, that they can do it, and being able to steer them.
We needed something that was able to do the job, clear about what it was doing, and that was steerable by humans in a really obvious way.
Unofficial community note. Prefer the recording for nuance.