TechnologyCustomer Service

How monday Service Uses LangSmith and LangGraph to Build Reliable AI Service Agents

monday Service implemented an eval-driven development framework using LangSmith and LangGraph to build and monitor customer-facing AI service agents, achieving 8.7x faster evaluation cycles for IT, HR, and Legal support workflows.

Outcomes

8.7x fasterEvaluation speed improvement
4.1x fasterParallelization benefit

Tools & Technologies

1L
LangSmith
Observability and evaluation platform for LLM applications, enabling tracing, debugging, and performance benchmarking.
2L
LangGraph
Graph-based orchestration framework for building stateful, multi-step AI agent workflows with human-in-the-loop support.

AI Categories

Challenge

Building reliable customer-facing AI agents where minor prompt deviations cascade into incorrect outcomes, with no efficient way to test and validate agent behavior before production.

Solution

monday Service implemented an eval-driven development framework using LangSmith for evaluation and tracing and LangGraph for agent orchestration, with offline regression testing and online trajectory monitoring.

Full Story

monday Service, the enterprise service management arm of monday.com, set out to build production-grade AI agents capable of handling complex, multi-turn customer conversations across IT, HR, and Legal departments. The fundamental challenge: in agentic systems, even minor prompt or tool-call deviations can cascade into significantly incorrect outcomes, making traditional development approaches insufficient.

Access 457+ AI use cases, 428+ tools, and adoption signal rankings.

Source

LANGCHAIN
February 2026
Original case study ↗

Similar Cases

1R
How Rakuten Uses Claude Code to Cut Feature Delivery from 24 to 5 Days
Rakuten
79%Reduction in average time to market for new features
2Z
How Zapier Achieves 89% AI Adoption with Claude Enterprise
Zapier
89%AI adoption rate across all employees
3K
How Klarna’s AI Assistant Resolves 80% of Queries in Under 2 Minutes
Klarna
80%Reduction in average customer query resolution time
4PA
How Palo Alto Networks Saves 351K Hours with Moveworks AI
Palo Alto Networks
351,000 hoursEmployee productivity hours saved
5S
How Smartsheet Uses Claude to Ship 3x More Code and Cut IT Costs by 60%
Smartsheet
1.76 millionMCP tool calls in first 30 days
6CR
How C.H. Robinson Automates 5,500 Shipments Daily with LangChain AI Agents
C.H. Robinson
~5,500Orders automated daily
7N
How Notion Built Agent Orchestration on Claude to Cut Costs 90%
Notion
90%Infrastructure cost reduction via prompt caching
8O
How OpusClip Uses Claude Code to Build a GTM Intelligence Engine
OpusClip
100% automated (up from 5–10% manual)Sales call review coverage
9J
How Jamf Uses Claude to Automate Workflows Across 16 Departments
Jamf
Under 45 minutesPerformance review skill build time
10I
How IBM Uses watsonx to Unlock $4.5B in Productivity Gains
IBM
$4.5 billionTotal productivity gains unlocked
See all use cases →