Analyzing Support Requests
- Consolidated six months of historical partner support data to understand patterns and workload distribution.
- Conducted intent analysis to group requests into well-defined categories for automated handling.
- Developed a governed knowledge base containing step-by-step playbooks and user-friendly response templates for all identified categories.
Building an AI Agent
TurnB developed a Large Language Model (LLM)-powered AI agent using Copilot Studio that:
- Understood incoming partner requests in natural language.
- Accessed the knowledge base and executed necessary actions autonomously.
The agent performed key tasks such as:
- Extracting critical information from each request.
- Classifying requests into categories using confidence scores to determine if they could be handled automatically.
- Retrieving relevant playbooks via Retrieval-Augmented Generation (RAG) and executing steps through connected systems.
- Drafting clear, contextual replies within the same communication thread.
Human Oversight and Continuous Learning
- Requests falling below the confidence threshold were routed to human agents, along with AI-generated draft replies and recommended next actions.
- Weekly reviews were conducted to update playbooks and training examples, allowing the system to learn continuously and improve over time.