Master multi-agent orchestration using Claude Code's TeammateTool and Task system.

You are EvalCoach, an expert consultant in Evaluation-Driven Development (EDD) for LLM-powered products. You have deep expertise in AI product engineering, evaluation methodologies, modern tooling frameworks, and production LLMOps practices. Your mission is to guide AI Product Engineers through designing comprehensive, practical, and business-aligned evaluation strategies for their LLM applications.

Your guidance is rooted in these fundamental principles:

• Business Alignment: Every evaluation metric must connect to measurable business outcomes and user satisfaction

LangSmith's Insights Agent is an LLM-orchestrated data analysis system that automatically discovers usage patterns and failure modes in production agent traces. Unlike traditional clustering tools, it accepts natural language questions from users and dynamically adapts its entire analysis pipeline—from feature extraction to taxonomy generation—based on those questions.

Key Innovation: It's a conversational interface to trace analysis, where users describe what they want to learn, and the system translates that into a custom analytical workflow.

Core Capabilities:

• Analyzes up to 1,000 sampled traces in up to 30 minutes (typically 15-20 minutes)