Lead retrieval initiatives end to end: Design, build, and operate retrieval systems using RAG and hybrid search (lexical plus vector, reranking, filtering) so agents answer from the right content with the right amount of context. Own delivery from scope and design through launch, monitoring, and iteration.
Build developer tooling for production agents: Drive technical design for the frameworks and platform pieces our engineers use to build agents, including multi-agent orchestration, shared primitives for prompts, tools, tracing, and evaluation.
Own answer quality: Diagnose why answers are thin, wrong, or inconsistent by separating retrieval problems from generation problems (prompt, token budget, model choice). Set a quality bar we can test against, and lead the
work to reach it.
Design content and data models: Define how content from documents,
knowledge bases, and call transcripts is ingested, segmented, labeled, and retrieved, including the primitives behind freshness, dedupe, source
precedence, and internal versus external visibility.
Make AI changes safe to ship: Build evaluation, observability, and rollout
practices (offline evals, online monitoring, regression detection) so we can change prompts, models, and retrieval with confidence. Evaluate multiple
solution paths and know when to trust, redirect, or override model and agent output.
Set performance and scaling benchmarks across the platform we own:
Define and track targets for retrieval and indexing, LLM provider usage, and agent orchestration.
Own operational health: Ensure the reliability and performance of the systems your team owns. Participate in on-call, lead incident resolution for your area, and communicate clearly with the team and stakeholders during incidents.
Use agentic development to raise leverage: Use coding agents by default for implementation, testing, refactoring, and documentation while holding a high validation bar. Create reusable workflows, patterns, and tooling that raise the effectiveness of your team beyond your own output.
Partner across functions: Work with product, design, and engineering
leadership to shape roadmap, tradeoffs, and requirements, and to translate strategy into concrete execution plans.
Raise team effectiveness: Mentor engineers, give high-quality code review and technical guidance, and improve standards, tooling, and processes.