Back

Applied AI Lead/Senior Applied AI Lead

YammerNew York, NY, USA
You will be redirected to the main website
Posted on: 27 Sep 2026

Job Description

Take each agent from a working prototype to something running in production. Set up a repeatable way to get there, and confirm it meets our bar for reliability, support, security, and Responsible AI before it ships. Build the agents required for new systems we're implementing. Prototype when it helps but spend most of your time making what we build ready for production and maintaining it with ongoing governance and support. Grow the agents we run from a few users to all users involved in a given system, and own the bug fixes, new features, and daily reliability of everything that is live. Set up the evaluation and monitoring that show how our agents are doing on quality, cost, and usage, and that catch problems before users run into them. Create simple, reusable patterns and starter templates so the team can build production-ready agents faster and more consistently. Work with the data engineering, marketing engineering, and Responsible AI teams to connect agents to the systems and workflows where people do their work. Keep track of how agent models and tools are changing, and bring what is useful back to the team. Bachelor's Degree in Business, Marketing, Communications, Finance, Engineering, or related field AND 2+ years of marketing operations, program management, project management, or related experience OR equivalent experience. Demonstrated experience taking AI/LLM or agent-based solutions from prototype into production and owning them there. Production-grade programming experience (e.g., Python) and fluency with a major cloud platform (Azure preferred). Hands-on experience with modern LLM application patterns: agent orchestration, tool/function calling, RAG, prompt/context engineering, and evaluation. Experience building evaluation harnesses and production observability/tracing for LLM systems using modern, approved AI tooling. Experience with AI safety, guardrails, and Responsible AI in production. Experience integrating AI into enterprise systems (auth/SSO, data pipelines, compliance/data-residency). Background in marketing, creative, or content-production environments. A track record of production evidence: specific agents you shipped, the integration complexity you navigated, and the users who relied on your work.

Job Overview

Salary:
Not disclosed
JOB TYPE:
Not specified
Experience:
Not mentioned
Job Location:
New York, NY, USA
Job Level:
Not specified
Education:
Graduation
Applied AI Lead/Senior Applied AI LeadYammer