Back

Principal Software Engineer

YammerRedmond, WA, USA
You will be redirected to the main website
Posted on: 27 Sep 2026

Job Description

Design and ship AI systems end‑to‑end—from exploration to production—spanning LLM‑based services, retrieval/grounding pipelines, and robust evaluation/observability. Build agentic and tool‑using workflows that reason across data and services, optimizing for safety, latency, and cost at cloud scale (Azure preferred). Collaborate across research and product teams to adapt/fine‑tune models (LLMs/SLMs, multimodal) for real customer scenarios. Lead technical direction across features and services; mentor engineers; champion high engineering standards, reliability, and accessible, inclusive experiences. Uphold Responsible AI, secure and compliance practices in design, data handling, and experimentation. Participate in on‑call/operational excellence as part of a healthy, sustainable engineering culture; lead by example. Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience. 8+ years building and shipping production software/services including 3+ years with modern ML (e.g., transformer‑based LLMs) and applied AI/ML systems. Strong coding skills in one or more: Python, C#, or C++—with design/architecture experience for cloud services (Azure preferred). Hands‑on experience taking LLM/ML features from prototype to production (evaluation, safety, telemetry, and iterative improvement). Ability to influence across teams and drive ambiguous, multi‑partner initiatives to outcomes. Experience with agentic systems, model/tool orchestration, and/or retrieval‑augmented generation (RAG). Expertise with Azure AI, vector stores, prompt/response evaluation, and performance optimization for LLM workloads. Track record of shipping applied research to production and partnering with research teams on custom/fine‑tuned models. Familiarity with Responsible AI practices and inclusive design/accessibility standards. Software Engineering IC6 - The typical base pay range for this role across the U.S. is USD $165,600 - $296,400 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $220,800 - $331,200 per year. Certain roles may be eligible for benefits and other compensation.
Principal Software EngineerYammer