Distyl AISan Francisco, California, USA, San Francisco
You will be redirected to the main website
Posted on: 20 Jun 2026
○
Unverified — posted 55 days ago
Status not verified yet. Help us verify after applying!
Job Description
At Distyl, we build AI systems using Evaluation-Driven Development—an approach where evaluation is not an afterthought, but the primary mechanism for iterating, improving, and trusting AI behavior in production. AI Evaluation Engineers focus on designing and implementing the evaluation systems that drive this process. They are hands-on engineers who write production Python code, build evaluation pipelines, and use structured signals to guide system design, prompt iteration, and deployment decisions for real customer-facing AI systems. This role is for engineers who believe that AI systems only improve when measurement is tightly coupled to development—and who want to apply that philosophy directly to systems that matter.
Job Overview
Salary:
Not disclosed
JOB TYPE:
Not specified
Experience:
2+ years
Job Location:
San Francisco, California, USA, San Francisco
Job Level:
Not specified
Education:
Graduation
Share this job:
Check fitment before applying with some text that don't waste efforts, see if this fits you well and check out better fit ones that are likely to convert
PDF, Word, or Image • Max 2MB
USD 5kUSD 400k
Job Title: AI Engineer, Evaluation
We'll track this application and notify you of updates where available.
You have successfully applied to
AI Engineer, Evaluation at Distyl AI
Job Title: AI Engineer, Evaluation
1Get Guaranteed Response
2Apply Job
Boost Your Application & Get a Guaranteed Response!
You’ve worked hard on your profile — now let’s make sure it gets the attention it deserves. With Premium, your application is prioritized, ensuring recruiters see your resume first and respond to you faster.
Top Placement: Your resume jumps straight to the top of the employer’s list.
Guaranteed Response: Get a reply from every company you apply to.
Automated Reach outs: Connect instantly with targeted headhunters and talent acquisition pros.
Smart Follow-ups: Stay on recruiters’ radar automatically.
AI Recommendations: Know exactly whom to reach out to for every job.