- Experience
- 5+ years
- Pay
- $204K – $255K per year
- Education
- Not specified
- Location
- San Francisco, CA
- Work mode
- Hybrid
- Job type
- Full-time
About this role
Ambience Healthcare builds an AI intelligence platform that automates clinical documentation and administrative workflows. The ML team develops production models, evaluation frameworks, and agentic clinical decision support systems.
What you will do
- Design and own evaluation pipelines for LLM and agentic systems
- Diagnose production model failures and test prompt, retrieval, and fine-tuning improvements
- Build agentic AI systems involving tool use, retrieval, context management, and routing
- Turn production feedback into high-quality training and evaluation datasets
- Collaborate closely with clinicians and engineers to deploy robust AI solutions
What the employer expects
- 5+ years of professional production ML, research engineering, or applied AI experience
- Strong understanding of modern LLMs, transformers, and production AI systems
- Experience designing rigorous evaluations for complex AI and agentic workflows
- Proficiency in Python and modern ML frameworks such as PyTorch
- Strong software engineering fundamentals with deployment and containerization skills
Benefits
- Comprehensive medical, dental, and vision coverage
- 401(k) company match up to 3% of base salary
- Flexible paid time off with no annual cap
- Annual company-wide off-sites and team gatherings
Skills
- Python
- PyTorch
- LLMs
- Transformers
- Machine Learning
- CI/CD
- Agentic Systems
Apply on the employer's site
The application opens on Ambience Healthcare Ashby job board. Dev Portal Notes does not collect your application or charge a fee.
Know someone who fits this role?
Applications are handled on the employer's own site.
Prepare for this role
Close the skill gap
Udemy
Become an AI Engineer: LLMs, RAG and Agents
Learn to build with large language models: prompting, fine-tuning, RAG and agents, in working code.
Get the courseUdemy
The Python Mega Course
Python taught by building real applications, from scripting through web apps and data work.
Get the courseSome links on this page may generate a small commission at no extra cost to you.