Senior Machine Learning Engineer II
- Salary
- $180,400 - $225,500
- Level
- Senior
Not stated in the posting: work type, visa.
Open. First seen 2 October 2026.
About the role
Judi Health's standard text
About Judi Health
Judi Health is a health technology company providing benefit administration solutions to employers, unions, health plans, and government entities. Judi Health replaces fragmented, outdated systems with the industry's first Unified Claims Processing™ architecture, seamlessly consolidating pharmacy and medical benefit administration on a single, secure platform. By delivering true price transparency, eliminating unnecessary middleman fees, and leveraging advanced AI-powered care delivery, Judi Health helps clients achieve unprecedented operational efficiency and service levels.
At Judi Health, we're deploying the infrastructure our country needs to deliver the healthcare we all deserve. We are the intelligence platform powering benefits plans for millions of Americans and proudly leading the next generation of care. To learn more, visit www.judi.health.
Location: Hybrid 3 days (offices in NYC, Denver, CO and Charlotte, NC area)
Position Summary:
Join our mission to infuse cutting-edge AI/ML/GenAI into pharmacy benefits as a Senior Machine Learning Engineer II. We are looking for an experienced software engineer with machine learning expertise to join us in expanding our AI capabilities, enabling increased productivity and magical experiences in our products and services.
In this role you will be expected to design and implement complex AI systems that leverage ML models for NLP, NLG, multimodal data analysis, chatbots, and RAG-based QnA. The ideal candidate should be passionate about applying AI/ML concepts to difficult problems and develop scalable solutions. We want people who like working in a collaborative team environment and enjoy creating practical, efficient, and high-performance software that leverages Large Language Models (LLM), Multimodal Language Models(MLM), and other ML models and techniques to build amazing capabilities for our customers, partners, and employees.
Most importantly, we are a mission-oriented, high-growth startup and we are looking for folks that are excited to be part of our journey to make lasting impact towards transforming healthcare.
Responsibilities:
Design, develop, and productionize machine learning (ML) solutions in the fields of Document understanding, Search and QnA, GenAI, Virtual Agents, etc.
Develop and maintain backend services using Python, focusing on AI-driven applications.
Design and implement APIs for seamless integration with AI models and services.
- Design multi-agent orchestration patterns (e.g. supervisor/subagent architectures, tool-use boundaries, human-in-the-loop gating) and evaluate architectural tradeoffs for scaling agent development across teams.
- Contribute to the development and scaling of the retrieval/search infrastructure underlying RAG systems (e.g. vector search clusters, embedding pipelines, capacity planning)
- Build and maintain CI/CD pipelines supporting the build, test, and deployment of agentic AI systems.
Collaborate with product managers, engineers, and other stakeholders as a specialist and subject matter expert in machine learning.
Work across the complete lifecycle of ML model development, including problem definition, data exploration, feature engineering, model training, validation, and deployment.
Participate in code reviews, testing, and quality assurance processes.
Troubleshoot and resolve technical issues related to AI model, integration, deployment and backend services.
Implement system telemetry, A/B testing and other statistical methods to validate the effectiveness of AI models. Ensure the integrity and robustness of ML solutions by developing automated testing and validation processes.
Document and communicate development processes, system designs, and architectural decisions.
Ensure the security and compliance of healthcare data, adhering to HIPAA regulations.
Required Qualifications:
Bachelor’s or Master’s degree in Computer Science, Machine Learning, or a related quantitative field.
Minimum 6+ years of experience in industry with a strong focus on ML solutions development and production deployment.
Strong grasp of OOP, Design Patterns, efficient algorithms, and quality software development.
Strong proficiency in Python and familiarity with ML libraries such as PyTorch.
Statistical Machine Learning and Artificial Intelligence in the context of NLP, Speech, RAG, Virtual Agents, and/or Document Processing technologies
Familiarity with cloud platforms such as AWS or Azure, including hands-on experience with containerized deployments
Familiarity with GenAI services such as OpenAI GPT, Anthropic Claude, Google Gemma etc. Experience developing and fine-tuning prompts on any of the GenAI services
- Experience designing evaluation frameworks for non-deterministic/agentic AI systems
Excellent problem-solving skills, attention to detail, and a strong capacity for logical thinking.
Passion for customer, innovation, product quality, service excellence, and test engineering
The ability to work collaboratively across multiple disciplines in an extremely fast-paced, startup environment.
Experience working with microservices/an API-based application paradigm.
Good written communication skills that enable collaboration in a remote environment.
Judi Health's standard text
This position description is designed to be flexible, allowing management the opportunity to assign or reassign duties and responsibilities as needed to best meet organizational goals.
New York, NY Salary Range
$180,400—$225,500 USD
Denver, CO Salary Range
$165,600—$207,000 USD
Charlotte, NC Salary Range
Judi Health's standard text
$150,400—$188,000 USD
All employees are responsible for adherence to the Judi Health Code of Conduct including the reporting of non-compliance. This position description is designed to be flexible, allowing management the opportunity to assign or reassign duties and responsibilities as needed to best meet organizational goals.
We provide equal employment opportunities to all employees and applicants for employment and prohibit discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, medical condition, genetic information, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
By submitting an application, you agree to the retention of your personal data for consideration for a future position at Judi Health. More details about Judi Health's privacy practices can be found at https://www.judi.health/legal/privacy-policy.
What this role asks for
Particular to this role
Azure · Generative AI · Microservices · NLP · RAG · Test Automation · Vector Databases
Rare in Judi Health's other 65 open postings.
Standard for data science / ML roles
LLM · Machine Learning · PyTorch
Common in data science / ML postings at any company.
In most of Judi Health's ads
Python
Named in most of its open postings, whatever the role.
68% of this description is written for the role. The rest is Judi Health's standard text, folded away below.
Read against Judi Health's other open postings on this site.
The team: Technology HIRES STEADILY
This role is one of 34 open in Technology. 2 were posted in the last 30 days and the oldest in June: a team that hires all year rather than one being built.
WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS
Python (24 of 34), AWS (20 of 34), CI/CD (16 of 34), SQL (15 of 34), Agile (12 of 34), Git (11 of 34), PostgreSQL (11 of 34)
OTHER ROLES ON THIS TEAM
- Developer - Atlassian Process Engineering posted Oct 13
- Analyst, Data Exchange - Claims Operations posted Oct 6
- Quality Assurance Manager posted Sep 15
- Platform Developer, SRE posted Sep 11
- Scrum Master posted Sep 8
- Mobile Developer posted Aug 19
- Senior Mobile Developer posted Aug 12
- Staff Applied AI/ML Scientist posted Aug 12
- IT Engineer I posted Aug 12
- Senior Machine Learning Engineering Manager posted Aug 7
- Senior Machine Learning Engineer I posted Aug 5
- Data Engineer II posted Jul 31
- Analyst, Data Exchange - Claim Ops (TPA) posted Jul 31
- Analyst, Data Exchange - Claims Operations posted Jul 23
- Senior Data Engineer posted Jul 21
- Staff Software Engineer, Streaming posted Jul 15
- Staff Software Engineer, Performance posted Jul 15
- Staff Software Engineer, Caching posted Jul 15
- Senior Backend Developer - Integrations posted Jul 8
- QA Manager posted Jul 2
- Senior UX/UI Designer posted Jun 24
- Senior Applied AI/ML Scientist posted May 26
- Analyst, Data Exchange Claims Ops (TPA) posted May 12
- UX/UI Designer posted Apr 30
- Senior Forward Deployed Engineer posted Apr 30
- Platform Developer, Operations posted Mar 5
- Data Engineer II posted Feb 27
- Senior Data Engineer posted Feb 27
- Senior Full Stack Software Developer posted Feb 19
- Senior Backend Software Developer posted Feb 18
- Technical QA Analyst II posted Feb 3
- Platform Developer posted Aug 18
- Senior Platform Developer posted Jun 13
From the team and dates on Judi Health's own job board.
See Machine Learning Engineer salaries in the United States →
Similar jobs
- Machine Learning Engineer | Contract | Remote at Tech Holding
Shares 10 skills: NLP, Vector Databases, RAG… · same country - Staff Machine Learning Engineer at Altana
Shares 9 skills: NLP, Vector Databases, RAG… · same country - Senior AI/ML Engineer at Node.Digital
Shares 11 skills: NLP, Vector Databases, RAG… · Senior level · same country - AI Engineer - SME at Accenture Federal Services
Shares 11 skills: NLP, Vector Databases, PyTorch… · Senior level · same country - Senior Machine Learning Engineer at Care Access
Shares 8 skills: NLP, PyTorch, Test Automation… · Senior level · same country - Staff Analyst, Analytics - Pharmacy Payment Integrity & Analytics at Judi Health
Also at this company
Is this your posting and you want it taken down? Email info@careerholo.com.