LLM Deployment Engineer
- Level
- Mid
Not stated in the posting: salary, work type, visa.
Open. First seen 4 November 2026.
About the role
About the role
We are seeking an LLM Deployment Engineer to drive the adoption of AI-powered automation across the organization. In this role, you will deploy and scale LLMs to streamline business processes and assist engineering R&D.
You'll work at the intersection of ML, software infrastructure engineering, and enterprise systems, by developing integration and automation solutions that enable teams across the organization to operate more efficiently.
What You´ll Do
· Deploy and maintain open-weights LLMs on cloud and local cluster.
· Scale deployments to serve a large number of users within the organization.
· Be up-to-date with new model releases, to keep our deployment state of the art.
· Connect LLMs to specific use cases, helping users across the organization to automate their work routine.
· Analyze the effectiveness of models on automation tasks.
· Embed security and privacy in the automation pipeline, to safeguard sensitive content.
Requirements
What You’ll Need
· 3+ years of professional experience in software engineering
· Experience working with LLM APIs, both open-weight and proprietary
· Familiarity with LLM applications, including tools, retrieval-augmented generation (RAG) and routing
· Experience with CI/CD pipelines, infrastructure as code, and modern software delivery practices
· Understanding of security and privacy considerations in enterprise environments
· Strong problem-solving skills and the ability to collaborate effectively across technical and non-technical teams
Nice to have
· Knowledge of Model Context Protocol (MCP) or similar interoperability standards
· Experience with AI governance, observability, or operational monitoring
· Proficiency with cloud platforms (AWS, GCP, or Azure), and high-performance computing environments (Kubernetes, SLURM).
· Experience in evaluating ML models.
Who You Are
You thrive in fast-paced environments where ambiguity is part of the challenge, and you can turn it into defined goals. You take ownership seriously and move things forward without waiting for perfect conditions. You know how to balance structure with flexibility without losing focus. Above all, you measure success by outcomes and take pride in getting things done.
What this role asks for
Standard for data science / ML roles
LLM · Machine Learning
Common in data science / ML postings at any company.
Compared with Destinus's other open jobs.
The team: Machine Learning & Software Engineering HIRES STEADILY
This role is one of 5 open in Machine Learning & Software Engineering. 1 was posted in the last 30 days and the oldest in April: a team that hires all year rather than one being built.
WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS
C++ (3 of 5), C (2 of 5), Embedded Systems (2 of 5), Machine Learning (2 of 5), Python (2 of 5)
OTHER ROLES ON THIS TEAM
- Machine Learning Engineer posted Aug 20
- Software Engineer posted Jul 30
- Digital Signal Processing Engineer posted May 19
- Satellite Communication Systems Engineer posted Apr 8
From the team and dates on Destinus's own job board.
Similar jobs
- Data Scientist at Cummins
Shares 7 skills: RAG, GCP, Azure… · same seniority - AI & ML Engineer | Banking at Capco
Shares 8 skills: RAG, GCP, Kubernetes… · same seniority - Senior MLOps Engineer at Salvo Software
Shares 8 skills: RAG, GCP, Kubernetes… - Senior Manager, AI Engineering at Palo Alto Networks
Shares 8 skills: RAG, GCP, Kubernetes… - Lead Software Engineer - Python and AI at JPMorgan Chase
Shares 8 skills: RAG, GCP, Kubernetes… - Mechanical Engineer, Jigs & Tools at Destinus
Also at this company
More jobs like this
Is this your posting? Email info@careerholo.com to have it removed.