← All jobs
True Talent Solutions Partners

Machine Learning Infrastructure Engineer

San Francisco
Salary
$200,000 - $400,000 annually
Level
Mid
Work type
On-site · San Francisco
Visa
Not offered

Open. First seen 25 October 2026.

Apply on the company's site →

About the role

About the Role

Join an AI team developing foundation models for physical systems, with weather as an initial application. You will build the distributed infrastructure that supports large-scale model training and inference, helping advance AI for science and physical AI.

What You'll Do

  • Design, deploy, and maintain distributed machine learning training and inference clusters.
  • Build scalable end-to-end pipelines for petabyte-scale datasets and the full model lifecycle.
  • Research and evaluate training approaches, including parallelization strategies and numerical precision trade-offs across model scales.
  • Profile and debug low-level GPU operations to improve performance.
  • Analyze experiment results, including through ablation studies, and apply relevant research to infrastructure work.

What We're Looking For

  • Two to ten years of experience building large-scale machine learning infrastructure for pre-trained or foundation models.
  • Hands-on experience across compute clusters, data infrastructure, distributed training, and inference, with a record of optimizing large-scale workloads.
  • Proficiency with distributed training frameworks such as FSDP or DeepSpeed, and experience with GPU performance optimization and debugging, including CUDA and JAX.
  • Knowledge of cloud platforms such as GCP, AWS, or Azure, plus containers and orchestration tools such as Docker and Kubernetes.
  • Familiarity with model serving, distributed task management, and ML system monitoring, logging, observability, and version control.
  • Experience in AI for science or physical AI, such as robotics, autonomous systems, or biology, and a generalist approach across the ML lifecycle.
  • Comfort working in fast-paced, time-sensitive environments and learning unfamiliar domains.

Compensation & Benefits

Base salary: $200,000 to $400,000 annually. Visa sponsorship is not available.

Location

On-site in San Francisco, California, United States, five days per week. Relocation support is provided.

What this role asks for

Particular to this role

CUDA

Rare in True Talent Solutions Partners's other 117 open postings.

Standard for DevOps / SRE / cloud roles

AWS · Azure · Docker · GCP · Kubernetes

Common in DevOps / SRE / cloud postings at any company.

Compared with True Talent Solutions Partners's other open jobs.

The team: Client Roles

This role is one of 118 open in Client Roles. 118 were posted in the last 30 days, including 6 lead roles: the team is hiring the people who run it too.

WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS

Python (64 of 118), LLM (47 of 118), TypeScript (47 of 118), React (38 of 118), Machine Learning (30 of 118), AWS (27 of 118), JavaScript (27 of 118)

OTHER ROLES ON THIS TEAM

From the team and dates on True Talent Solutions Partners's own job board.

Salary context

6 other open postings titled Machine Learning Infrastructure Engineer state a salary: median USD 200,000 to USD 350,000 a year.

Similar jobs

Is this your posting? Email info@careerholo.com to have it removed.