← All jobs
True Talent Solutions Partners

Member of Technical Staff

San Francisco
Salary
$200,000 - $300,000 annually
Level
Staff
Work type
On-site · San Francisco
Visa
Sponsors visas

Open. First seen 25 October 2026.

Apply on the company's site →

About the role

About the Role

Join a small AI infrastructure team building systems that improve the performance and efficiency of large language model inference. You will work across model serving, GPU kernels, and heterogeneous computing infrastructure, with ownership of problems from customer needs through production deployment.

What You'll Do

  • Deliver day-one support for new open-source models, tuning them for latency and throughput.
  • Improve model serving through batching, KV cache management, speculative decoding, and quantization.
  • Write and tune kernels using CUDA, HIP, and Triton across a range of accelerator hardware.
  • Design, deploy, and operate clusters across multiple hardware vendors.
  • Run production inference on mixed hardware fleets, focusing on reliability, observability, and cost efficiency.
  • Work with customers to understand performance needs and help set technical priorities.

What We're Looking For

  • Typically 1 to 6 years of experience in backend, infrastructure, systems, or low-level engineering, including experience at scale or ownership of complex systems end to end.
  • Strong understanding of computer architecture, memory hierarchy, and operating system internals beyond application-level development.
  • Hands-on experience with CUDA, HIP, Triton, or other GPU programming, plus Python and familiarity with accelerators such as TPUs or AWS Trainium.
  • Knowledge of ML inference optimization techniques such as quantization, batching, KV caches, and speculative decoding.
  • Strong computer science fundamentals, demonstrated problem-solving ability, and interest in applying AI coding tools to improve engineering workflows.
  • Comfort communicating with customers and working across both systems engineering and broader software development.

Compensation & Benefits

Base salary is $200,000 to $300,000 USD annually. Visa sponsorship is available.

Location

On-site in San Francisco, California, five days per week.

What this role asks for

Particular to this role

CUDA

Rare in True Talent Solutions Partners's other 117 open postings.

Compared with True Talent Solutions Partners's other open jobs.

The team: Client Roles

This role is one of 118 open in Client Roles. 118 were posted in the last 30 days, including 6 lead roles: the team is hiring the people who run it too.

WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS

Python (64 of 118), LLM (47 of 118), TypeScript (47 of 118), React (38 of 118), Machine Learning (30 of 118), AWS (27 of 118), JavaScript (27 of 118)

OTHER ROLES ON THIS TEAM

From the team and dates on True Talent Solutions Partners's own job board.

Other openings for this role

2 open postings for this role in San Francisco, first posted 25 October 2026. The company is likely hiring for more than one position. None has been taken down and posted again.

Salary context

41 other open postings titled Member of Technical Staff state a salary: median USD 160,000 to USD 300,000 a year.

Similar jobs

Is this your posting? Email info@careerholo.com to have it removed.