True Talent Solutions Partners

Member of Technical Staff

San Francisco
Salary
$200,000 - $300,000 annually
Level
Staff
Work type
On-site · San Francisco
Visa
Sponsors visas

Open. First seen 7 November 2026.

Apply on the company's site →

About the role

About the Role

Join a small AI infrastructure team building systems that improve the performance and efficiency of large language model inference. You will work across software and hardware, with broad ownership from customer needs through production deployment.

What You'll Do

  • Deliver support for new open-source models, tuning them for latency and throughput.
  • Optimize inference serving, including batching, KV caching, speculative decoding, and quantization.
  • Write and tune kernels using CUDA, HIP, and Triton across a range of accelerator platforms.
  • Design, deploy, and operate clusters spanning multiple hardware vendors.
  • Run production inference across heterogeneous fleets, improving reliability, observability, and cost efficiency.
  • Work with customers to understand problems and develop practical systems solutions.

What We're Looking For

  • Typically 1 to 6 years of relevant experience, including strong early-career candidates with substantial internship or project experience.
  • Experience in backend, infrastructure, or systems engineering, with demonstrated work beyond application-level development.
  • Strong understanding of computer architecture, memory hierarchy, and operating system internals.
  • Familiarity with GPU programming or inference optimization, such as CUDA, Triton, quantization, batching, KV caching, or speculative decoding.
  • Experience deploying or operating infrastructure at scale, such as clusters or large GPU fleets, is valuable.
  • Strong computer science fundamentals, ownership of challenging technical work, and effective use of AI coding tools.
  • Comfort communicating with customers and working across a broad range of engineering problems.

Compensation & Benefits

Base salary: $200,000 to $300,000 annually. Visa sponsorship is available.

Location

On-site in San Francisco, California, five days per week.

What this role asks for

Particular to this role

CUDA

Rare in True Talent Solutions Partners's other 121 open postings.

Compared with True Talent Solutions Partners's other open jobs.

The team: Client Roles

This role is one of 122 open in Client Roles. 122 were posted in the last 30 days, including 5 lead roles: the team is hiring the people who run it too.

WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS

Python (67 of 122), LLM (48 of 122), TypeScript (39 of 122), React (36 of 122), Machine Learning (32 of 122), AWS (31 of 122), JavaScript (21 of 122)

OTHER ROLES ON THIS TEAM

From the team and dates on True Talent Solutions Partners's own job board.

Posting history

Reposted 5 times since 25 October 2026: a posting for this role in San Francisco was taken down and the role was posted again.

Salary context

42 other open postings titled Member of Technical Staff state a salary: median USD 177,500 to USD 300,000 a year.

Similar jobs

More jobs like this

SKILLSLLM 19,799CUDA 1,102
PLACESSan Francisco 8,596United States 78,233
COMPANYJobs at True Talent Solutions Partners 122

Is this your posting? Email info@careerholo.com to have it removed.