Machine Learning Systems Engineer

About the company

Our client is a software company.

The role

Raydar is recruiting for this role on behalf of our client. Own low-level performance work for machine learning model serving in production, tuning compute clusters and building the tooling that measures results. Partner with researchers to bring new model designs into live systems, and speak directly with customers when technical needs have to be pinned down.

What you'll do

- Design, deploy and tune model serving systems across multi-node clusters to raise throughput and cut response times for production workloads.

- Implement targeted performance improvements and benchmark their impact.

- Diagnose performance bottlenecks across the stack, from GPU execution to memory limits.

- Build test and benchmarking tooling that compares quality, speed and resource usage across different parallelism approaches.

- Partner with research scientists to move new model architectures and optimizations into production infrastructure.

- Keep up with academic and open-source work and apply promising ideas to improve performance.

- Talk with customers to understand and clarify their technical needs.

Requirements

What we're looking for

- Software engineering background at companies that build hardware or chip design tools.

- Track record of tuning performance for high-performance computing and machine learning workloads.

- Experience shipping native compiled software that runs in customer environments, in a language such as C, Rust or Go.

- Strong skills in Python and C++/CUDA, plus hands-on use of a common model serving framework such as PyTorch.

- A degree in electrical engineering, computer science or a closely related discipline.

- Comfortable engaging customers directly and representing the company in a professional manner.

Bonus points

- Background building performance-critical engines or algorithms at chip design software vendors.

- Familiarity with C++ performance modeling and simulation libraries.

- Experience with machine learning or heavy numerical workloads running on consumer devices.

- Experience in scientific or numerical computing.

Benefits

Compensation and benefits

- Base salary: USD 180,000 to 350,000 per year

- Equity

- Health, dental and vision coverage

- Retirement plan

- Flexible time off

- Relocation support

Location and work model

- San Jose, California, United States

- On-site, 5 days per week in office

- Full-time