Machine Learning System Software Architect
- Level
- Lead
Not stated in the posting: salary, work type, visa.
Open. First seen 2 October 2026.
About the role
Do you want to be part of the AI revolution? Do you want to think out of the box, thriving on challenges in AI industry and the desire to solve them? Do you want to work with a world-class team to explore the fast-growing AI hardware opportunities and impact on AI industry?
We’re looking forward to you joining us to collaborate, contribute, and revolutionize AI silicon and system.
Description
We are looking for a world-class Machine Learning System Software Architect to join our SoC team at Baidu’s Sunnyvale office. The successful candidate will be a motivated self-starter who will thrive in this highly technical environment. Your job responsibilities as a Machine Learning System Software Architect will help the team to architect and create high-performance machine learning system software and build the distributed AI training system by connecting thousands of Kunlun Accelerators and servers.
Create differentiated architectural innovations for Baidu’s Kunlun AI SoC roadmap. Architect, simulate, and design amazing machine learning solutions for our AI machine learning products.
Develop system-level ML architectures that push the boundaries of performance, power, and latency; and collaborate closely with many other teammates to ensure we design and optimize hardware and software for maximum performance.
Monitor industrial and academic trends in artificial intelligence and determine where they should intersect our roadmaps. Drive partnerships for access to the most advanced AI technologies
Evaluate the power, performance, and cost of prospective architecture and subsystems. Build scalable tools for modeling and performance evaluation.
Engage with system and application software engineers to ensure optimization of the entire hardware/software stack.
Work with SoC design, verification, and validation engineers to execute the architecture.
Qualifications
- Knowledge of Machine Learning market, technological and business trends, software ecosystem, and emerging applications.
- Proven track record of 5+ years architecting software solutions for Machine Learning, acceleration and optimization, especially in large distributed training system and HPC area.
- Experience with deep learning frameworks: TensorFlow/PyTorch/PaddlePaddle, etc.
- Strong track record of outreach to ML researchers and application developers.
- Experience with CPUs, GPUs, memory systems, and accelerators.
- Experience with performance simulation and modeling in C++
- MS or PhD in Electrical or Computer Engineering.
- Excellent communication skills in both English and Chinese.
Baidu USA's standard text
Culture Fit:
- Mission alignment: If you want to be part of a team to accomplish this great mission, we will provide you the best possible platform to do that.
- Self-directed: We work best with people that are driven, motivated, and aspire to greatness.
- Hungry to learn: We are eager to see you learn new skills and grow.
- Team orientation: We work in small, fast-moving teams. We watch out for each other and go after big goals together as a team.
#LI-DNI
What this role asks for
Particular to this role
Deep Learning · TensorFlow
Rare in Baidu USA's other 14 open postings.
Standard for data science / ML roles
Machine Learning · PyTorch
Common in data science / ML postings at any company.
82% of this description is written for the role. The rest is Baidu USA's standard text, folded away below.
Read against Baidu USA's other open postings on this site.
The team: XingYun Research & Development Center
This role is one of 11 open in XingYun Research & Development Center.
WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS
C++ (6 of 11), C (4 of 11), Perl (4 of 11), Python (4 of 11), Deep Learning (2 of 11), FPGA (2 of 11), Machine Learning (2 of 11)
OTHER ROLES ON THIS TEAM
- Senior RTL Design Engineer posted Aug 22
- CPU Design Architect / Principal Digital Design Engineer posted Aug 22
- CPU Digital Design Engineer posted Aug 22
- System Software Engineer – Lead Engineer posted Aug 14
- Design Verification Engineer posted Jun 18
- SoC System Hardware Architect posted Jun 18
- SoC Memory Subsystem Architect posted Jun 18
- Low Power SoC Hardware Architect posted Jun 18
- Machine Learning System Hardware Architect posted Jun 15
- CPU/GPU/Processor Hardware Architect posted Jun 15
From the team and dates on Baidu USA's own job board.
Similar jobs
- Senior Software Engineer, Machine Learning (Audio) at Syntiant
Shares 5 skills: Deep Learning, TensorFlow, PyTorch… · same country - Senior Machine Learning Engineer II (EO/IR Image Analysis) at Rocket Lab Corporation
Shares 5 skills: Deep Learning, TensorFlow, PyTorch… · same country - Senior Machine Learning Engineer at Canopy
Shares 5 skills: Deep Learning, TensorFlow, PyTorch… · same country - Director of Computer Vision and Machine Learning at Allen Control Systems
Shares 4 skills: Deep Learning, PyTorch, C++… · Lead level · same country - Senior Machine Learning Engineer (Applied Intelligence) at Anduril Industries
Shares 4 skills: Deep Learning, TensorFlow, PyTorch… · same country - System Software Engineer – Lead Engineer at Baidu USA
Also at this company
Is this your posting and you want it taken down? Email info@careerholo.com.