Software Engineer - ML Infrastructure

About the Role

Arena Intelligence is seeking an ML Infrastructure Software Engineer to lead the design and development of scalable, low-latency model inference infrastructure, high-performance post-training infrastructure for reinforcement learning (RL), distributed ML training job execution, and comprehensive model evaluation frameworks. In this role, you’ll architect systems that execute complex training, inference, and evaluation workloads at scale, powering the insights that help researchers and developers build the world’s most advanced AI models. Working in close partnership with ML researchers, your contributions will be foundational to surfacing trustworthy, transparent, and timely evaluation and training signals across the platform.

This role is ideal for someone who thrives in fast-moving environments, cares deeply about performance and reliability, and wants to build systems that advance state-of-the-art AI capabilities.

You’ll

• Architect, scale, and optimize LLM post-training infrastructure tailored for reinforcement learning (RL) alongside with low-latency model inference services
• Design and maintain robust job execution systems for large-scale distributed ML training and fine-tuning workloads
• Build comprehensive, automated model evaluation frameworks to deliver rapid, reliable feedback signals to ML researchers
• Ensure high availability, low latency, and fault tolerance across GPU clusters and distributed event streams
• Collaborate cross-functionally with AI researchers, product leaders, and infrastructure teams to support evolving training and evaluation needs

You’ll have

• 5+ years of experience in software engineering, with a focused background in ML infrastructure, distributed systems, or large-scale data platform engineering
• Hands-on experience with PyTorch, model serving engines, and distributed training frameworks
• Solid background in reinforcement learning (RL) post-training infrastructure, RLHF, or automated model evaluation pipelines
• Proven ability to design and operate low-latency, high-throughput, and fault-tolerant distributed services at scale
• Strong foundation in systems design, GPU cluster utilization, and performance tuning
• Thrive in a fast-paced, high-ownership environment working closely with ML researchers

What we offer

• We offer competitive compensation aligned to the markets where our team members are based. The compensation range for each role is listed on its posting and will depend on the candidate's experience and work location.
• Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs.
• The opportunity to work on cutting-edge AI with a small, mission-driven team
• A culture that values transparency, trust, and community impact