Sr. Backend Engineer, Enterprise

BACKEND ENGINEER, ENTERPRISE

The Enterprise Agents Engineering Team at SpaceXSI is a team of builders solving the hardest problems in applied AI: integrating with messy systems, orchestrating complex workflows, and harnessing AI to transform business operations. We build full-stack solutions with ownership of end-to-end product execution from ideation to deployment, collaborating closely with our team to incorporate cutting-edge AI advancements into robust and reliable user-centric solutions. Through an iterative development process, we work hand-in-hand with customers to gather feedback, refine features, and evolve products to address real-world challenges.

RESPONSIBILITIES:

• Build and maintain the unified inference stack as the single surface area for all inference needs across the company
• Own and evolve the platform services that power Chat API, Imagine API, Voice API, Grok Build, and Grok Bot
• Design, build, and maintain Chat API features including batch API, collections API, files API, and related capabilities
• Implement and operate chat moderation and abuse protection systems across the API and grok.com
• Build and maintain the company-wide logging system for all request types, including enforcement of Zero Data Retention (ZDR) policies
• Manage multi-region inference cluster (IC) deployments, data aggregation, data replication, and the distributed authentication system
• Participate in follow-the-sun on-call coverage (UK → Japan → US) to ensure continuous reliability of the inference platform

BASIC QUALIFICATIONS:

• 5+ years of experience in designing, implementing, and maintaining reliable and horizontally scalable distributed systems
• Experience with Rust or C++

PREFERRED SKILLS AND EXPERIENCE:

• Experience with operating databases such as PostgreSQL, ClickHouse, and CockroachDB
• Knowledge of service observability and reliability best practices
• Expert knowledge of Python
• Expert knowledge of TypeScript
• Experience with Docker, Kubernetes, and containerized applications
• Expert knowledge of gRPC (unary, response streaming, bi-directional streaming, REST mapping)
• Hands-on experience with LLM APIs, embeddings, or RAG patterns
• Track record of delivering user-facing software at scale