Sr. Software Engineer- Databricks AI

P-1700

At Databricks, we are passionate about helping enterprises that build ML models and AI agents deliver high-quality AI to production fast. Founded by engineers, and customer obsessed, we leap at every opportunity to tackle technical challenges, from designing great developer experiences to building reliable systems at global scale. And we're only getting started.

Our team builds the MLOps and LLMOps platform that millions of AI developers and ML practitioners use to track model training experiments, manage model registry, observe and evaluate AI agents. We're the team behind MLflow, the most widely adopted open-source AI engineering platform with more than 30 million package downloads per month, and its managed service used by thousands of organizations globally. We're now expanding to Bengaluru, India, and building our first AI engineering team there from scratch to work on this platform.

As a Senior Software Engineer and a founding member of the Bengaluru team, you'll design and build the backend systems behind these products and take them from design through production. This is an excellent opportunity for a hands-on engineer who thrives in a fast-paced environment.

Check out our recent blog post: coSTAR: How we ship AI agents at Databricks fast, without breaking things

The impact you will have:

• Design and implement core services and APIs for the platform, ensuring scalability, reliability, and operational excellence.
• Build systems that ingest, store, and query traces, metrics, and artifacts from training runs and production agents.
• Develop evaluation and monitoring capabilities, such as LLM judges and quality metrics, that catch regressions before they reach production.
• Optimize the scalability and cost of the platform as usage grows across customers and cloud regions.
• Work with product, research, and customers on what we build next.
• Establish best practices for code quality, testing, and operational readiness, and mentor other engineers.

What we look for:

• BS (or higher) in Computer Science, or a related field.
• 5+ years of experience developing large-scale distributed systems, scaling infrastructure, or building platforms and developer tools for other teams.
• Strong foundation in algorithms, data structures, and system design.
• Strong experience with backend technical stacks such as Scala or Java.
• Experience with cloud technologies, e.g. AWS, Azure, GCP, Docker, Kubernetes.
• Engineering maturity in security, correctness, and operational excellence.
• Strong communication skills and ability to collaborate across teams.
• Experience with ML or LLM systems is a plus.

Compliance

If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.