AI Software Engineer

About the Role

We’re looking for an AI/ML Software Engineer to play a foundational role in building and deploying AI-powered solutions for our core product. You’ll work across the full AI/ML lifecycle, from defining and building models to evaluating and deploying large-scale ML pipelines and real-time inference systems, while partnering with cross-functional teams to deliver impactful, real-world AI applications.

What You'll Do

• Build and Deploy AI/ML Models
• Own and develop an AI model aligned with our core product needs within your first three months.
• Validate AI-driven product features through real-world testing and feedback from warfighters.
• Establish scalable MLOps pipelines and real-time inference services to streamline model training, deployment, runtime, and monitoring.
• Own high model reliability and uptime by implementing monitoring across your work.
• Data Collection & Processing
• Identify and integrate structured, unstructured, batch, and real-time data sources.
• Work with internal logs, APIs, user interactions, and third-party datasets to improve training data quality.
• Continuous Improvement & Best Practices
• Stay ahead of emerging AI trends and technologies to improve model performance.
• Document and share AI/ML development best practices.
• Contribute to the hiring and mentoring of AI/ML talent as we grow our team.
• Help the wider team understand the latest trends and the significance of novel approaches in AI.

What We’re Looking For

• Strong Programming Skills
• Expertise in at least one: Python, C++, or C.
• ML Framework Proficiency
• Hands-on experience with AI/ML training and fine-tuning frameworks, including:
• PyTorch, TensorFlow, CUDA, Jupyter Notebooks
• Large Language Models (LLMs) and Open-Source Models (Llama, Anthropic, Mistral)
• LangChain, Retrieval-Augmented Generation (RAG), Hugging Face, Exo Labs
• MLOps & Data Engineering Knowledge
• Experience with data processing and pipeline frameworks such as Apache Kafka, Apache Airflow, AWS Kinesis, pandas, and dbt.
• Understanding of AI model performance monitoring, data drift detection, and observability tools like Grafana or Kibana.
• AI Fundamentals & Security Awareness
• Deep understanding of deep neural networks (DNNs), LLMs, over/underfitting, prompt engineering, and LLM security (jailbreaking risks and protections).
• Growth Mindset
• A passion for continuous learning, staying current with the latest advancements in AI/ML, and teaching others

Bonus Points

• Experience mentoring and upskilling junior engineers.
• Familiarity with legacy systems and working with public sector customers.
• Contributions to open-source (AI/ML) projects.

Why Gallatin?

Compensation: Gallatin offers competitive compensation commensurate with experience. Actual compensation may vary based on experience, skills, and location. In addition to base salary, we offer a generous equity grant, full healthcare coverage, 401k, unlimited PTO, and the perks of working in a high-caliber, mission-driven environment.

This position may require the ability to obtain and maintain a U.S. government security clearance. The successful candidate must be able to work in a classified environment when necessary.

We comply with the United States Department of Labor's Pay Transparency provision.

Note: Due to the nature of certain government contracts held by this organization, U.S. citizenship is a requirement for all positions at Gallatin. Proof of citizenship will be required prior to employment if selected.