True Talent Solutions Partners

Full-Stack Engineer, Agent Evaluation & Reliability

San Francisco
Salary
$120,000 - $180,000 annually
Level
Mid
Work type
On-site · San Francisco
Visa
Sponsors visas

Open. First seen 1 November 2026.

Apply on the company's site →

About the role

About the Role

Join a small, technical AI company building infrastructure that helps enterprise AI agents improve through production feedback. This backend-leaning full-stack role focuses on reliable evaluation systems and includes ownership of product features from design through delivery.

What You'll Do

  • Build backend systems for agent evaluation and continuous improvement.
  • Design data models for evaluation datasets, experiment runs, agent traces, knowledge versions, findings, and customer-defined quality criteria.
  • Develop and operate enterprise integrations, including authentication, OAuth, webhooks, incremental syncs, backfills, rate limits, retries, and monitoring.
  • Take features from technical design through implementation, deployment, monitoring, customer feedback, and iteration.
  • Work with customers to diagnose system failures and turn specific needs into reusable product capabilities.
  • Build product interfaces across the full stack while contributing to architecture and product decisions.

What We're Looking For

  • Two to four years of experience building and operating production software, including experience at a fast-paced startup.
  • Hands-on machine learning engineering experience that includes model development.
  • Strong production experience with TypeScript and Node.js or Bun, and the ability to work across the full stack.
  • Strong PostgreSQL knowledge and practical experience with Redis, job queues, background workers, or workflow systems.
  • Understanding of why evaluating nondeterministic AI agent systems differs from conventional software testing.
  • High ownership, fast learning, and the ability to take projects from start to finish.

Compensation & Benefits

Base salary: $120,000 to $180,000 annually. Visa sponsorship is available.

Location

On-site in San Francisco, California, United States.

What this role asks for

Particular to this role

OAuth · Redis

Rare in True Talent Solutions Partners's other 128 open postings.

Standard for full stack roles

JavaScript · Node.js · PostgreSQL · TypeScript

Common in full stack postings at any company.

Compared with True Talent Solutions Partners's other open jobs.

The team: Client Roles

This role is one of 129 open in Client Roles. 129 were posted in the last 30 days, including 6 lead roles: the team is hiring the people who run it too.

WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS

Python (71 of 129), LLM (45 of 129), TypeScript (42 of 129), React (37 of 129), AWS (29 of 129), Machine Learning (28 of 129), JavaScript (26 of 129)

OTHER ROLES ON THIS TEAM

From the team and dates on True Talent Solutions Partners's own job board.

Posting history

Reposted once since 25 October 2026: a posting for this role in San Francisco was taken down and the role was posted again.

  • 1 November 2026 – open (this posting)
  • 25 October 2026 – closed 27 October 2026

Similar jobs

More jobs like this

SKILLSMachine Learning 19,865JavaScript 15,474TypeScript 13,138PostgreSQL 8,710
PLACESSan Francisco 7,758United States 73,394
COMPANYJobs at True Talent Solutions Partners 129

Is this your posting? Email info@careerholo.com to have it removed.