Clera

Research Engineer, Benchmarks

Singapore
Salary
$100,000 - $170,000 annually
Level
Mid
Work type
On-site · Singapore
Visa
Sponsors visas

Open. First seen 28 October 2026.

Apply on the company's site →

About the role

About the Role

Join a small, technical team in the AI evaluation sector to design and build rigorous benchmarks for frontier AI agents. Your work will help ensure evaluations reflect realistic workflows and provide credible insights into real-world agent performance.

What You'll Do

  • Design, implement, and maintain internal benchmarks for evaluating AI agents on domain-specific tasks.
  • Work with subject-matter experts to translate real workflows into evaluation tasks and criteria.
  • Build reliable infrastructure to run models and agents against benchmark tasks at scale.
  • Develop metrics and analyses to assess benchmark difficulty, reliability, and failure modes.
  • Validate how benchmark results relate to real-world evaluations and user needs.
  • Write clear technical documentation and benchmark reports.

What We're Looking For

  • Two to four years of experience in software engineering, machine learning engineering, or research, including at least two years building AI benchmarks, evaluation infrastructure, or agent environments.
  • A degree in a technical field and strong proficiency in Python, Docker, and Linux.
  • Experience designing and operating benchmark or evaluation environments for AI agents or large language models.
  • Background building infrastructure to run AI models or agents reliably, and developing metrics, statistical analyses, or validation studies.
  • Experience collaborating with subject-matter experts to model workflows across technical or business domains and create benchmark tasks.
  • Strong technical writing, attention to detail, and ability to reason from first principles in an early-stage, unstructured environment.
  • Published research or technical writing on AI benchmarking, model evaluation, or failure modes is valued. Reinforcement learning experience is also useful.

Compensation & Benefits

Base salary: $100,000 to $170,000 USD annually. Visa sponsorship is available.

Location

On-site in Singapore, Singapore.

What this role asks for

Particular to this role

Docker · Linux

Rare in Clera's other 299 open postings.

Standard for software engineering roles

Python

Common in software engineering postings at any company.

Compared with Clera's other open jobs.

The team: Engineering HIRES STEADILY

This role is one of 210 open in Engineering. 144 were posted in the last 30 days and the oldest in March: a team that hires all year rather than one being built.

WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS

LLM (103 of 210), TypeScript (95 of 210), Python (82 of 210), React (81 of 210), Machine Learning (42 of 210), PostgreSQL (39 of 210), JavaScript (36 of 210)

OTHER ROLES ON THIS TEAM

From the team and dates on Clera's own job board.

Posting history

Reposted once since 3 October 2026: a posting for this role in Singapore was taken down and the role was posted again.

Similar jobs

More jobs like this

SKILLSPython 46,045Machine Learning 19,787LLM 18,620Linux 12,138
PLACESSingapore 3,159
COMPANYJobs at Clera 212

Is this your posting? Email info@careerholo.com to have it removed.