Job Description

About Turing:

Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems.

Turing helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies.

Role Overview:

We're staffing a frontier AI data initiative that builds the training data and evaluations used to develop and measure AI agents. You'll join the QC team, the quality bar for the initiative, the last line of defense ensuring every task and rubric that ships is realistic, correct, and unambiguous.

What you'll do:

• Review long-horizon agent tasks authored by the mining team for realism, correctness, and scope, catching flawed assumptions, ambiguity, and missing edge cases before tasks ship.

• Pressure-test rubrics: confirm they define completion precisely, grade consistently, and can't be gamed or misread.

• Validate tasks end-to-end against the connector environments they run in, verifying that stated objectives are actually achievable and that expected outcomes hold.

• Reproduce and debug failures, then feed clear, specific findings back to task authors and connector engineers.

• Define and improve QC standards, checklists, and processes as the initiative scales.

What we're looking for: 

• Strong backend software engineering, primarily in Python, you can read others' code, run it, and debug it independently.

• Working knowledge of GCP, Docker, virtual machines, and Harbor.

• Exceptional attention to detail and a high bar for correctness; you find the failure others missed.

• Sharp written communication, precise, actionable feedback on tasks and rubrics is the core of the role.

• Ability to reason about real-world workflows and judge whether a task faithfully represents one.

• High daily proficiency with AI coding tools (e.g., Claude Code, Cursor, Copilot), a hard requirement.

Nice to have: 

• Experience in QA, evaluation design, red-teaming, or data quality at scale.

• Experience building or evaluating agentic/LLM systems.

• Familiarity with the SaaS tools being replicated (Slack, Linear, Jira, Notion, Gmail, wikis) at an API/data-model level.

• Candidates may specialize in QC, but the strongest profiles are excellent generalist backend engineers who can move across mining and connectors when needed.

Offer Details:

• Commitments Required: At least 4 hours per day and minimum 20 hours per week with overlap of 4 hours with PST. 

• Employment type : Contractor assignment (no medical/paid leave)

• Duration of contract : 35 week [expected start date is next week]

• Location : India, Pakistan, Nigeria, Egypt, Ghana, Bangladesh, Turkey, Mexico

Job Tags

Similar Jobs