Senior Software Engineer - AI Interaction Evaluator (Codex / Claude Code)

About the role

We are seeking a senior‑level software engineer to evaluate the quality of interactions with modern AI coding agents such as OpenAI Codex and Claude Code. This is a contract position focused on assessing how well the model mimics the reasoning and judgment of an experienced developer, rather than writing production code.

Key responsibilities

• Evaluate AI‑generated coding interactions end‑to‑end.
• Judge whether outputs are useful, high‑level correct, and aligned with strong engineering thinking.
• Assess the quality of explanations and reasoning, not just the code itself.
• Distinguish between different levels of response quality and provide clear, opinionated feedback.
• Help define standards for great interactions with tools like Cursor.

Required profile

• Staff or principal‑level engineer (or equivalent experience).
• Strong background in TypeScript/JavaScript or Python.
• Hands‑on experience with OpenAI Codex, Claude Code, and AI‑first IDEs such as Cursor.
• Deep familiarity with modern AI‑assisted development workflows.
• Ability to evaluate code without fully executing every line.
• Comfortable delivering direct, rigorous feedback.

Required skills

• TypeScript
• JavaScript
• Python
• OpenAI Codex
• Claude Code
• Cursor (AI‑first IDE)

What we offer

• Hourly rates up to $200 USD (US/Canada), $150 EUR (EU/Latam), $100 USD (other locations).
• 10–20 hours per week, remote work.
• Engagement through early May with possible extension.
• Take‑home evaluation exercise and one behavioral interview.