Remote Member of Technical Staff, Coding Research — Technical & Domain Contract
Hiring Agency: Remote Job Recruiting • Updated Today
Position Description
Remote Job Recruiting is recruiting an experienced Remote Member of Technical Staff, Coding Research — Technical & Domain Contract for a 100% remote contract supporting advanced artificial intelligence model development across the US, UK, Canada, Australia, New Zealand, and Ireland. Compensated at $600,000 - $1,300,000/year, this role collaborates with frontier machine learning teams to author high-precision domain benchmarks, evaluate reasoning outputs, and refine domain-specific model accuracy.
Core Responsibilities & Deliverables
- Design and own evaluation frameworks for coding agents, including benchmark specifications, scoring methodologies, rubrics, and quality standards.
- Lead from initial concept through completion research initiatives focused on measuring and improving coding model performance across diverse software engineering tasks.
- Develop high-quality datasets, golden examples, and evaluation protocols that enable reliable assessment of frontier coding systems.
- Analyze model behavior and failure modes, identifying systematic weaknesses and translating findings into actionable improvements for training and evaluation.
- Build tooling and infrastructure that support large-scale experimentation, data generation, review workflows, and evaluation pipelines.
- Establish best practices for coding-agent assessment, ensuring methodological rigor, reproducibility, and measurement quality.
- Partner closely with researchers, engineers, and applied AI teams to design experiments and evaluate emerging model capabilities.
Required Qualifications & Domain Skills
- Comfortable operating in fast-moving research environments with significant ambiguity and evolving priorities.
- Experience working on frontier AI systems, coding agents, or model evaluation research.
- Deep interest in understanding how data, evaluations, and feedback mechanisms influence model capabilities.
- Track record of independently driving ambiguous technical or research projects from conception to execution.
- Experience designing benchmarks or datasets for machine learning systems at scale.
- Working knowledge of agentic workflows, tool use, reinforcement learning, or post-training methodologies.
- Publications, open-source contributions, or demonstrated technical leadership in AI, machine learning, or software engineering.
Engagement Details & Compensation
- Compensation Rate: $600,000 - $1,300,000/year (contract specialist remuneration)
- Work Arrangement: 100% Remote / Work From Home
- Eligible Remote Countries: United States, United Kingdom, Canada, Australia, New Zealand, Ireland, and South Africa
- Core Competencies: LLMs, Coding Evaluation, AI Evaluation, ML Systems
- Hiring Agency: Remote Job Recruiting
Direct Application Process: Click the Apply button on this page to proceed directly to our partner application portal and submit your profile for immediate consideration.