Remote Gmail & Google Calendar AI Assistant Evaluator — Specialist Placement
Hiring Agency: Remote Job Recruiting • Updated Today
Position Description
Remote Job Recruiting is recruiting an experienced Remote Gmail & Google Calendar AI Assistant Evaluator — Specialist Placement for a 100% remote contract supporting advanced artificial intelligence model development across the US, UK, Canada, Australia, New Zealand, and Ireland. Compensated at $15 - $30/hour, this role collaborates with frontier machine learning teams to author high-precision domain benchmarks, evaluate reasoning outputs, and refine domain-specific model accuracy.
Core Responsibilities & Deliverables
- Complete realistic, everyday digital tasks (emailing, scheduling, booking, coordinating) using AI assistant tools under standardized, repeatable conditions.
- Give an AI assistant clear instructions for real-world tasks, then carefully review and verify its work for accuracy and completeness.
- Apply detailed grading guidelines to evaluate, rank, and annotate assistant responses, providing structured feedback that improves model performance.
- Test scenarios involving email threads, calendar invites, online bookings, and multi-person coordination, ensuring coverage of diverse situations and edge cases.
- Utilize AI training tools and platforms to record findings and submit evaluation data in alignment with project standards and milestones.
- Collaborate with project trainers and contributors to resolve ambiguities, refine guidelines, and ensure evaluation consistency across the team.
- Participate in ongoing quality reviews, incorporating feedback to maintain rigorous evaluation standards.
Required Qualifications & Domain Skills
- Exceptional attention to detail and accuracy when reviewing model-generated output.
- Strong written communication skills for clear reporting and timely updates on progress and challenges.
- Demonstrated time management and self-organization for independent, remote project participation.
- Prior experience with AI evaluation, data labeling, user testing, or similar feedback-driven projects.
- Working knowledge of prompt writing and a practical understanding of AI assistant behaviors and limitations.
- Experience grading or reviewing AI outputs for accuracy, helpfulness, and safety.
- Compensation Band: $15 - $30/hour
Engagement Details & Compensation
- Compensation Rate: $15 - $30/hour (contract specialist remuneration)
- Work Arrangement: 100% Remote / Work From Home
- Eligible Remote Countries: United States, United Kingdom, Canada, Australia, New Zealand, Ireland, and South Africa
- Core Competencies: Gmail, Google Calendar, AI Usage, Scheduling, Emails, Google Meetings
- Hiring Agency: Remote Job Recruiting
Direct Application Process: Click the Apply button on this page to proceed directly to our partner application portal and submit your profile for immediate consideration.