Job Description

About the Role

As a Machine Learning Expert Rater, you will play a pivotal role in analyzing, fine-tuning, and optimizing machine learning models used for content moderation and policy enforcement. You will evaluate complex, nuanced content, assess AI reasoning processes, and collaborate with policy experts to ensure model outputs align with organizational standards. Your work will directly influence model performance, annotation workflows, and the overall quality of AI-driven policy decisions.

Responsibilities

• Evaluate and provide feedback on AI model outputs and reasoning (chain-of-thought) in nuanced Trust & Safety cases.
• Perform high-quality content annotations in partnership with Policy Experts.
• Support supervised fine-tuning and reinforcement learning (RLHF) processes.
• Conduct data analysis to identify patterns, trends, and model weaknesses.
• Produce clear reports and actionable insights for engineering and policy teams.
• Collaborate closely with policy enforcement teams to ensure ML models meet established guidelines.
• Maintain confidentiality and responsibly handle sensitive or challenging content.

Required Qualifications

• 1+ year of experience with AI model supervised fine-tuning or reinforcement learning (RLHF).
• 1+ year of experience in Machine Learning operations (MLOps).
• 1+ year of experience in User-Generated Content (UGC) moderation or Trust & Safety operations.
• Strong skills in data analysis, pattern detection, and reporting.
• Ability to handle edge-case or ambiguous scenarios in AI training sets.
• Native-level English communication skills.
• Deep familiarity with U.S. culture and context, gained through U.S. citizenship or at least 5 years of residency.
• Detail-oriented with strong ability to follow complex workflows and guidelines.

Equal Opportunity

All qualified applicants will receive consideration for a contractual relationship without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status. At TELUS Digital AI, we are proud to foster equal opportunity and are committed to building a diverse and inclusive community. Selection decisions are based solely on qualifications, merit, competence, and performance.

Job Tags

Similar Jobs