Adversarial Risk Evaluator AI Trainer, [$20–$30]/hour

Project Overview:

Join a growing community of professionals advancing the next wave of AI. As an AI Trainer, you’ll play a hands-on role by analyzing and providing feedback on data to improve LLM performance, helping ensure that the next generation of AI technology is accurate and trustworthy.

We are seeking a skilled Trust & Safety / Content Review professional to work as a project consultant in our AI Labor Marketplace. This is not a full-time employment position — you will be engaged as an expert project consultant on a contract basis.

Location:

U.S.-based experts only

Engagement:

Part-time, project-based expert evaluation work

Work Type:

Remote

Project Summary:

Evaluate AI-generated responses for safety and policy alignment across categories such as hate, sexual content, violence, and self-harm. Apply structured scoring rubrics, assign severity ratings, and provide concise written justifications to support high-quality evaluation datasets.

Consultant Engagement Terms:

This is a project-based consultant role. Consultants will be paid on a per-project basis; hourly rates are estimates based on anticipated completion time. Consultants control their own schedule, provide their own tools, and may simultaneously provide services to other vendors/employers (subject to those vendors’ allowances).

Responsibilities:

Contributors will:

• Review prompt–response pairs generated by AI systems
• Assign relevance scores using defined rating scales
• Evaluate and classify safety risks across multiple content categories
• Apply severity ratings in alignment with provided policy guidelines
• Write brief, clear justifications for each evaluation
• Maintain consistency across high volumes of tasks
• Adhere to quality standards and feedback from QA or calibration processes

Expected Outcomes:

• High-quality, consistent annotations across assigned tasks
• Accurate application of safety and relevance rubrics
• Clear, concise written justifications supporting each rating
• Reliable throughput aligned with project expectations

Qualifications:

• Experience in trust & safety, content moderation, QA, or AI evaluation preferred
• Strong written communication and judgment skills
• Ability to follow detailed guidelines and apply structured rubrics consistently
• Comfortable reviewing sensitive or explicit content
• High attention to detail and ability to work independently in a remote environment