Remote

24-MAG

📍 New York, New York, United States

Full-time computer-and-mathematical

Job Description

We are sharing a specialised part-time consulting opportunity for highly detail-oriented professionals with experience in AI data evaluation, structured review, quality assurance, or human data operations.

This role supports the training and evaluation of advanced AI systems through precise annotation, output review, and rubric-based quality assessment. Selected professionals will follow detailed guidelines, identify subtle errors and edge cases, and provide structured feedback across high-volume evaluation workflows where accuracy and consistency are essential.

Key Responsibilities

AI Output Evaluation

  • Review, evaluate, and annotate AI-generated responses with exceptional attention to detail
  • Assess outputs for accuracy, consistency, relevance, and adherence to task requirements
  • Identify subtle errors, edge cases, contradictions, and quality issues
  • Distinguish between minor im...
Apply for this Position