LLM Red-Teamer

LLM Red-Teamer

Role Type: Contractor

Location: Remote

Scope of Work

Develop complex, adversarial multi-turn conversations and task-based scenarios aligned with detailed project specifications.

Author clear, precise evaluation rubrics to rigorously assess model responses against defined behavioral targets.

Iteratively test conversations and tasks against frontier LLMs, escalating difficulty and nuance until the desired quality threshold is achieved.

Deliver comprehensive task packages, including transcripts, target behaviors, binary rubrics, and supporting rationale or evidence.

Validate LLM outputs, documenting model strengths and failure modes relative to the project specification.

Maintain calibration with team leads and quality control contacts as project requirements evolve.

Contribute independently, producing high-quality deliverables at a steady and consistent pace.

Preferred Qualifications