Job Description
JOB DESCRIPTION Build and maintain AI evaluation pipelines to test, measure, and evaluate the behavior and performance of AI systems. Implement traces, spans, and session tracking for observability and identify error propagation in multi-step pipelines. Define AI quality metrics and KPIs around factuality, faithfulness, toxicit...
Req ID: 375677
We are currently seeking a AI Eval / Testing (Eval Engineer) to join our team in Dallas, Texas (US-TX), United States (US).
Job title : AI Eval / Testing (Eval Engineer)
Experience level: 10 + years
Job Summary
We are looking for an AI Evaluation & Test Engineer to ensure generative AI models and applications are safe, accurate, trustworthy, and deliver an elegant user experience.
Validates AI models and agents for accuracy, safety, bias, and performance through structured testing, benchmarking, and continuous evaluation pipelines and will be responsible for following: