Senior AI Evaluation Engineer: CI/CD & Quality Metrics

Optimum Solutions is seeking a skilled AI evaluation engineer for a 6-month contract in Singapore. The role focuses on owning the ACS evaluation workstream, establishing regression tests, and ensuring end-to-end traceability across AI agents and tools.

You will work with EvalsHub-like tech, LangSmith, LangChain, and Temporal to build reusable evaluation pipelines, integrate with CI/CD, and deliver measurable agent-quality outcomes. On-site schedule applies.