Staff AI Engineer

Job Description

WHAT IS THE OPPORTUNITY?We're building the engine that judges how good our agents actually are. Claimshave to be data-driven: you can't build on what you can't see, so how can youhonestly say one version is 10% better than the last? Evaluation runs both beforewe ship and after; this role owns the runtime side — judging agents live inproduction, from the traces they generate serving real traffic.The hard part is the data. Agent behaviour generates verbose traces with highcardinality, and we need a system that can analyze them real-time, providingactionable insights in low latency. Join us to build it: the engineering looks alot like site reliability engineering meeting user analytics, combininghigh-throughput low latency data with evaluating user behaviour and outcomes.WHAT WILL YOU DO?

Build the ingestion path that takes agent traces at production volume and keeps up with it.

Score agent behaviour live — judge qual...

Apply for this Position