Browse jobs
Straight from companies' own career pages, updated as roles open, change or close.
Straight from companies' own career pages, updated as roles open, change or close.
Role: AI Engineer โ Agent Evaluation Specialist
Location: Los Angeles, CA (Hybrid)
Duration: 3+ Months (Possible Extension)
Primary Focus: Hands-on Agent Evaluation
Specialisation: Agentic AI, AWS Bedrock AgentCore, Claude Agent SDK, Langfuse, AI Observability & Evaluation
We are looking for an AI Engineer with strong, practical experience in evaluating LLM-powered agents, rather than someone focused primarily on building or developing agents.
Key Requirements (Must-Have):
Critical Screening Criteria:
Candidates must demonstrate actual implementation experience with agent evaluation frameworks, not just theoretical knowledge or general GenAI/LLM development.
Agent evaluation is the core requirement and will be the primary selection criterion.
All your information will be kept confidential according to EEO guidelines.