Evaluating AI Agents: A production blueprint with Strands and AgentCore from AWS and Motorway
Motorway, a UK online car marketplace, partnered with AWS to build an AI-powered dealer stock search agent. They developed an evaluation pipeline combining Strands Agents SDK and Amazon Bedrock AgentCore, reducing incorrect results from 1 in 8 queries to 1 in 50 and cutting issue detection time from hours to minutes. The blueprint includes a three-layer evaluation framework for tool usage, reasoning, and output quality, with quality gates blocking deployments when metrics fall below thresholds.
Amazon/AWS
Amazon Web Services
Anthropic
AWS ML blog23.07 · 23:49