SageMaker Inference now supports OpenAI-compatible APIs

Amazon SageMaker Inference now supports OpenAI-compatible APIs, enabling direct integration with tools like OpenAI SDK, LangChain, and Strands Agents by simply changing an endpoint URL. This new feature removes the need for custom integration code or SDK wrappers, allowing users to leverage existing SDK calls and framework integrations with SageMaker endpoints while retaining control over GPU instances, VPC data, and auto-scaling. The update is available in multiple AWS regions.