
Amazon SageMaker Inference now supports OpenAI-compatible APIs, allowing you to use existing tools like OpenAI SDK and LangChain with SageMaker endpoints by simply changing the endpoint URL.


<div><p>This article announces OpenAI-compatible API support for Amazon SageMaker Inference endpoints, enabling seamless integration with existing tools and frameworks.</p><ul><li>Use OpenAI SDK, LangChain, and Strands Agents directly with SageMaker endpoints</li><li>Switch endpoints by changing URL only—no custom code or SDK wrappers needed</li><li>Existing SDK calls, streaming logic, and framework integrations work unchanged</li><li>Choose own GPU instances and keep data in your VPC</li><li>Run any open source or fine-tuned model with auto-scaling policies</li><li>Authentication uses AWS credentials with automatic token refresh</li><li>Available in 14 regions globally</li></ul><p>SageMaker Inference now provides OpenAI-compatible APIs, eliminating integration complexity while maintaining full control over infrastructure and models.</p></div>


Related articles