Amazon SageMaker Notebook Instances now support Trainium1 and Inferentia 2 based instances

The article announces the general availability of Amazon EC2 Trn1 (powered by AWS Trainium chips) and Inf2 (powered by AWS Inferentia chips) instances on Amazon SageMaker Notebook Instances. These instances are purpose-built for high-performance deep learning training and inference, respectively.

Specifically, the article covers:

• Trn1 instances offer cost savings for training large language models (LLMs) and latent diffusion models
• Inf2 instances deliver low-cost, high-performance inference for generative AI like LLMs and vision transformers
• Use cases for these instances include text summarization, code generation, question answering, image and video generation, recommendation, and fraud detection
• Availability regions for Trn1 and Inf2 instances on SageMaker Notebook Instances
• Link to developer guide for setting up and using SageMaker Notebook Instances