HyperPod enhances ML infrastructure with security and storage

This article announces new security and storage enhancements for Amazon SageMaker HyperPod, a purpose-built infrastructure for foundation model training and inference at scale.

• Customer Managed Keys (CMK) support enables encryption of EBS volumes with customer-controlled keys for compliance
• CMK support allows independent encryption of root and secondary volumes with different keys per instance group
• Custom AMIs can be encrypted with CMK independently of volume encryption
• Amazon EBS CSI driver support enables dynamic, Pod-level storage management for Kubernetes volumes
• EBS CSI driver supports both ephemeral and persistent volumes for large-scale AI workloads
• Volume resizing capability allows dynamic expansion of storage without cluster recreation
• Features require HyperPod cluster with Amazon EKS orchestration and continuous node provisioning

These enhancements make SageMaker HyperPod more enterprise-ready by providing enhanced security governance and flexible storage options for foundation model training and deployment.