Llama 2 foundation models from Meta are now available in Amazon SageMaker JumpStart
Blog
This article announces the availability of Meta's Llama 2 foundation models through Amazon SageMaker JumpStart for fine-tuning and deployment.
- Llama 2 models range from 7B to 70B parameters with pre-trained and chat-optimized variants
- Deploy models via SageMaker Studio UI or Python SDK with a few clicks
- Fine-tune Llama 2 7B and 13B models on your own datasets in 1-2 hours
- Chat models accept conversation history; pre-trained models perform text completion
- Available in five AWS regions with inference and fine-tuning capabilities
- Supports inference parameters like max_new_tokens, temperature, and top_p
- Uses FSDP and LoRA methods for efficient fine-tuning
Llama 2 models are now accessible through SageMaker JumpStart, enabling developers to quickly deploy and customize large language models for various NLP tasks without extensive infrastructure setup.
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.