Amazon Bedrock has introduced Intelligent Prompt Routing, a new feature that dynamically routes prompts to the most appropriate foundational model within a model family.

• Routes prompts to optimize response quality and cost
• Uses advanced prompt matching and model understanding techniques
• Predicts the best model for each request to provide optimal responses
• Currently supports routing between:
  • Claude Sonnet 3.5 and Claude Haiku
  • Llama 3.1 8B and Llama 3.1 70B
• Part of Amazon Bedrock's managed service for foundation models

The preview allows customers to build more cost-effective generative AI applications by intelligently selecting the most appropriate model for each request.