
    Amazon Bedrock Intelligent Prompt Routing enables cost-effective and efficient routing between different foundation models within the same model family, dynamically predicting and selecting the most appropriate model based on response quality and cost.


<div>
<p>
AWS has announced the general availability of Amazon Bedrock Intelligent Prompt Routing, a feature that dynamically routes requests between different foundation models to optimize cost and performance.
</p>
<ul>
<li>Supports models from Anthropic, Meta, and Nova families</li>
<li>Can use default pre-configured routers or create custom configurations</li>
<li>Reduces routing overhead to approximately 85 ms</li>
<li>Achieved up to 56% cost savings in internal tests</li>
<li>Allows routing between two models within the same model family</li>
</ul>
<p>
Key benefits include cost optimization, improved latency, and maintaining response quality by intelligently routing prompts to the most appropriate model based on complexity and cost.
</p>
</div>


Related articles