Amazon Bedrock offers select FMs for batch inference at 50% of on-demand inference price

The article announces that Amazon Bedrock now offers batch inference in general availability for select foundation models (FMs) from leading AI providers like Anthropic, Meta, Mistral AI, and Amazon. Batch inference allows processing multiple inference requests asynchronously, improving performance on large datasets. The key points are:

• Select FMs available for batch inference at 50% of on-demand pricing
• Typical batch inference job completion within 24 hours
• Supports model evaluation, experimentation, and offline processing
• Amazon Bedrock provides a choice of high-performing FMs from leading AI companies
• Offers security, privacy, and responsible AI capabilities for building generative AI applications