Import a question answering fine-tuned model into Amazon Bedrock as a custom model
Machine Learning Blog
This article explains how to import a question answering fine-tuned model into Amazon Bedrock as a custom model. It details the steps involved in fine-tuning a Mistral model using SageMaker, importing the fine-tuned model into Amazon Bedrock, testing the imported model, and evaluating its performance.
Specifically, the article covers:
- Prerequisites for fine-tuning the Mistral model and importing it into Amazon Bedrock
- Fine-tuning the Mistral model using QLoRA and Parameter-Efficient Fine-Tuning (PEFT) techniques in a SageMaker notebook
- Importing the fine-tuned model into Amazon Bedrock using the console or SDK
- Testing the imported model using the Amazon Bedrock console and SDK
- Evaluating the imported model's performance for question answering tasks using the SageMaker FMEval library
- Cleaning up resources after the process is complete
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.