Home icon

Import a question answering fine-tuned model into Amazon Bedrock as a custom model

Machine Learning Blog



This article explains how to import a question answering fine-tuned model into Amazon Bedrock as a custom model. It details the steps involved in fine-tuning a Mistral model using SageMaker, importing the fine-tuned model into Amazon Bedrock, testing the imported model, and evaluating its performance.

Specifically, the article covers:

  • Prerequisites for fine-tuning the Mistral model and importing it into Amazon Bedrock
  • Fine-tuning the Mistral model using QLoRA and Parameter-Efficient Fine-Tuning (PEFT) techniques in a SageMaker notebook
  • Importing the fine-tuned model into Amazon Bedrock using the console or SDK
  • Testing the imported model using the Amazon Bedrock console and SDK
  • Evaluating the imported model's performance for question answering tasks using the SageMaker FMEval library
  • Cleaning up resources after the process is complete


Go to article

The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.

Related articles

Oct 21
2024
Amazon Bedrock Custom Model Import now generally available
Oct 21
2024
Amazon Bedrock Custom Model Import now generally available
Oct 18
2024
Amazon Bedrock Model Evaluation now supports evaluating custom model import models
Apr 23
2024
Import custom models in Amazon Bedrock (preview)

The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.