Index your web crawled content using the new Web Crawler for Amazon Kendra
Blog
This article discusses how to use the new Amazon Kendra Web Crawler to index and search content from internal and external websites.
Specifically, the article covers:
- An overview of the Amazon Kendra Web Crawler and its new features
- Prerequisites for using the Web Crawler
- Step-by-step instructions for:
- Gathering authentication details for the website
- Creating an Amazon Kendra index
- Creating a Web Crawler data source
- Testing the solution by searching the indexed website content
- An example of crawling an authenticated website
- Cleaning up the resources created
- Conclusion highlighting the benefits of the Web Crawler
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.