Home icon

Data discovery: How to find out what’s on your Amazon FSx for NetApp ONTAP volumes

Storage Blog



This article presents a solution for discovering and cataloging file metadata from Amazon FSx for NetApp ONTAP volumes using AWS analytics services.

  • Creates continuously refreshed, SQL-queryable catalog of FSx file metadata using Iceberg tables
  • Uses ONTAP snapshots, S3 Access Points, Lambda, and Athena for metadata extraction and querying
  • Deployed as AWS CDK application; scales to millions of files per volume
  • Enables SQL queries to answer capacity, lifecycle, and compliance questions
  • Supports natural-language querying via Amazon Q Developer and S3 Tables MCP server
  • Includes Amazon QuickSight dashboards for visualization and stakeholder sharing
  • Captures file path, size, modification time, age, and extension metadata
  • Partitions data by volume and date for historical trend analysis

The solution provides enterprise storage administrators with visibility into petabyte-scale file systems through multiple query interfaces—SQL, natural language, and visual dashboards—without creating redundant data copies.



Go to article

The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.

Related articles

Sep 18
2024
Restrict access to your Amazon FSx for NetApp ONTAP volumes using export policies
Jul 9
2024
Amazon FSx for NetApp ONTAP now allows you to read data during backup restores
Sep 20
2024
Automate monitoring at scale for Amazon FSx for NetApp ONTAP volumes
Sep 18
2024
Protecting data against ransomware with Amazon FSx for NetApp ONTAP

The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.