AWS Glue Data Quality now supports pre-processing queries

This article announces the general availability of preprocessing queries for AWS Glue Data Quality, enabling data transformation before quality checks.

• Transform data before running data quality checks via AWS Glue Data Catalog APIs
• Create derived columns and perform calculations within quality evaluation
• Filter datasets to focus quality checks on specific data subsets
• Eliminates need for separate pre-processing steps, streamlining workflows
• Available through start-data-quality-rule-recommendation-run and start-data-quality-ruleset-evaluation-run APIs
• Accessible in all commercial AWS Regions where AWS Glue Data Quality is available

Preprocessing queries enhance AWS Glue Data Quality by allowing complex data transformations directly within the quality validation process, reducing operational complexity.