AWS Glue enables enhanced Apache Spark capabilities for AWS Lake Formation tables with full table access
News
AWS Glue 5.0 now supports enhanced Apache Spark capabilities for AWS Lake Formation tables with full table access, offering new data manipulation features:
- Enables read and write operations on Lake Formation registered tables
- Supports DML operations like CREATE, ALTER, DELETE, UPDATE, and MERGE INTO
- Works with Apache Hive and Iceberg tables within the same Spark application
- Allows use of advanced Spark features like RDDs, custom libraries, and UDFs
- Compatible with SageMaker Unified Studio in interactive mode
- Maintains Lake Formation's table-level security controls
This update removes previous limitations on ETL operations and provides more flexibility for data teams working with Lake Formation tables.
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.