Migrate to Apache Flink 2.2 on Amazon Managed Service for Apache Flink

This article provides a comprehensive guide to migrating Apache Flink applications from version 1.x to 2.2 on Amazon Managed Service for Apache Flink.

• Flink 2.2 requires Java 17, Python 3.9+, and removes DataSet API and Java 11 support
• Performance improvements include RocksDB 8.10.0 for faster checkpoints and Kryo 5.6 serialization upgrades
• New SQL/Table API features: ML_PREDICT for direct model calls, VARIANT type for semistructured data, ProcessTableFunction for stateful logic
• In-place upgrades preserve application configuration, logs, metrics, and compatible state
• Auto-rollback automatically reverts to previous version if binary incompatibilities detected during startup
• Migration steps: update code and dependencies, check state compatibility, enable auto-rollback, take manual snapshot, run upgrade, monitor metrics
• State compatibility issues most common with POJOs using Java collections; Avro and Protobuf are compatible
• Monitor numRestarts, lastCheckpointDuration, numberOfFailedCheckpoints, and uptime metrics post-upgrade
• Rollback uses pre-upgrade snapshot; cannot restore Flink 2.2 snapshots on Flink 1.x
• Terraform requires AWS provider version 6.40.0+ for FLINK-2_2 runtime support

The migration process is streamlined with in-place upgrades and automatic rollback capabilities, enabling safe transitions to Flink 2.2's modern runtime and advanced features.