Skip to content

[FLINK-39680][FLINK-21378] Supports unaligned checkpoint on pointwise edges#28523

Open
pltbkd wants to merge 7 commits into
apache:masterfrom
pltbkd:unaligned-cp-forward-edges-v2
Open

[FLINK-39680][FLINK-21378] Supports unaligned checkpoint on pointwise edges#28523
pltbkd wants to merge 7 commits into
apache:masterfrom
pltbkd:unaligned-cp-forward-edges-v2

Conversation

@pltbkd

@pltbkd pltbkd commented Jun 24, 2026

Copy link
Copy Markdown
Contributor

What is the purpose of the change

This PR enables unaligned checkpoint on pointwise edges when users enable it explicitly, as long as handling the channel state recovery of pointwise edges.
The two issues are combined because neither makes sense as an independent change.

Brief change log

  • Support unaligned checkpoint on forward edges with force-unaligned option
  • Introduce EdgeDistributionPatternHook to store edge patterns for channel mapping calculation during recovery
  • Handling channel state redistribution on both JM and TM sides for pointwise edges

Verifying this change

This change is covered by existing unaligned checkpoint IT cases, because the original topologies contain pointwise edges and the jobs are already set FORCE_UNALIGNED.
This change also added an IT case that covers all parallelism and edge pattern changes on pointwise edges.

Does this pull request potentially affect one of the following parts:

  • Dependencies (does it add or upgrade a dependency): no
  • The public API, i.e., is any changed class annotated with @Public(Evolving): no
  • The serializers: no
  • The runtime per-record code paths (performance sensitive): no
  • Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: yes
  • The S3 file system connector: no

Documentation

  • Does this pull request introduce a new feature? no
  • If yes, how is the feature documented? not applicable

@flinkbot

flinkbot commented Jun 24, 2026

Copy link
Copy Markdown
Collaborator

CI report:

Bot commands The @flinkbot bot supports the following commands:
  • @flinkbot run azure re-run the last Azure build

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants