Skip to content

HDDS-14661. Handle split table writes for Multipart Upload#10588

Draft
spacemonkd wants to merge 1 commit into
apache:masterfrom
spacemonkd:HDDS-14661
Draft

HDDS-14661. Handle split table writes for Multipart Upload#10588
spacemonkd wants to merge 1 commit into
apache:masterfrom
spacemonkd:HDDS-14661

Conversation

@spacemonkd

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

HDDS-14661. Handle split table writes for Multipart Upload

Please describe your PR in detail:

Implements the runtime support for schemaVersion 1 multipart uploads using the split multipartPartsTable.

This patch covers the MPU lifecycle after an upload is already marked as schemaVersion 1:

  • CommitPart writes part metadata into multipartPartsTable instead of growing MultipartInfoTable.
  • Complete MPU reads parts from multipartPartsTable, assembles the final key, and deletes all consumed part rows.
  • Abort MPU scans split-table parts, releases quota, moves part blocks to the deleted table, and removes part rows.
  • Expired MPU cleanup follows the same split-table cleanup path for abandoned uploads.
  • ListParts reads ordered part metadata from multipartPartsTable.
  • Legacy schemaVersion 0 behavior remains unchanged.

This patch intentionally does not decide when new uploads become schemaVersion 1.
PR #10062 owns the upgrade/finalization and initiate-MPU schema selection. Once that branch starts creating schemaVersion 1 MPUs, this patch provides the runtime read/write/cleanup behavior needed to handle them end to end.

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-14661

How was this patch tested?

Patch was tested using unit tests

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

s3 S3 Gateway

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants