apache/flink · error · IOException

Recovering commit failed for object %s. Object does not exis

Error message

Recovering commit failed for object %s. Object does not exist and MultiPart Upload %s is not valid.

What it means

Error "Recovering commit failed for object %s. Object does not exist and MultiPart Upload %s is not valid." thrown in apache/flink.

Source

Thrown at flink-filesystems/flink-s3-fs-base/src/main/java/org/apache/flink/fs/s3/common/writer/S3Committer.java:122

                    ObjectMetadata metadata = s3AccessHelper.getObjectMetadata(objectName);
                    if (totalLength != metadata.getContentLength()) {
                        String message =
                                String.format(
                                        "Inconsistent result for object %s: conflicting lengths. "
                                                + "Recovered committer for upload %s indicates %s bytes, present object is %s bytes",
                                        objectName,
                                        uploadId,
                                        totalLength,
                                        metadata.getContentLength());
                        LOG.warn(message);
                        throw new IOException(message, e);
                    }
                } catch (FileNotFoundException fnf) {
                    LOG.warn(
                            "Object {} not existing after failed recovery commit with MPU ID {}",
                            objectName,
                            uploadId);
                    throw new IOException(
                            String.format(
                                    "Recovering commit failed for object %s. "
                                            + "Object does not exist and MultiPart Upload %s is not valid.",
                                    objectName, uploadId),
                            e);
                }
            }
        } else {
            LOG.debug("No data to commit for file: {}", objectName);
        }
    }

    @Override
    public RecoverableWriter.CommitRecoverable getRecoverable() {
        return new S3Recoverable(objectName, uploadId, parts, totalLength);
    }
}

View on GitHub (pinned to 2f3c205e92)

Solutions

  1. Address the cause reported by the error message: Recovering commit failed for object the reported value. Object does not exist and MultiPart Upload the reported value is not valid.
  2. Verify the inputs, configuration values, and classpath/dependency setup related to this operation, then retry.

Example fix

Correct the condition described ("Recovering commit failed for object the reported value. Object does not exist and MultiPart Upload the reported value is not valid.") and rerun the job or command.

When it happens

Trigger: Triggered at runtime when the operation fails because: Recovering commit failed for object the reported value. Object does not exist and MultiPart Upload the reported value is not valid.

Common situations: Commonly caused by misconfiguration, missing dependencies or files, unsupported types or operations, or invalid user input leading to: Recovering commit failed for object the reported value. Object does not exist and MultiPart Upload the reported value is not valid.


AI-assisted analysis of apache/flink@2f3c205e92 (2026-08-14). Data as JSON: /api/errors/fc6345d72299ca5b. Report an issue: GitHub.