apache/flink · error · UnsupportedOperationException

Only HadoopPathBasedPendingFileRecoverable is supported.

Error message

Only HadoopPathBasedPendingFileRecoverable is supported.

What it means

Error "Only HadoopPathBasedPendingFileRecoverable is supported." thrown in apache/flink.

Source

Thrown at flink-formats/flink-hadoop-bulk/src/main/java/org/apache/flink/formats/hadoop/bulk/HadoopPathBasedPartFileWriter.java:175

        static final HadoopPathBasedPendingFileRecoverableSerializer INSTANCE =
                new HadoopPathBasedPendingFileRecoverableSerializer();

        private static final Charset CHARSET = StandardCharsets.UTF_8;

        private static final int MAGIC_NUMBER = 0x2c853c90;

        @Override
        public int getVersion() {
            return 2;
        }

        @Override
        public byte[] serialize(PendingFileRecoverable pendingFileRecoverable) {
            if (!(pendingFileRecoverable
                    instanceof
                    HadoopPathBasedPartFileWriter.HadoopPathBasedPendingFileRecoverable)) {
                throw new UnsupportedOperationException(
                        "Only HadoopPathBasedPendingFileRecoverable is supported.");
            }

            HadoopPathBasedPendingFileRecoverable hadoopRecoverable =
                    (HadoopPathBasedPendingFileRecoverable) pendingFileRecoverable;
            Path path = hadoopRecoverable.getTargetFilePath();
            Path inProgressPath = hadoopRecoverable.getTempFilePath();

            byte[] pathBytes = path.toUri().toString().getBytes(CHARSET);
            byte[] inProgressBytes = inProgressPath.toUri().toString().getBytes(CHARSET);

            byte[] targetBytes =
                    new byte[12 + pathBytes.length + inProgressBytes.length + Long.BYTES];
            ByteBuffer bb = ByteBuffer.wrap(targetBytes).order(ByteOrder.LITTLE_ENDIAN);
            bb.putInt(MAGIC_NUMBER);
            bb.putInt(pathBytes.length);
            bb.put(pathBytes);
            bb.putInt(inProgressBytes.length);

View on GitHub (pinned to 2f3c205e92)

Solutions

  1. Address the cause reported by the error message: Only HadoopPathBasedPendingFileRecoverable is supported.
  2. Verify the inputs, configuration values, and classpath/dependency setup related to this operation, then retry.

Example fix

Correct the condition described ("Only HadoopPathBasedPendingFileRecoverable is supported.") and rerun the job or command.

When it happens

Trigger: Triggered at runtime when the operation fails because: Only HadoopPathBasedPendingFileRecoverable is supported.

Common situations: Commonly caused by misconfiguration, missing dependencies or files, unsupported types or operations, or invalid user input leading to: Only HadoopPathBasedPendingFileRecoverable is supported.

AI-assisted analysis of apache/flink@2f3c205e92 (2026-08-14). Data as JSON: /api/errors/c5b7097f5e4e4d37. Report an issue: GitHub.