apache/flink · error · TableException

Exception in open

Error message

Exception in open

What it means

FileSystemOutputFormat.open initializes the PartitionWriter by selecting the appropriate writer factory based on partition columns and grouping settings, then creates the writer. Any exception during this initialization — format factory instantiation, file system access for output files, or writer creation — is caught and wrapped in a TableException with message 'Exception in open'.

Source

Thrown at flink-connectors/flink-connector-files/src/main/java/org/apache/flink/connector/file/table/FileSystemOutputFormat.java:197

                            fsFactory,
                            stagingPath,
                            context.getTaskNumber(),
                            context.getAttemptNumber(),
                            outputFileConfig);
            PartitionWriter.Context<T> writerContext =
                    new PartitionWriter.Context<>(parameters, formatFactory);
            writer =
                    PartitionWriterFactory.<T>get(
                                    partitionColumns.length - staticPartitions.size() > 0,
                                    dynamicGrouped,
                                    staticPartitions)
                            .create(
                                    writerContext,
                                    fileManager,
                                    computer,
                                    new PartitionWriter.DefaultPartitionWriterListener());
        } catch (Exception e) {
            throw new TableException("Exception in open", e);
        }
    }

    @Override
    public void writeRecord(T record) {
        try {
            writer.write(record);
        } catch (Exception e) {
            throw new TableException("Exception in writeRecord", e);
        }
    }

    @Override
    public void close() throws IOException {
        try {
            if (writer != null) {
                writer.close();
            }

View on GitHub (pinned to 2f3c205e92)

Solutions

1. Examine the chained cause of the TableException to find the underlying failure.
2. Verify the output path exists or is creatable and is writable by the Flink TaskManager process.
3. Ensure the correct format JAR is on the classpath and the format factory initializes without error.
4. Check for disk space and file system quotas on the TaskManager node.

try {
    outputFormat.open(...);
} catch (TableException e) {
    Throwable root = e.getCause();
    // Inspect root cause: permission, format init, FS connectivity
    throw new RuntimeException("Failed to open output format", root);
}

When it happens

Trigger: The PartitionWriterFactory.create call fails: output directory cannot be created, the format factory throws during initialization, the partition computer setup fails, or a file system permission issue prevents opening output files for writing.

Common situations: Output directory permissions are insufficient. Format factory (e.g. Parquet, CSV, JSON) fails to initialize due to schema mismatch or missing dependencies. File system path is unreachable (HDFS/S3 connectivity). Disk full on the TaskManager node.

Related errors

• Exception in close
• Exception in finalizeGlobal
• Exception in writeRecord
• An IO error occurred while accessing the staging FileSystem.
• Can not find format factory.

AI-assisted analysis of apache/flink@2f3c205e92 (2026-08-14). Data as JSON: /api/errors/649fc36c2d113d28. Report an issue: GitHub.