{"record":{"id":"534ca5eaf8efcabb","repo":"apache/seatunnel","slug":"debeziumjson-file-does-not-support-this-compress-t","errorCode":null,"errorMessage":"DebeziumJson file does not support this compress type: {}","messagePattern":"DebeziumJson file does not support this compress type: (.+?)","errorType":"console","errorClass":null,"httpStatus":null,"severity":"warning","filePath":"seatunnel-connectors-v2/connector-file/connector-file-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/sink/writer/DebeziumJsonWriteStrategy.java","lineNumber":141,"sourceCode":"\n    @Override\n    public FSDataOutputStream getOrCreateOutputStream(@NonNull String filePath) {\n        FSDataOutputStream fsDataOutputStream = beingWrittenOutputStream.get(filePath);\n        if (fsDataOutputStream == null) {\n            try {\n                switch (compressFormat) {\n                    case LZO:\n                        LzopCodec lzo = new LzopCodec();\n                        OutputStream out =\n                                lzo.createOutputStream(\n                                        hadoopFileSystemProxy.getOutputStream(filePath));\n                        fsDataOutputStream = new FSDataOutputStream(out, null);\n                        break;\n                    case NONE:\n                        fsDataOutputStream = hadoopFileSystemProxy.getOutputStream(filePath);\n                        break;\n                    default:\n                        log.warn(\n                                \"DebeziumJson file does not support this compress type: {}\",\n                                compressFormat.getCompressCodec());\n                        fsDataOutputStream = hadoopFileSystemProxy.getOutputStream(filePath);\n                        break;\n                }\n                beingWrittenOutputStream.put(filePath, fsDataOutputStream);\n                isFirstWrite.put(filePath, true);\n            } catch (IOException e) {\n                throw CommonError.fileOperationFailed(\"DebeziumJsonFile\", \"open\", filePath, e);\n            }\n        }\n        return fsDataOutputStream;\n    }\n}\n","sourceCodeStart":123,"sourceCodeEnd":156,"githubUrl":"https://github.com/apache/seatunnel/blob/cf67b549a7a6c35fa0beb12d83c62892427ea919/seatunnel-connectors-v2/connector-file/connector-file-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/sink/writer/DebeziumJsonWriteStrategy.java#L123-L156","documentation":"A warning from DebeziumJsonWriteStrategy.getOrCreateOutputStream when the configured compress format has no handled case for Debezium JSON text output. The writer falls back to an uncompressed stream, so the produced files ignore the requested compression. Non-fatal: the job continues.","triggerScenarios":"Sink configured with file_format=debezium_json and compress set to a codec without a switch case (e.g. BROTLI, ZSTD); triggered when the first record for a file causes getOrCreateOutputStream to open the stream.","commonSituations":"Config templated across formats; new CompressFormat enum values added upstream but not to this strategy; users expecting parity with ORC compress options.","solutions":["Set compress to a supported value (lzo, gzip, or none) for debezium_json sinks","Consult the file connector documentation for supported compress formats","Use archive compress options if the goal is compressed delivery of text files","Add the missing codec branch in DebeziumJsonWriteStrategy if support is required"],"exampleFix":"// before\nsink = {\n  file_format = \"debezium_json\"\n  compress = \"brotli\"\n}\n// after\nsink = {\n  file_format = \"debezium_json\"\n  compress = \"lzo\"\n}","handlingStrategy":"validation","validationCode":"Set<String> supported = Set.of(\"none\", \"lzo\", \"gzip\");\nif (!supported.contains(compressValue.toLowerCase())) {\n    throw new IllegalArgumentException(\"compress=\" + compressValue + \" unsupported for debezium_json; use \" + supported);\n}","typeGuard":null,"tryCatchPattern":null,"preventionTips":["Match compress options to the debezium_json documentation","Avoid sharing one sink template across text and columnar formats","Grep job logs for 'does not support this compress type' during test runs","Update all JSON-family write strategies together when adding codecs"],"tags":["hadoop","file-sink","compression","cdc"],"backgroundTag":"unsupported-config-value","analyzedSha":"cf67b549a7a6c35fa0beb12d83c62892427ea919","analyzedAt":"2026-09-10T21:44:55.265Z","contentChangedAt":"2026-09-10T21:44:55.265Z","schemaVersion":2},"datasetVersion":"2026-09-14T11:17:12.474Z"}