{"record":{"id":"6ee52d5c6d852a31","repo":"apache/seatunnel","slug":"maxwelljson-file-does-not-support-this-compress-ty","errorCode":null,"errorMessage":"MaxWellJson file does not support this compress type: {}","messagePattern":"MaxWellJson file does not support this compress type: (.+?)","errorType":"console","errorClass":null,"httpStatus":null,"severity":"warning","filePath":"seatunnel-connectors-v2/connector-file/connector-file-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/sink/writer/MaxWellJsonWriteStrategy.java","lineNumber":141,"sourceCode":"\n    @Override\n    public FSDataOutputStream getOrCreateOutputStream(@NonNull String filePath) {\n        FSDataOutputStream fsDataOutputStream = beingWrittenOutputStream.get(filePath);\n        if (fsDataOutputStream == null) {\n            try {\n                switch (compressFormat) {\n                    case LZO:\n                        LzopCodec lzo = new LzopCodec();\n                        OutputStream out =\n                                lzo.createOutputStream(\n                                        hadoopFileSystemProxy.getOutputStream(filePath));\n                        fsDataOutputStream = new FSDataOutputStream(out, null);\n                        break;\n                    case NONE:\n                        fsDataOutputStream = hadoopFileSystemProxy.getOutputStream(filePath);\n                        break;\n                    default:\n                        log.warn(\n                                \"MaxWellJson file does not support this compress type: {}\",\n                                compressFormat.getCompressCodec());\n                        fsDataOutputStream = hadoopFileSystemProxy.getOutputStream(filePath);\n                        break;\n                }\n                beingWrittenOutputStream.put(filePath, fsDataOutputStream);\n                isFirstWrite.put(filePath, true);\n            } catch (IOException e) {\n                throw CommonError.fileOperationFailed(\"MaxWellJsonFile\", \"open\", filePath, e);\n            }\n        }\n        return fsDataOutputStream;\n    }\n}\n","sourceCodeStart":123,"sourceCodeEnd":156,"githubUrl":"https://github.com/apache/seatunnel/blob/cf67b549a7a6c35fa0beb12d83c62892427ea919/seatunnel-connectors-v2/connector-file/connector-file-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/sink/writer/MaxWellJsonWriteStrategy.java#L123-L156","documentation":"Warning from MaxWellJsonWriteStrategy.getOrCreateOutputStream when the configured compress format lacks a handled case for MaxWell JSON text output. The writer falls back to an uncompressed stream, so requested compression is silently ignored and the job continues.","triggerScenarios":"Sink with file_format=maxwell_json and a compress codec not covered by the switch (e.g. BROTLI, ZSTD); triggered on first write when the output stream is created.","commonSituations":"Shared compress settings across sink formats; users expecting text formats to support all codecs; new CompressFormat enum values not propagated to this strategy.","solutions":["Set compress to a supported value (lzo, gzip, none) for maxwell_json sinks","Consult connector docs for supported compress formats per file format","Switch to a columnar format (ORC/Parquet) for broader codec support","Add the codec case to MaxWellJsonWriteStrategy if support is genuinely needed"],"exampleFix":"// before\nsink = {\n  file_format = \"maxwell_json\"\n  compress = \"zstd\"\n}\n// after\nsink = {\n  file_format = \"maxwell_json\"\n  compress = \"none\"\n}","handlingStrategy":"validation","validationCode":"Set<String> supported = Set.of(\"none\", \"lzo\", \"gzip\");\nif (!supported.contains(compressValue.toLowerCase())) {\n    throw new IllegalArgumentException(\"maxwell_json supports compress \" + supported + \", got: \" + compressValue);\n}","typeGuard":null,"tryCatchPattern":null,"preventionTips":["Consult per-format compress support before configuring","Keep CDC sink configs separate from columnar sink templates","Check test-run logs for unsupported-compress warnings","Keep MaxWell/Canal/Debezium strategies in sync when codecs change"],"tags":["hadoop","file-sink","compression","cdc"],"backgroundTag":"unsupported-config-value","analyzedSha":"cf67b549a7a6c35fa0beb12d83c62892427ea919","analyzedAt":"2026-09-10T21:44:55.265Z","contentChangedAt":"2026-09-10T21:44:55.265Z","schemaVersion":2},"datasetVersion":"2026-09-14T11:17:12.474Z"}