{"record":{"id":"fafe47f8ecc82384","repo":"apache/flink","slug":"corrupt-data-unexpected-magic-number-fafe47","errorCode":null,"errorMessage":"Corrupt data: Unexpected magic number.","messagePattern":"Corrupt data: Unexpected magic number\\.","errorType":"exception","errorClass":"IOException","httpStatus":null,"severity":"error","filePath":"flink-formats/flink-hadoop-bulk/src/main/java/org/apache/flink/formats/hadoop/bulk/HadoopPathBasedPartFileWriter.java","lineNumber":218,"sourceCode":"        @Override\n        public HadoopPathBasedPendingFileRecoverable deserialize(int version, byte[] serialized)\n                throws IOException {\n            switch (version) {\n                case 1:\n                    return deserializeV1(serialized);\n                case 2:\n                    return deserializeV2(serialized);\n                default:\n                    throw new IOException(\"Unrecognized version or corrupt state: \" + version);\n            }\n        }\n\n        private HadoopPathBasedPendingFileRecoverable deserializeV1(byte[] serialized)\n                throws IOException {\n            final ByteBuffer bb = ByteBuffer.wrap(serialized).order(ByteOrder.LITTLE_ENDIAN);\n\n            if (bb.getInt() != MAGIC_NUMBER) {\n                throw new IOException(\"Corrupt data: Unexpected magic number.\");\n            }\n\n            byte[] targetFilePathBytes = new byte[bb.getInt()];\n            bb.get(targetFilePathBytes);\n            String targetFilePath = new String(targetFilePathBytes, CHARSET);\n\n            byte[] tempFilePathBytes = new byte[bb.getInt()];\n            bb.get(tempFilePathBytes);\n            String tempFilePath = new String(tempFilePathBytes, CHARSET);\n\n            return new HadoopPathBasedPendingFileRecoverable(\n                    new Path(targetFilePath), new Path(tempFilePath));\n        }\n\n        private HadoopPathBasedPendingFileRecoverable deserializeV2(byte[] serialized)\n                throws IOException {\n            final ByteBuffer bb = ByteBuffer.wrap(serialized).order(ByteOrder.LITTLE_ENDIAN);\n","sourceCodeStart":200,"sourceCodeEnd":236,"githubUrl":"https://github.com/apache/flink/blob/2f3c205e9266cb30240eb7f4fdab15cad629a70f/flink-formats/flink-hadoop-bulk/src/main/java/org/apache/flink/formats/hadoop/bulk/HadoopPathBasedPartFileWriter.java#L200-L236","documentation":"Error \"Corrupt data: Unexpected magic number.\" thrown in apache/flink.","triggerScenarios":"Triggered at runtime when the operation fails because: Corrupt data: Unexpected magic number.","commonSituations":"Commonly caused by misconfiguration, missing dependencies or files, unsupported types or operations, or invalid user input leading to: Corrupt data: Unexpected magic number.","solutions":["Address the cause reported by the error message: Corrupt data: Unexpected magic number.","Verify the inputs, configuration values, and classpath/dependency setup related to this operation, then retry."],"exampleFix":"Correct the condition described (\"Corrupt data: Unexpected magic number.\") and rerun the job or command.","handlingStrategy":null,"validationCode":null,"typeGuard":null,"tryCatchPattern":null,"preventionTips":[],"tags":[],"backgroundTag":null,"analyzedSha":"2f3c205e9266cb30240eb7f4fdab15cad629a70f","analyzedAt":"2026-08-14T08:48:24.518Z","schemaVersion":2},"datasetVersion":"2026-08-14T10:17:34.591Z"}