{"record":{"id":"3af736055b593d73","repo":"apache/hadoop","slug":"problem-getting-input-split-size","errorCode":null,"errorMessage":"Problem getting input split size","messagePattern":"Problem getting input split size","errorType":"exception","errorClass":"RuntimeException","httpStatus":null,"severity":"error","filePath":"hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java","lineNumber":356,"sourceCode":"    org.apache.hadoop.mapred.InputSplit[] splits =\n    job.getInputFormat().getSplits(job, job.getNumMapTasks());\n    // sort the splits into order based on size, so that the biggest\n    // go first\n    Arrays.sort(splits, new Comparator<org.apache.hadoop.mapred.InputSplit>() {\n      public int compare(org.apache.hadoop.mapred.InputSplit a,\n                         org.apache.hadoop.mapred.InputSplit b) {\n        try {\n          long left = a.getLength();\n          long right = b.getLength();\n          if (left == right) {\n            return 0;\n          } else if (left < right) {\n            return 1;\n          } else {\n            return -1;\n          }\n        } catch (IOException ie) {\n          throw new RuntimeException(\"Problem getting input split size\", ie);\n        }\n      }\n    });\n    JobSplitWriter.createSplitFiles(jobSubmitDir, job, \n        jobSubmitDir.getFileSystem(job), splits);\n    return splits.length;\n  }\n  \n  private static class SplitComparator implements Comparator<InputSplit> {\n    @Override\n    public int compare(InputSplit o1, InputSplit o2) {\n      try {\n        long len1 = o1.getLength();\n        long len2 = o2.getLength();\n        if (len1 < len2) {\n          return 1;\n        } else if (len1 == len2) {\n          return 0;","sourceCodeStart":338,"sourceCodeEnd":374,"githubUrl":"https://github.com/apache/hadoop/blob/2add9630210752f88ceb1bb74eb65e37bf41da8e/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java#L338-L374","documentation":"Error \"Problem getting input split size\" thrown in apache/hadoop.","triggerScenarios":"Thrown at hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java:356 when the library encounters an invalid state.","commonSituations":"See trigger scenarios.","solutions":["Check that input paths are accessible and the InputFormat can compute splits; see the underlying IOException for the specific path failing."],"exampleFix":null,"handlingStrategy":null,"validationCode":null,"typeGuard":null,"tryCatchPattern":null,"preventionTips":[],"tags":[],"backgroundTag":null,"analyzedSha":"2add9630210752f88ceb1bb74eb65e37bf41da8e","analyzedAt":"2026-08-22T19:55:07.957Z","schemaVersion":2},"datasetVersion":"2026-08-22T20:17:22.307Z"}