apache/hadoop · error · IOException

JobConf: missing required property: {}

Error message

JobConf: missing required property: {}

What it means

Error "JobConf: missing required property: {}" thrown in apache/hadoop.

Source

Thrown at hadoop-tools/hadoop-streaming/src/main/java/org/apache/hadoop/streaming/mapreduce/StreamXmlRecordReader.java:291

          outBufOrNull.write(c);
        }
        pos_ += m + 1; // skip m chars, +1 for 'c'
        m = 0;
      }
    }
    if (!includePat && match) {
      bin_.reset();
    } else if (outBufOrNull != null) {
      outBufOrNull.write(cpat);
      pos_ += msup;
    }
    return match;
  }

  String checkJobGet(String prop) throws IOException {
    String val = conf_.get(prop);
    if (val == null) {
      throw new IOException("JobConf: missing required property: " + prop);
    }
    return val;
  }

  String beginMark_;
  String endMark_;

  Pattern beginPat_;
  Pattern endPat_;

  boolean slowMatch_;
  int lookAhead_; // bytes to read to try to synch CDATA/non-CDATA. Should be
  // more than max record size
  int maxRecSize_;

  BufferedInputStream bin_; // Wrap FSDataInputStream for efficient backward
  // seeks
  long pos_; // Keep track on position with respect encapsulated

View on GitHub (pinned to 2add963021)

Solutions

1. Set the missing JobConf property required by the mapreduce StreamXmlRecordReader (begin/end tag keys).

When it happens

Trigger: The mapreduce streaming XML record reader is configured without a required JobConf property (e.g. begin/end tag keys).

Common situations: See trigger scenarios.

AI-assisted analysis of apache/hadoop@2add963021 (2026-08-22). Data as JSON: /api/errors/be869e39cb0d3925. Report an issue: GitHub.