apache/hadoop · error · UnsupportedOperationException

S3 Select is no longer supported

Error message

S3 Select is no longer supported

What it means

Error "S3 Select is no longer supported" thrown in apache/hadoop.

Source

Thrown at hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/OpenFileSupport.java:177

   * @param parameters open file parameters from the builder.
   * @param blockSize for fileStatus
   * @return open file options
   * @throws IOException failure to resolve the link.
   * @throws IllegalArgumentException unknown mandatory key
   * @throws UnsupportedOperationException for S3 Select options.
   */
  @SuppressWarnings("ChainOfInstanceofChecks")
  public OpenFileInformation prepareToOpenFile(
      final Path path,
      final OpenFileParameters parameters,
      final long blockSize) throws IOException {
    Configuration options = parameters.getOptions();
    Set<String> mandatoryKeys = parameters.getMandatoryKeys();
    // S3 Select is not supported in this release
    if (options.get(SelectConstants.SELECT_SQL, null) != null) {
      if (mandatoryKeys.contains(SelectConstants.SELECT_SQL)) {
        // mandatory option: fail with a specific message.
        throw new UnsupportedOperationException(SelectConstants.SELECT_UNSUPPORTED);
      } else {
        // optional; log once and continue
        LOG_NO_SQL_SELECT.warn(SelectConstants.SELECT_UNSUPPORTED);
      }
    }
    // choice of keys depends on open type
    rejectUnknownMandatoryKeys(
        mandatoryKeys,
        InternalConstants.S3A_OPENFILE_KEYS,
        "for " + path + " in file I/O");

    // where does a read end?
    long fileLength = LENGTH_UNKNOWN;

    // was a status passed in via a withStatus() invocation in
    // the builder API?
    FileStatus providedStatus = parameters.getStatus();
    S3AFileStatus fileStatus = null;

View on GitHub (pinned to 2add963021)

Solutions

1. Remove usage of S3 Select; it is no longer supported by S3A.

When it happens

Trigger: Thrown at hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/OpenFileSupport.java:177 when the library encounters an invalid state.

Common situations: See trigger scenarios.

AI-assisted analysis of apache/hadoop@2add963021 (2026-08-22). Data as JSON: /api/errors/f2138dbe40c9cf4d. Report an issue: GitHub.