apache/hadoop · error · IOException

Filesystem not generating Delegation Tokens: {}

Error message

Filesystem not generating Delegation Tokens: {}

What it means

Error "Filesystem not generating Delegation Tokens: {}" thrown in apache/hadoop.

Source

Thrown at hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/security/AbfsDtFetcher.java:82

  /**
   *  Returns Token object via FileSystem, null if bad argument.
   *  @param conf - a Configuration object used with FileSystem.get()
   *  @param creds - a Credentials object to which token(s) will be added
   *  @param renewer  - the renewer to send with the token request
   *  @param url  - the URL to which the request is sent
   *  @return a Token, or null if fetch fails.
   */
  public Token<?> addDelegationTokens(Configuration conf,
      Credentials creds,
      String renewer,
      String url) throws Exception {
    if (!url.startsWith(getServiceName().toString())) {
      url = getServiceName().toString() + "://" + url;
    }
    FileSystem fs = FileSystem.get(URI.create(url), conf);
    Token<?> token = fs.getDelegationToken(renewer);
    if (token == null) {
      throw new IOException(FETCH_FAILED + ": " + url);
    }
    creds.addToken(token.getService(), token);
    return token;
  }
}

View on GitHub (pinned to 2add963021)

Solutions

1. Enable delegation token generation on the ABFS filesystem (correct auth type and token provider configuration).
2. Use a filesystem instance that supports delegation tokens for this job.

When it happens

Trigger: A YARN/Spark job requests an ABFS delegation token from a filesystem not configured to issue them.

Common situations: See trigger scenarios.

AI-assisted analysis of apache/hadoop@2add963021 (2026-08-22). Data as JSON: /api/errors/87fa67be7fdde1cd. Report an issue: GitHub.