apache/hadoop · error · AbfsDriverException

Parsing of Json List Response Failed in DfsClient.

Error message

Parsing of Json List Response Failed in DfsClient.

What it means

Error "Parsing of Json List Response Failed in DfsClient." thrown in apache/hadoop.

Source

Thrown at hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsDfsClient.java:1418

        DfsListResultSchema listResultSchema;
        final ObjectMapper objectMapper = new ObjectMapper();
        listResultSchema = objectMapper.readValue(stream, DfsListResultSchema.class);
        result.setListResultSchema(listResultSchema);
        LOG.debug("ListPath listed {} paths with {} as continuation token",
            listResultSchema.paths().size(),
            getContinuationFromResponse(result));
        List<VersionedFileStatus> fileStatuses = new ArrayList<>();
        for (DfsListResultEntrySchema entry : listResultSchema.paths()) {
          fileStatuses.add(getVersionedFileStatusFromEntry(entry, uri));
        }
        ListResponseData listResponseData = new ListResponseData();
        listResponseData.setFileStatusList(fileStatuses);
        listResponseData.setRenamePendingJsonPaths(null);
        listResponseData.setContinuationToken(
            getContinuationFromResponse(result));
        return listResponseData;
      } catch (JsonParseException | JsonMappingException ex) {
        throw new AbfsDriverException(ERR_DFS_LIST_PARSING, ex);
      }
    } catch (AbfsDriverException ex) {
      // Throw as it is to avoid multiple wrapping.
      LOG.error("Unable to deserialize list results for Uri {}", uri != null ? uri.toString(): "NULL", ex);
      throw ex;
    } catch (Exception ex) {
      LOG.error("Unable to deserialize list results for Uri {}", uri != null ? uri.toString(): "NULL", ex);
      throw new AbfsDriverException(ERR_DFS_LIST_PARSING, ex);
    }
  }

  @Override
  public List<String> parseBlockListResponse(final InputStream stream) throws IOException {
    return null;
  }

  /**
   * When the request fails, this function is used to parse the responseAbfsHttpClient.LOG.debug("ExpectedError: ", ex);

View on GitHub (pinned to 2add963021)

Solutions

1. Capture the raw list response with DEBUG logging and validate the JSON.
2. Check for proxies or middleware altering the response body.
3. Retry the listing operation.

When it happens

Trigger: The DFS endpoint returns a list response whose JSON cannot be parsed.

Common situations: See trigger scenarios.

AI-assisted analysis of apache/hadoop@2add963021 (2026-08-22). Data as JSON: /api/errors/1482c665c5867455. Report an issue: GitHub.