apache/hadoop · error · InvalidInputException

Job ResourceSkyline history is invalid, please try again wit

Error message

Job ResourceSkyline history is invalid, please try again with valid Job ResourceSkyline history

What it means

Error "Job ResourceSkyline history is invalid, please try again with valid Job ResourceSkyline history" thrown in apache/hadoop.

Source

Thrown at hadoop-tools/hadoop-resourceestimator/src/main/java/org/apache/hadoop/resourceestimator/solver/preprocess/SolverPreprocessor.java:67

  /**
   * Check if Solver's input parameters are valid.
   *
   * @param jobHistory   the history {@link ResourceSkyline}s of the recurring
   *                     pipeline job.
   * @param timeInterval the time interval which is used to discretize the
   *                     history {@link ResourceSkyline}s.
   * @throws InvalidInputException if: (1) jobHistory is <em>null</em>;
   *     (2) jobHistory is empty; (3) timeout is non-positive;
   *     (4) timeInterval is non-positive;
   */
  public final void validate(
      final Map<RecurrenceId, List<ResourceSkyline>> jobHistory,
      final int timeInterval) throws InvalidInputException {
    if ((jobHistory == null) || (jobHistory.size() == 0)) {
      LOGGER.error(
          "Job resource skyline history is invalid, please try again with"
              + " valid resource skyline history.");
      throw new InvalidInputException("Job ResourceSkyline history", "invalid");
    }

    if (timeInterval <= 0) {
      LOGGER.error(
          "Solver timeInterval {} is invalid, please specify a positive value.",
          timeInterval);
      throw new InvalidInputException("Solver timeInterval", "non-positive");
    }
  }

  /**
   * Return the multi-dimension resource vector consumed by the job at specified
   * time.
   *
   * @param skyList           the list of {@link Resource}s used by the job.
   * @param index             the discretized time index.
   * @param containerMemAlloc the multi-dimension resource vector allocated to
   *                          one container.

View on GitHub (pinned to 2add963021)

Solutions

  1. Provide a valid job ResourceSkyline history (parsable, non-empty) to the solver preprocessor.

When it happens

Trigger: The job resource skyline history supplied to the estimator solver is null or empty, so the solver has no data to estimate from.

Common situations: See trigger scenarios.


AI-assisted analysis of apache/hadoop@2add963021 (2026-08-22). Data as JSON: /api/errors/f84e6d22eaeadcf8. Report an issue: GitHub.