apache/hadoop · error · YarnException

Failed to initialize SynthTraceJobProducer

Error message

Failed to initialize SynthTraceJobProducer

What it means

Error "Failed to initialize SynthTraceJobProducer" thrown in apache/hadoop.

Source

Thrown at hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/SLSRunner.java:146

    int poolSize = tempConf.getInt(SLSConfiguration.RUNNER_POOL_SIZE,
        SLSConfiguration.RUNNER_POOL_SIZE_DEFAULT);
    SLSRunner.runner.setQueueSize(poolSize);

    rmRunner = new RMRunner(getConf(), this);
    nmRunner = new NMRunner(runner, getConf(), rmRunner.getRm(), rmRunner.getTableMapping(), poolSize);
    amRunner = new AMRunner(runner, this);
    amRunner.init(tempConf);
  }

  private SynthTraceJobProducer getSynthJobTraceProducer() throws YarnException {
    // if we use the nodeFile this could have been not initialized yet.
    if (nmRunner.getStjp() != null) {
      return nmRunner.getStjp();
    } else {
      try {
        return new SynthTraceJobProducer(getConf(), new Path(inputTraces[0]));
      } catch (IOException e) {
        throw new YarnException("Failed to initialize SynthTraceJobProducer", e);
      }
    }
  }

  /**
   * @return an unmodifiable view of the simulated info map.
   */
  public static Map<String, Object> getSimulateInfoMap() {
    return Collections.unmodifiableMap(simulateInfoMap);
  }

  /**
   * This is invoked before start.
   * @param inputType The trace type
   * @param inTraces Input traces
   * @param nodes The node file
   * @param metricsOutputDir Output dir for metrics
   * @param trackApps Track these applications

View on GitHub (pinned to 2add963021)

Solutions

1. Check the SYNTH trace generator configuration (workload definition files) for errors; see the logged cause.

When it happens

Trigger: The SynthTraceJobProducer fails to initialize from the synthetic workload JSON, e.g. because the trace definition file is missing or invalid.

Common situations: See trigger scenarios.

AI-assisted analysis of apache/hadoop@2add963021 (2026-08-22). Data as JSON: /api/errors/914748c93b978a5a. Report an issue: GitHub.