apache/dolphinscheduler · error · TaskException

data factory start task error

Error message

data factory start task error

What it means

A catch-all in DatafactoryTask.submitApplication: starting the Azure Data Factory pipeline via startDatafactoryTask() threw — invalid task parameters, missing/unauthorized Azure credentials, an unknown pipeline, or an SDK (SdkBaseException) failure. The task instance is marked failed; the caused-by exception carries the Azure error detail.

Source

Thrown at dolphinscheduler-task-plugin/dolphinscheduler-task-datafactory/src/main/java/org/apache/dolphinscheduler/plugin/task/datafactory/DatafactoryTask.java:69

        return Collections.emptyList();
    }

    @Override
    public void init() {
        parameters = JSONUtils.parseObject(taskExecutionContext.getTaskParams(), DatafactoryParameters.class);
        log.info("Initialize Datafactory task params {}", JSONUtils.toPrettyJsonString(parameters));
        hook = new DatafactoryHook();
    }

    @Override
    public void submitApplication() throws TaskException {
        try {
            // start task
            exitStatusCode = startDatafactoryTask();
            setExitStatusCode(exitStatusCode);
        } catch (Exception e) {
            setExitStatusCode(TaskConstants.EXIT_CODE_FAILURE);
            throw new TaskException("data factory start task error", e);
        }
        // set runId to the appIds if start success
        setAppIds(parameters.getRunId());
    }

    @Override
    public void cancelApplication() throws TaskException {
        checkApplicationId();
        hook.cancelDatafactoryTask(parameters);
        exitStatusCode = TaskConstants.EXIT_CODE_KILL;
    }

    @Override
    public void trackApplicationStatus() throws TaskException {
        checkApplicationId();
        Boolean isFinishedSuccessfully;
        isFinishedSuccessfully = hook.queryStatus(parameters);
        if (!isFinishedSuccessfully) {

View on GitHub (pinned to 02eac45a1b)

Solutions

1. Check the caused-by Azure SDK exception for authentication (credentials/policy missing) vs pipeline-not-found errors
2. Verify the DataFactory task params: subscriptionId, factoryName, pipelineName, and parameter JSON are all set correctly
3. Confirm the task's Azure credentials are configured in the worker's security config
4. Retry after transient Azure throttling/outage errors

When it happens

Trigger: Thrown at dolphinscheduler-task-plugin/dolphinscheduler-task-datafactory/src/main/java/org/apache/dolphinscheduler/plugin/task/datafactory/DatafactoryTask.java:69 when the library encounters an invalid state.

Common situations: See trigger scenarios.

AI-assisted analysis of apache/dolphinscheduler@02eac45a1b (2026-09-06). Data as JSON: /api/errors/93ec513929127971. Report an issue: GitHub.