apache/dolphinscheduler · error · TaskException

datasync task error

Error message

datasync task error

What it means

A catch-all in DatasyncTask.submitApplication: creating or starting the AWS DataSync task threw — invalid endpoint/subnet/security-group parameters, insufficient IAM permissions on the execution role, or an AWS SDK error. checkCreateTask or startDatasyncTask failure is wrapped with exit code set to failure; the caused-by carries the AWS detail.

Source

Thrown at dolphinscheduler-task-plugin/dolphinscheduler-task-datasync/src/main/java/org/apache/dolphinscheduler/plugin/task/datasync/DatasyncTask.java:109

            log.info("Success convert json to task params {}", JSONUtils.toPrettyJsonString(parameters));
        }
    }

    @Override
    public void submitApplication() throws TaskException {
        try {
            int exitStatusCode = checkCreateTask();
            if (exitStatusCode == TaskConstants.EXIT_CODE_FAILURE) {
                // if create task failure go end
                setExitStatusCode(exitStatusCode);
                return;
            }
            // start task
            exitStatusCode = startDatasyncTask();
            setExitStatusCode(exitStatusCode);
        } catch (Exception e) {
            setExitStatusCode(TaskConstants.EXIT_CODE_FAILURE);
            throw new TaskException("datasync task error", e);
        }
        // set taskExecArn to the appIds if start success
        setAppIds(hook.getTaskExecArn());
    }

    @Override
    public void cancelApplication() throws TaskException {
        checkApplicationId();
        hook.cancelDatasyncTask();
    }

    @Override
    public void trackApplicationStatus() throws TaskException {
        checkApplicationId();
        Boolean isFinishedSuccessfully = null;
        isFinishedSuccessfully = hook.doubleCheckFinishStatus(TaskExecutionStatus.SUCCESS, DatasyncHook.doneStatus);
        if (!isFinishedSuccessfully) {
            exitStatusCode = TaskConstants.EXIT_CODE_FAILURE;

View on GitHub (pinned to 02eac45a1b)

Solutions

1. Inspect the caused-by AwsServiceException for the failing call (create_task/start_task)
2. Verify DataSync task params: subnet ARN, security groups, source/dest locations, and IAM execution role permissions
3. Confirm the task's AWS credentials are configured and have datasync:* permissions
4. Retry after transient AWS errors; fix config and re-run for validation errors

When it happens

Trigger: Thrown at dolphinscheduler-task-plugin/dolphinscheduler-task-datasync/src/main/java/org/apache/dolphinscheduler/plugin/task/datasync/DatasyncTask.java:109 when the library encounters an invalid state.

Common situations: See trigger scenarios.

AI-assisted analysis of apache/dolphinscheduler@02eac45a1b (2026-09-06). Data as JSON: /api/errors/f162f00ca424503b. Report an issue: GitHub.