Skip to content

[Improvement-16994][TaskPlugin] ensure spark application cancelled#17504

Closed
abzymeatsjtu wants to merge 1 commit intoapache:devfrom
abzymeatsjtu:feat_ensure_application_cancelled
Closed

[Improvement-16994][TaskPlugin] ensure spark application cancelled#17504
abzymeatsjtu wants to merge 1 commit intoapache:devfrom
abzymeatsjtu:feat_ensure_application_cancelled

Conversation

@abzymeatsjtu
Copy link
Copy Markdown
Contributor

ensure spark application cancelled when cancel application is triggered

close #16994

Comment on lines +217 to +228

RunState currentState = RunState.Cancelling;

while (!RunState.isCancelled(currentState)) {
currentState = RunState.valueOf(pollJobRunStatus());

try {
Thread.sleep(10 * 1000L);
} catch (InterruptedException e) {
break;
}
}
Copy link
Copy Markdown
Member

@ruanwenjun ruanwenjun Sep 11, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We don't need to do this change, since the kill operation is async, and only handle finish, then the worker will return the task state to master. The change might block a thread.

@sonarqubecloud
Copy link
Copy Markdown

Please retry analysis of this Pull-Request directly on SonarQube Cloud

@github-actions
Copy link
Copy Markdown

This pull request has been automatically marked as stale because it has not had recent activity for 120 days. It will be closed in 7 days if no further activity occurs.

@github-actions github-actions Bot added the Stale label Jan 10, 2026
@github-actions
Copy link
Copy Markdown

This pull request has been closed because it has not had recent activity. You could reopen it if you try to continue your work, and anyone who are interested in it are encouraged to continue work on this pull request.

@github-actions github-actions Bot closed this Jan 18, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Improvement][AliyunServerlessSparkTask] Some Improvement on Aliyun Serverless Spark Task Plugin

3 participants