Skip to content

Conversation

@wangyong001
Copy link

Added call to deleteSlavePod when computer is null. When Jenkins master encounter disk full issue, Jenkins master failed to write out the queue file /var/jenkins_home/queue.xml and also had some other file write issue, like:
Failed to create agent log directory /var/jenkins_home/logs/slaves/{slavePodName} and also:
Provisioned agent {slavePodName} failed to launch
java.nio.file.FileSystemException: /var/jenkins_home/nodes/{slavePodName}: No space left on device Also, the kubernetes plugin will try to provision a new pod every second and it will exhaust cloud resource in very quickly. And since no "delete" command send to cloud, the nominated cloud is not able to delete these pods.

Testing done

Steps to test:

  1. Create a Jenkins master with small disk
  2. Make the Jenkins master disk usage almost 100%
  3. Trigger a build
  4. Check log/all for pod provision and termination, it will send out "delete" command when "Computer for agent is null"

Submitter checklist

Added call to deleteSlavePod when computer is null.
When Jenkins master encounter disk full issue, Jenkins master failed to write out the queue file /var/jenkins_home/queue.xml
and also had some other file write issue, like: 
Failed to create agent log directory /var/jenkins_home/logs/slaves/{slavePodName}
and also:
Provisioned agent {slavePodName} failed to launch
java.nio.file.FileSystemException: /var/jenkins_home/nodes/{slavePodName}: No space left on device
Also, the kubernetes plugin will try to provision a new pod every second and it will exhaust cloud resource in very quickly.
And since no "delete" command send to cloud, the nominated cloud is not able to delete these pods.
@wangyong001 wangyong001 requested a review from a team as a code owner November 19, 2025 00:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant