DEV Community: Kuldeepkumhar-fs

🛠️ How to Troubleshoot a Kubernetes Cluster: A Step-by-Step Guide 🚀

Kuldeepkumhar-fs — Mon, 03 Mar 2025 09:47:37 +0000

🛠️ How to Troubleshoot a Kubernetes Cluster: A Step-by-Step Guide 🚀

Kubernetes is powerful but troubleshooting issues in a K8s cluster can be complex. This guide will help you debug and fix common Kubernetes problems like pod failures, networking issues, node problems, and control plane failures.

📌 Keywords: Kubernetes troubleshooting, fix Kubernetes issues, Kubernetes debugging, Kubernetes pod errors, Kubernetes service not working, Kubernetes networking issues, Kubernetes health checks failing, Kubernetes CrashLoopBackOff, Kubernetes NotReady node, Kubernetes API server down, kubectl logs, Kubernetes monitoring tools.

🛠️ Common Kubernetes Issues & How to Fix Them

Kubernetes failures usually fall into these categories:
✅ Pod Issues (CrashLoopBackOff, ImagePullBackOff, OOMKilled)
✅ Service & Networking Issues (Pods unreachable, DNS failures)
✅ Node Issues (NotReady nodes, kubelet failures, resource exhaustion)
✅ Control Plane Issues (API Server down, etcd failures)
✅ Persistent Storage Issues (PVC not bound, Disk Pressure)

Let’s dive into how to troubleshoot each of these step by step! 🔍

🚀 Step 1: Troubleshooting Pod Issues

🔹 1. Check Pod Status

kubectl get pods -A

💡 Common Issues:

CrashLoopBackOff → Pod is repeatedly crashing
ImagePullBackOff → Image pull failed
Pending → Pod is waiting for a resource

🔹 2. Inspect Pod Logs

kubectl logs <pod-name> -n <namespace>

💡 Fix:

If the error is related to the application (e.g., missing dependencies), update the container image.
If logs show connection refused, check Service & Networking.

🔹 3. Check Pod Events & Describe Pod

kubectl describe pod <pod-name> -n <namespace>

Look for:

"FailedMount" (Persistent Volume issue)
"FailedScheduling" (Node scheduling issue)
"OOMKilled" (Out of Memory)

💡 Fix:

FailedMount? Check if Persistent Volume is correctly attached.
OOMKilled? Increase memory limits in the pod spec.

🖧 Step 2: Troubleshooting Service & Networking Issues

🔹 1. Check Service Details

kubectl get svc -A

Verify if:

Type: ClusterIP, NodePort, LoadBalancer is correct
EXTERNAL-IP is assigned (for LoadBalancer services)

🔹 2. Check Service Endpoints

kubectl get endpoints -A

💡 If there are no endpoints, your service is not connecting to pods.

🔹 3. Manually Test Service Connectivity

kubectl exec -it <pod-name> -- curl http://<service-ip>:<port>

💡 Fix:

If curl fails, check if the Service Selector correctly maps to pods.
If using CoreDNS, verify it’s running:

kubectl get pods -n kube-system | grep coredns

🖥️ Step 3: Troubleshooting Node Issues

🔹 1. Check Node Status

kubectl get nodes

If a node is NotReady, check its events:

kubectl describe node <node-name>

💡 Possible Errors & Fixes:
| Issue | Cause | Fix |
|--------|-------|------|
| NotReady | Kubelet crash | Restart Kubelet: sudo systemctl restart kubelet |
| DiskPressure | Node out of disk | Clean logs: sudo du -sh /var/lib/docker |
| MemoryPressure | Insufficient memory | Increase node memory in cloud provider |

🔹 2. Check Kubelet Logs

journalctl -u kubelet -n 50

If Kubelet is not responding, restart it:

sudo systemctl restart kubelet

⚙️ Step 4: Troubleshooting Control Plane Issues

If your API server is down, the entire cluster becomes unresponsive.

🔹 1. Check API Server Logs

kubectl cluster-info

If the API server is not reachable, check logs:

sudo journalctl -u kube-apiserver -n 50

💡 Fix:

If etcd is failing, restart it:

sudo systemctl restart etcd

Check if control plane nodes are under resource constraints.

💾 Step 5: Troubleshooting Persistent Storage Issues

If your pods are stuck in "ContainerCreating" due to volume issues:

🔹 1. Check Persistent Volume (PV) and Claim (PVC)

kubectl get pv,pvc -A

💡 Fix:

If PVC is Pending, check storage class:

kubectl get storageclass

If disk is full, expand storage.

🛠️ Best Practices for Troubleshooting Kubernetes

🔹 Enable Logging & Monitoring (kubectl logs, Prometheus, Loki)
🔹 Use kubectl get events for real-time issues
🔹 Keep your cluster nodes updated
🔹 Automate Scaling (Horizontal Pod Autoscaler)

🚀 Conclusion

Troubleshooting Kubernetes requires systematic debugging of pods, services, nodes, and control plane components. Using tools like kubectl logs, kubectl describe, and monitoring solutions like Prometheus can help detect and resolve issues quickly.

A Complete Guide to Docker: Images, Containers, Networking, and Volumes

Kuldeepkumhar-fs — Tue, 25 Feb 2025 17:19:43 +0000

A Complete Guide to Docker: Images, Containers, Networking, and Volumes

Topics Covered

Introduction to Docker
Working with Docker Images
Managing Docker Containers
Docker Networking
Persistent Storage with Docker Volumes

Introduction

Docker has revolutionized the way we develop, deploy, and manage applications by containerizing them. It allows developers to package applications along with their dependencies into lightweight, portable containers that can run anywhere.

In this guide, we'll explore Docker fundamentals, including Docker images, containers, networking, and volumes, with practical commands and explanations.

1. What is Docker?

Docker is an open-source platform that enables developers to automate the deployment of applications inside lightweight, portable containers.

Why Use Docker?

Portability: Containers run the same way across different environments.
Scalability: Easily scale applications up or down.
Efficiency: Uses fewer resources compared to virtual machines.
Isolation: Each container runs independently.

Basic Docker Commands

# Check Docker version
docker --version

# Check system-wide Docker info
docker info

# List all available commands
docker help

2. Working with Docker Images

A Docker image is a lightweight, standalone, and executable software package that includes everything needed to run a piece of software.

Docker Image Commands

# Search for an image from Docker Hub
docker search ubuntu

# Download (pull) an image from Docker Hub
docker pull ubuntu

# List all downloaded images
docker images

# Remove an image
docker rmi ubuntu

Create a Custom Docker Image

You can create your own image using a Dockerfile.

Example Dockerfile:

# Use Ubuntu as the base image
FROM ubuntu:latest

# Install dependencies
RUN apt-get update && apt-get install -y curl

# Set working directory
WORKDIR /app

# Copy files to the container
COPY . /app

# Set default command
CMD ["bash"]

Build and Run the Image:

# Build an image from the Dockerfile
docker build -t my-custom-image .

# Run a container from the custom image
docker run -it my-custom-image

3. Managing Docker Containers

A Docker container is a running instance of a Docker image.

Basic Container Commands

# Run a container from an image
docker run -it ubuntu

# Run a container in detached mode (-d runs it in the background)
docker run -d --name my-container ubuntu

# List running containers
docker ps

# List all containers (including stopped ones)
docker ps -a

# Stop a running container
docker stop my-container

# Remove a container
docker rm my-container

4. Docker Networking

Docker networking allows containers to communicate with each other and external systems.

List Networks

docker network ls

Create a New Network

docker network create my_custom_network

Run a Container in a Specific Network

docker run -d --name container1 --network my_custom_network nginx

Connect an Existing Container to a Network

docker network connect my_custom_network container1

Inspect Network Details

docker network inspect my_custom_network

5. Docker Volumes (Persistent Storage)

Docker volumes are used to persist data across container restarts.

List Volumes

docker volume ls

Create a Volume

docker volume create my_volume

Run a Container with a Mounted Volume

docker run -d -v my_volume:/data --name my_container ubuntu

Inspect Volume Details

docker volume inspect my_volume

Remove a Volume

docker volume rm my_volume

Conclusion

Docker simplifies the deployment and management of applications by containerizing them. Understanding images, containers, networking, and volumes is essential for efficient use of Docker in development and production environments.

By mastering these concepts and commands, you'll be well-equipped to work with Docker and deploy applications seamlessly!

🚀 Happy Dockering! 🚀

📌 Where to Learn More?