File Archiving to AWS S3 using AWS SDK for Java

Shubham Srivastava — Sat, 04 Apr 2026 11:53:14 +0000

Many servers process and generate large amounts of data daily, resulting in numerous files. Storing these files on the server for extended periods consumes significant server space. To address this, these files can be efficiently archived into S3 buckets.

The AWS SDK for Java offers user-friendly APIs for various AWS services. By utilizing the AWS SDK, we can develop a Java application capable of interacting with S3 to perform tasks such as listing buckets, uploading and downloading objects, and executing other S3-related operations.

Let's begin with a straightforward Java project structured as follows:

Our project requires only two Maven dependencies to function:

We will implement two static methods. The first method will construct an S3 client using essential properties such as the S3 endpoint URL, bucket name, access key ID, and secret access key. These properties become available upon S3 bucket creation. The second method will use this S3 client to establish an HTTP connection with S3 and handle the file upload process.

Finally, the main method will iterate through files in a specified directory, compiling a list of files with their respective paths. It will then proceed to upload each file to the S3 bucket using the previously defined upload method. After verifying the files are successfully stored in the S3 bucket, all uploaded files will be deleted from the server to free up space.

Conclusion

By implementing this Java-based solution, organizations can effectively manage server storage by offloading large volumes of data to AWS S3. The AWS SDK for Java simplifies interaction with S3, enabling the creation of robust applications for archiving files. This approach not only frees up valuable local server space but also leverages the scalability and durability of S3, providing a practical and efficient strategy for long-term data management.

Simple steps to create AWS EKS Cluster and Nodes

Shubham Srivastava — Sun, 14 Apr 2024 18:00:57 +0000

Amazon Elastic Kubernetes Service (EKS):

Kubernetes is a set of open source tools that automates deployment , management and scaling of containerized applications. AWS EKS is a wrapper around Kubernetes that provides managed service to maintain Kubernetes control plane. As it is managed by AWS you do not need to install , scale , maintain and operate control plane.

Since cloudformation templates are the simplest approach to describe and deliver infrastructure declaratively while utilising maintainability and reusability, I have used them to create Clusters and Nodes.

Prerequisites:

An active AWS account.
Basic knowledge of AWS services specifically IAM,EKS and CloudFormation.
AWS CLI and Kubectl installed and configured on local machine.

1. Create EKS Cluster

Here is the CloudFormation template for EKS cluster creation. This comprises 3 sections Template Version, Parameters and Resources.

AWSTemplateFormatVersion:

Version of the CloudFormation template.

Parameters:

Required values that we will pass dynamically while creating stack using AWS CLI

Resources:

AWS resources required for the EKS cluster.

Save this file as AWS-EKSClusterTemplate.yml in your local machine and replace default values in Parameters sections and run below command that will create CloudFormation Stack and EKS Cluster.

Please do not forget to replace default values with your AWS services as these values are specific to my AWS account and will give error. You can use default VPC, Subnet and EC2 key pair from your AWS account.

aws cloudformation create-stack --stack-name myClusterStack --template-body file://AWS-EKSClusterTemplate.yml --capabilities CAPABILITY_NAMED_IAM

2. Create EKS Nodes:

Here is the cf template for EKC Nodes creation.

Save this file as AWS-EKSNodesTemplate.yml in your local machine and replace default values in Parameters section and run below command to create CloudFormation Stack and EKS Nodes.

aws cloudformation create-stack --stack-name myNodeStack --template-body file://AWS-EKSNodesTemplate.yml --capabilities CAPABILITY_NAMED_IAM

Login to AWS account and check stack status. This process might take sever minutes. Once its complete stack status must show completed as below.

3. Use kubectl to check nodes in cluster and deploy first docker image.

Run kubectl get nodes command in your terminal, it will show 1 node in ready state.

If you have not configured kubectl to connect to newly created EKS cluster then run below command.

aws eks update-kubeconfig --name MyWebCluster

Now our environment is ready for deployment. Let's deploy and test nginx webserver using below command.

kubectl run nginx --image=nginx

Now, the port-forward feature of kubectl simply tunnels the traffic from a specified port at your localhost machine to the specified port on the pod.

Finally, pod is running and serving at port 8080. You can test application by visiting (http://localhost:8080) in web browser.

4. Clean Up

Cleaning up all the resources that were created above is crucial; failing to do so will result in significant expenses.

aws cloudformation delete-stack --stack-name myNodeStack
aws cloudformation delete-stack --stack-name myClusterStack

Conclusion:

AWS EKS simplifies managing containerized applications by offering a scalable, secure, and Kubernetes-based platform. If you're looking for agility and a focus on development, EKS lets you offload cluster management to AWS. Consider EKS for your next containerized project!

DEV Community: Shubham Srivastava