DEV Community: Alok Kumar

Agile and DevOps

Alok Kumar — Sat, 25 Nov 2023 04:51:12 +0000

Agile and DevOps

Agile and DevOps, we can understand it by simple example.

Imagine you're planning a dinner party with friends. Instead of deciding everything at once, you might plan it step by step, being open to changes along the way.

You decide on the basics first - date, guest list, and location. This is like Agile's "sprints" where you focus on small parts of a bigger project.

As you plan, you're open to adjustments. Just like Agile encourages adapting plans as you go, maybe a friend can't make it or you find a better location.

During the party, you might notice some things could be better, like the music or food choice. Agile works similarly; after each sprint (or phase), you get feedback and improve for the next one.

Agile is like planning a gathering step by step, staying flexible, and adapting as needed. DevOps is more like a well-coordinated kitchen where teams collaborate, use efficient tools, and continuously improve their process.

Test Automation and Shift-Left

Test Automation and Shift-Left both are one of the strong piller of Agile and Devops methodology.

We can imagine a test automation as a robot assistant that helps to do our job faster than you could and save our lots of time and effort and Shift-left is planning ahead and gathering supplies and reduce the risks.

Both actually aim to streamline processes, improve quality, and reduce risks in their respective domains.

Serverless

Serverless is just like laundry service 😀
Where you drop your clothes without worrying about the washing machine, detergent, or timing. 😎

Laundry service ( or cloud provider in devops prospect) will manage the infrastructure and they can scale it accordingly.
If your laundry load increases, the service handles it without you worrying about machine capacity.

Serverless automatically scales based on demand, handling varying workloads seamlessly.

It simplify tasks and allow users to focus more on their core activities without worrying about underlying processes.

Certified Kubernetes Administrator (CKA) - Several Successful Story

Alok Kumar — Sat, 18 Nov 2023 05:10:35 +0000

Are you ready to conquer the Kubernetes CKA (Certified Kubernetes Administrator) Exam?

Introducing an exciting opportunity: my brand-new CKA Exam Questions Challenge Course, exclusively available on Udemy!

This dynamic question challenge set is meticulously crafted to help you achieve remarkable scores in the CKA Exam.

Each question is thoughtfully designed with varying levels of complexity, ensuring you're well-prepared before sitting for the exam.

But wait, there's more! Our comprehensive video series is a must-watch, providing you with invaluable insights and guidance to tackle every question effectively.

Still skeptical? Rest assured that over 1,000 individuals have already received notifications celebrating their successful completion of the CKA Exam, all thanks to our sample question sets.

Some friends tagged me on LinkedIn after successful completing of CKA certification after completing my Udemy Course (You will be the next one :)), linking below few links for your reference:

CKA Tagging
CKA Tagging
CKA Tagging
CKA Tagging
CKA Tagging
CKA Tagging
CKA Tagging
CKA Tagging
CKA Tagging
CKA Tagging
CKA Tagging
CKA Tagging
CKA Tagging
CKA Tagging
CKA Tagging
CKA Tagging
CKA Tagging
CKA Tagging
CKA Tagging
CKA Tagging
CKA Tagging

and many more ....

But we don't stop there. Each question comes with a complete lab, allowing you to gain hands-on experience and solidify your understanding of Kubernetes.

Embark on your path to mastery and unlock the boundless potential of Kubernetes!

Enroll now in the Kubernetes CKA Exam Questions Udemy Course using the heavy discount link.

kubernetes #CKA #DevOps #CKAD #learningeveryday #AWS #Cloud #devopscommunity #cloudcomputing

Terraform - Interview Question Series

Alok Kumar — Tue, 14 Nov 2023 13:22:22 +0000

Please find the list of interview question on Terraform

Question-1: What is Terraform and what is it used for?

Answer: Terraform is an open-source infrastructure as code (IAC) software tool used for provisioning and managing cloud infrastructure, on-premises infrastructure, and other infrastructure resources in a consistent and efficient manner.

Question-2: What are the key features of Terraform?

Answer: Declarative Configuration: Terraform uses a declarative syntax to describe infrastructure resources, making it easier to manage complex infrastructure and ensuring consistency.

Resource Management: Terraform provides a unified way to manage multiple resources, such as virtual machines, DNS entries, databases, and more.

Versioning and History: Terraform maintains a history of changes and versions, making it easier to collaborate and roll back changes if necessary.

Multi-Cloud Support: Terraform supports multiple cloud providers, including Amazon Web Services (AWS), Google Cloud Platform (GCP), Microsoft Azure, and more.

Modular Design: Terraform allows users to define reusable components, making it easier to manage complex infrastructure and promoting consistency and organization.

... Visit my blog on Interview Question Series ...

Question-59: What is the difference between Terraform and other infrastructure as code tools such as Ansible and Chef?

Answer: Terraform, Ansible, and Chef are all popular tools for infrastructure as code, but they have different focuses and use cases.

Terraform focuses on provisioning and managing infrastructure, providing a high-level description of the desired state of your infrastructure, and automating the process of creating and updating infrastructure to match that desired state. Terraform is best suited for tasks such as creating and managing cloud infrastructure, networking, and storage.

Ansible, on the other hand, is focused on configuration management and deployment, providing a way to automate the deployment and configuration of software and applications. Ansible is best suited for tasks such as deploying and configuring applications and services, and managing the configuration of servers and other infrastructure components.

Chef is another popular tool for infrastructure as code and configuration management, providing a way to automate the deployment and configuration of software and applications. Chef provides a more extensive and flexible automation framework, but requires a more significant learning curve and investment in terms of time and resources to use effectively.

In short, Terraform, Ansible, and Chef are all valuable tools for infrastructure as code, but have different focuses and use cases, and can be used together in a complementary fashion to manage infrastructure and applications more effectively.

Question-60: How does Terraform handle rollbacks in case of failures during infrastructure changes?

Answer: Terraform provides a "plan and apply" approach, which makes it easy to preview and control changes to your infrastructure before they are actually made. This helps to reduce the risk of failures during infrastructure changes.

In the event of a failure during an infrastructure change, Terraform provides several mechanisms for rolling back changes:

Terraform state: The Terraform state file keeps track of the current state of your infrastructure, and can be used to revert changes in the event of a failure.

Terraform destroy: The Terraform destroy command can be used to revert changes made by a Terraform apply, removing the resources that were created.

Terraform taint: The Terraform taint command can be used to mark a specific resource as "tainted", which indicates to Terraform that the resource should be destroyed and recreated the next time Terraform apply is run.

In addition, Terraform provides state management features, such as state backup and state import, which make it easier to manage and maintain the state file over time, and to revert changes in the event of a failure.

In short, Terraform provides a flexible and comprehensive mechanism for handling rollbacks in case of failures during infrastructure changes, making it easier to ensure the stability and reliability of your infrastructure over time.

... Visit my blog on Interview Question Series ...

YouTube 13k Subscriber crossed! Exciting Giveaway

Alok Kumar — Sat, 04 Nov 2023 06:27:52 +0000

Dear Friends,

My YouTube channel, @alokkumar, has just reached a remarkable milestone of 13,000 subscribers.

To celebrate this incredible achievement, I'm thrilled to announce a special giveaway.

I'll be offering a generous gift of 100 free enrollments for my highly acclaimed Udemy course, "Certified Kubernetes Administrator (CKA): 100% Lab Course," exclusively to those candidates who have scheduled their CKA exam on or before January 31, 2024.

My best wishes and good luck to all of you amazing individuals aiming for CKA success! 🚀🎉

Please DM me on LinkedIn and provide me your CKA exam enrollment acknowledgement receipt.

Please share it with your friends and repost this post.

YouTube

CKA Udemy Course Link

Thanks

kubernetes #cka #aws #devopscommunity #giveaway #keeplearning #youtube #udemycoupon #udemyfree #udemy

DevOps Interview Bootcamp: Sharpen Your Q&A Skills - 900 Q&A

Alok Kumar — Wed, 01 Nov 2023 15:04:46 +0000

Dear Friends,

Welcome to our exciting 2nd course on Udemy "DevOps Interview Bootcamp: Sharpen Your Q&A Skills - 900 Q&A".

Are you tired of struggling with technical questions during DevOps interviews? Do you want to gain confidence and master the art of answering difficult questions? Look no further! Our comprehensive course is designed to help you excel in your DevOps interviews and land your dream job using MCQ question set with 900 Questions.

Our expert instructors have crafted a detailed question and answer set for you to practice with. You'll learn how to interpret each question, understand the underlying concepts, and formulate the correct response. You'll also receive valuable feedback on your answers, helping you to identify and correct mistakes.

This course is not just about memorizing answers. It's about developing a deep understanding of DevOps concepts and learning how to apply them to real-world situations. With our course, you'll be able to confidently tackle even the most challenging technical questions that may come your way during an interview.

Our unique approach to DevOps interview preparation ensures that you will not only be well-prepared for your interviews but also excel in your role as a DevOps professional. Don't miss out on this opportunity to take your career to the next level. Enroll now and start your journey to DevOps Interview Mastery!

Questions Covered From:

Jenkins
Docker
Kubernetes
Terraform
Ansible
Git
AWS
Others

Enroll now in the Udemy Course using the link with heavy discount coupon:

DevOps Interview Bootcamp: Sharpen Your Q&A Skills - 900 Q&A

kubernetes #DevOps #learningeveryday #AWS #Cloud #devopscommunity #cloudcomputing #Jenkins #Docker #Terraform #Ansible #Git

'Kubernetes Complete Course In 10 Hours' – your ultimate beginner's guide to Kubernetes FREE!

Alok Kumar — Fri, 06 Oct 2023 02:29:38 +0000

Dear Friends,

The long-awaited moment has finally arrived! Introducing the 'Kubernetes Complete Course In 10 Hours' – your ultimate beginner's guide to Kubernetes.

Let's spread the word! Share this video link far and wide to help those in need and build a vibrant learning community together.

Kubernetes, often abbreviated as K8s, is like a super-smart manager for your computer programs. Imagine you have lots of applications and want to make sure they run smoothly, scale when needed, and recover from problems automatically.

Kubernetes helps you do that by organizing and managing your applications, like a traffic cop for your software, making sure everything runs as it should on a cluster of computers or servers.

It's like having a team of experts to take care of your software, so you don't have to worry about it constantly.

What all topics of Kubernetes, we are going to cover in this course?

Kubernetes Cluster Architecture
EKS Cluster Setup
Simple Pod
ReplicaSet
Deployments
DaemonSet
Lebel and Selector
Static Pod
Graceful and Forceful Termination of Resource
NodeName and NodeSelector
NodeAffinity
Taint and Tolerations
Namespaces
Service Part-1
Service Part-2
Init Containers
Multiple-Scheduler
ConfigMaps
Secrets
Persistent Volume & Claim
Network Policy
ETCD Database backup and restore
Cluster Upgrade
EKS Cluster Scaling
CKA Exam Tips

About Course

"We designed this course to be 80% hands-on labs and only 20% theory. This way, you can get the most out of it, even if you don't know anything about Kubernetes yet. All you need is a bit of familiarity with Docker, and you'll be good to go!"

Kubernetes #CKA #DevOps #CKAD #learningeveryday #AWS #Cloud #devopscommunity #cloudcomputing

Don’t Forget To Like, Comment, Share & Subscribe to my Channel, It always motivates me.

Kubernetes Complete Course In 10 Hours

Kubernetes CKA Exam Question Bank .. 17 Questions with Complete Lab .. In 3 hours .. FREE!

Alok Kumar — Sun, 24 Sep 2023 16:27:48 +0000

Hello friends,

let me share my journey with you in a way that's both relatable and exciting. It's a story about my experience preparing for the Certified Kubernetes Administrator (CKA) exam and how it led to something amazing.

Picture this: I was gearing up for the CKA exam, eager to conquer it. The only problem was, I had no clue about the type of questions that would pop up in the test. To make things challenging, there was hardly any content available on YouTube back in those days that could guide me. Frustrating, right?

So, I made a bold decision. I decided to bridge this gap myself. I thought, "Why not create a course that provides questions similar to those asked in the CKA exam, along with step-by-step lab sections to tackle them?" That way, aspiring CKA candidates could not only understand the problems but also learn how to solve them effortlessly.

As time rolled on, something incredible happened. People from all corners of the world started appreciating my efforts. They began clearing the CKA certification, all thanks to my "CKA Challenge Question Labs" course. You see, the CKA exam isn't a walk in the park, and my course wasn't just about questions. It was about boosting confidence.

I didn't stop there, though. I kept adding more and more questions to the course, and my YouTube subscribers grew by the day. People were tagging me on LinkedIn, celebrating their certification victories. Over a thousand of them! But here's the kicker – my reach was still somewhat limited.

That's when I had a vision. I needed to take my mission to the next level. So, I decided to transform my course into something bigger and better on Udemy. I put together a comprehensive CKA practice set course, and guess what? Friends from all over the world showed a keen interest and enrolled in the course.

But wait, there's more. I wanted to make sure that everyone had access to these valuable resources. So, I did something special. I distributed some of my courses for free and even hosted exciting giveaways. Of course, there were paid options too, for those who wanted to dive deeper.

In this video series, I cover a massive 17 challenging CKA exam questions. Each question is accompanied by a lab section right next to it, and they come in varying difficulty levels, all neatly packaged into one video. It's a breeze to watch and prepare for the exam.

Now, here's the deal: If you appreciate my dedication and want to tackle more of these challenging questions, I invite you to enroll in my Udemy course. I'm constantly adding fresh content, so you'll stay connected with me and continue to supercharge your CKA exam preparation.

Join me on this journey, and let's conquer the CKA exam together!

Kubernetes CKA Exam Question Bank

Full Course On Udemy

Terraform Full Course in 9 hours .. Zero to Hero Series #FREE#

Alok Kumar — Thu, 21 Sep 2023 04:26:04 +0000

Dear Friends,

Please find my Terraform Full Course in 9 hours .. Zero to Hero Series on YouTube for free .. #terraform #devops @AlokKumar

Terraform is a tool that helps you create and manage your computer infrastructure, like servers, databases, and networks, in a way that's easy to understand and repeatable. It uses code to define your infrastructure, which means you can treat your infrastructure like software, allowing you to automate its creation and changes.

Let's say you want to set up a web server on a cloud platform like Amazon Web Services (AWS). Instead of manually clicking through the AWS console to create the server, you can use Terraform to write a simple configuration file that describes the server's specifications, like its size, operating system, and security settings.

By using Terraform, you can automate the provisioning and management of your infrastructure, making it easier to scale, update, and maintain your applications and services.

What all topics of Terraform, we are going to cover in this course?

Creating First EC2 Instance
tfstate file .. backup state file .. destroy target flag
Terraform Resource Attribute and Output Values
Terraform Provider Version handling
Terraform Format, Validate, EIP Association with EC2
Terraform Shared Credential, AWS CLI, Comments
Running Nginx From Docker Container using Terraform
Terraform Input Variable Part – 1
Terraform Variable, Count and Generating and Applying Terraform Plan Part – 2
Input Variable from terraform.tfvars, *.tfvars, *.auto.tfvars and environment variables Part – 3
Implement Variable Type as String, Number, List and Map. Part – 4
Terraform Meta-Argument for_each
Terraform Meta-Argument – lifecycle
Terraform Data Resource
Terraform State Management using S3 and DynamoDB
Terraform Workspace .. Help to keep Infrastructure consistent
Terraform Taint .. Recreate a degraded or damaged resources
Numeric, String and Collection Function
Encoding & FileSystem
Terraform Provisioners .. File, Local-exec, Remote-exec, Creation & Destroy-Time and Failure Behavior
Terraform Modules
Terraform Locals and Module Source

About this course

We designed this course to be 80% hands-on labs and only 20% theory. This way, you can get the most out of it, even if you don't know anything about Terraform yet. All you need is a bit of familiarity with AWS, and you'll be good to go!

About me

Hi, I'm Alok Kumar, and I've been working in the IT industry for over 15 years. I'm not only an instructor for three courses on Udemy but also share my knowledge through my YouTube channel. What's really exciting is that over 1000 students have already earned certifications through my courses and connected with me on LinkedIn!

Terraform #DevOps #learningeveryday #AWS #Cloud #devopscommunity #cloudcomputing

Don’t Forget To Like, Comment, Share & Subscribe to my Channel, It always motivates me.

Free YouTube Course - Terraform Full Course in 9 hours

Certified Kubernetes Administrator (CKA) - Practice Question with Complete Details Lab

Alok Kumar — Thu, 13 Apr 2023 02:46:45 +0000

If you're looking to become a certified Kubernetes administrator, then our CKA course is an absolute must-watch! Kubernetes has become the de facto standard for container orchestration, and a CKA certification is a valuable asset to have on your resume.

Our course is designed to give you the knowledge and skills you need to pass the CKA exam with flying colors.

In this course, you will learn to answer, how to deploy and manage Kubernetes clusters, configure networking, and use Kubernetes APIs to automate tasks.

You'll gain hands-on experience with important concepts like containerization, pod deployment, and service management.

As an expert instructors, I will guide you through each step of the process, giving you the confidence you need to succeed on exam day.

Whether you're just starting out with Kubernetes or looking to take your skills to the next level, our CKA course on complete hands-on is the perfect choice.

With comprehensive lab session, real-world examples, and interactive labs, this course is designed to help you master the skills you need to become a successful Kubernetes administrator.

This is 100% Lab Series with proper solution to each questions.

Remember that this course gives you more than 90% guarantee that, you will pass the Certified Kubernetes Administrator Exam.

You need to understand, each and every question carefully and try to answer your own first, in case you feel difficulties in solving it.

A proper solution, provided to that problem in details in next video.

After achieving great success on YouTube, I'm bringing this valuable course to a wider audience.

Don't miss out on this amazing opportunity - click on the link below to enroll now and take your career to the next level with the Certified Kubernetes Administrator - CKA certification.

Your satisfaction is my top priority, and your positive rating and feedback are incredibly valuable to me.

Not only do they give me a boost of confidence, but they also help me improve my skills and better serve you in the future.

So, please don't hesitate to leave a rating and share your thoughts - I am eager to hear what you have to say!

My Udemy Course Link

Creating Thumbnail Image using Terraform, Lambda, IAM, CloudWatch and S3 Bucket

Alok Kumar — Tue, 13 Dec 2022 07:42:21 +0000

In this Blog, we are going to use Terraform as IAC tools for resource provisioning.

Through, Terraform we are going to create below resources and establish the connectivity between them:

Lambda
IAM
CloudWatch
S3 bucket (Original and Thumbnail)

We are going to see how to use terraform to create an AWS Lambda function and configure an AWS S3 trigger.

The use case is to generate a thumbnail image whenever an image is uploaded to S3 Original bucket.

We will first write a Lambda function which will open the original image from a source bucket and create a thumbnail and store it in thumbnail bucket.

Then we will configure an S3 trigger to trigger this Lambda function whenever an image is uploaded to the S3 bucket.

The prerequisite for this project is to have terraform and AWS CLI configured.

I have already configured my CLI in my system using “aws configure” command.

I will create a new directory for the project, we’ll call it as “thumbnail_generation_lambda-main” we will open this project in the visual studio code.

We will create a Lambda function in python, which I will put it in a directory called src.

We will start writing the code, first we need to define a Lambda Handler, which will be the entry point for the Lambda function, which takes two parameters event and context.

I will import the logging Library and configure the logger.
As we begin, we will print the event and the context.

Next, we need to extract the bucket name and the key from the event. Whenever this Lambda function is called from an S3 trigger, the trigger will pass the event.

Object with the bucket and the key, which is a file name being uploaded, we need to extract the bucket name and key.

The first item in this record is S3 bucket name. This will be the bucket name and the key name. Then we will define the destination bucket name and the key.

We will call this bucket name as "alok-thumbnail-image-bucket-0007" and the destination file name we will just append underscore thumbnail to the original file name, for which I need to use OS dot path split, for that I will import OS library and I will pass the key which will return me the name and extension separately, thumbnail name extension from this I will build the thumbnail key which would be thumbnail name underscore thumbnail and the extension, this will be the destination key.

Next, we will get access to S3 for which, I need to use the import library boto3.

Open the file in S3 by passing bucket and key value, I will extract the body of this and read it as a byte string.

We will load this image in memory bytes IO for that we will import BytesIO Library, from IO import bytes IO then load the image in memory.

This will load the image in memory and then we will use pillow image object.

We will pass this byte IO image dot open and passing this byte IO. I'm passing this image, just for the information purpose we will log the size of this image before we actually compress.

To generate thumbnail this is the method IMG dot thumbnail and mention the preferred size, here I will mention 500 comma 500.

With image anti layers option passed the image would have been now compressed we will again log the size now to see what is the to see what is the final results after compression and now we need to dump this image into a destination bucket for that we need to write the image in a buffer and then pass this buffer directly to the destination bucket.

Buffer equal to bytes IO, we create a new by for object and then save the image to this buffer in the in the preferred format.

Now I will be dumping it into the destination bucket. We'll use this same data to validate whether the success whether the upload is successful or not.

Status code is not equal to 200 which is Success you will raise exception and then finishing the Lambda function by return success.

Here, in this case I am just returning the original event object with this we have finished writing the Lambda function, below is the final code of the lambda.py file

import logging
import boto3
from io import BytesIO
from PIL import Image
import os

logger = logging.getLogger()
logger.setLevel(logging.INFO)

def lambda_handler(event, context):
    logger.info(f"event: {event}")
    logger.info(f"context: {context}")

    bucket = event["Records"][0]["s3"]["bucket"]["name"]
    key = event["Records"][0]["s3"]["object"]["key"]

    thumbnail_bucket = "alok-thumbnail-image-bucket-0007"
    thumbnail_name, thumbnail_ext = os.path.splitext(key)
    thumbnail_key = f"{thumbnail_name}_thumbnail{thumbnail_ext}"

    logger.info(f"Bucket name: {bucket}, file name: {key}, Thumbnail Bucket name: {thumbnail_bucket}, file name: {thumbnail_key}")

    s3_client = boto3.client('s3')

    # Below snippet of code will Load and open image from S3
    file_byte_string = s3_client.get_object(Bucket=bucket, Key=key)['Body'].read()
    img = Image.open(BytesIO(file_byte_string))
    logger.info(f"Size before compression: {img.size}")

    # Below snippet of code will Generate thumbnail
    img.thumbnail((500,500), Image.ANTIALIAS)
    logger.info(f"Size after compression: {img.size}")

    # Below snippet of code will Dump and save image to S3
    buffer = BytesIO()
    img.save(buffer, "JPEG")
    buffer.seek(0)

    sent_data = s3_client.put_object(Bucket=thumbnail_bucket, Key=thumbnail_key, Body=buffer)

    if sent_data['ResponseMetadata']['HTTPStatusCode'] != 200:
        raise Exception('Failed to upload image {} to bucket {}'.format(key, bucket))

    return event

We will then move on to configure part of Terraform (Main.tf).

We are going to mention all the details in the terraform for provisioning the resources like:

1. AWS Provider

terraform {
  required_providers {
    aws = {
      source  = "hashicorp/aws"
      version = "4.36.1"
    }
    archive = {
      source  = "hashicorp/archive"
      version = "~> 2.2.0"
    }
  }
  required_version = "~> 1.0"
}

provider "aws" {
  region = var.aws_region
}

2. Archive Provider - Used for bundling the source to zip file and upload it to lambda.

3. Original and Thumbnail S3 bucket.

resource "aws_s3_bucket" "thumbnail_original_image_bucket" {
  bucket = "alok-original-image-bucket-0007"
}

resource "aws_s3_bucket" "thumbnail_image_bucket" {
  bucket = "alok-thumbnail-image-bucket-0007"
}

4. Setting the policy of Get (Original) and Put object (Thumbnail).

resource "aws_iam_policy" "thumbnail_s3_policy" {
  name = "thumbnail_s3_policy"
  policy = jsonencode({
    "Version" : "2012-10-17",
    "Statement" : [{
      "Effect" : "Allow",
      "Action" : "s3:GetObject",
      "Resource" : "arn:aws:s3:::alok-original-image-bucket-0007/*"
      }, {
      "Effect" : "Allow",
      "Action" : "s3:PutObject",
      "Resource" : "arn:aws:s3:::alok-thumbnail-image-bucket-0007/*"
    }]
  })
}

5. Lambda IAM Role to assume the role

resource "aws_iam_role" "thumbnail_lambda_role" {
  name = "thumbnail_lambda_role"
  assume_role_policy = jsonencode({
    "Version" : "2012-10-17",
    "Statement" : [{
      "Effect" : "Allow",
      "Principal" : {
        "Service" : "lambda.amazonaws.com"
      },
      "Action" : "sts:AssumeRole"
    }]
  })
}

6. IAM Policy Attachment, role for s3 and role for lambda

resource "aws_iam_policy_attachment" "thumbnail_role_s3_policy_attachment" {
  name       = "thumbnail_role_s3_policy_attachment"
  roles      = [aws_iam_role.thumbnail_lambda_role.name]
  policy_arn = aws_iam_policy.thumbnail_s3_policy.arn
}
resource "aws_iam_policy_attachment" "thumbnail_role_lambda_policy_attachment" {
  name       = "thumbnail_role_lambda_policy_attachment"
  roles      = [aws_iam_role.thumbnail_lambda_role.name]
  policy_arn = "arn:aws:iam::aws:policy/service-role/AWSLambdaBasicExecutionRole"
}

7. Configuration to zip the lambda file to upload “my-lambda-code.zip”

resource "aws_lambda_function" "thumbnail_lambda" {
  function_name = "thumbnail_generation_lambda"
  filename      = "${path.module}/my-lambda-code.zip"

  runtime     = "python3.9"
  handler     = "lambda.lambda_handler"
  memory_size = 256

  source_code_hash = data.archive_file.thumbnail_lambda_source_archive.output_base64sha256

  role = aws_iam_role.thumbnail_lambda_role.arn

  layers = [
    "arn:aws:lambda:ap-south-1:770693421928:layer:Klayers-p39-pillow:1"
  ]
}

8. Setting lambda permission to Thumbnail bucket to put the thumbnail.

resource "aws_lambda_permission" "thumbnail_allow_bucket" {
  statement_id  = "AllowExecutionFromS3Bucket"
  action        = "lambda:InvokeFunction"
  function_name = aws_lambda_function.thumbnail_lambda.arn
  principal     = "s3.amazonaws.com"
  source_arn    = aws_s3_bucket.thumbnail_original_image_bucket.arn
}

resource "aws_s3_bucket_notification" "thumbnail_notification" {
  bucket = aws_s3_bucket.thumbnail_original_image_bucket.id

  lambda_function {
    lambda_function_arn = aws_lambda_function.thumbnail_lambda.arn
    events              = ["s3:ObjectCreated:*"]
  }

  depends_on = [
    aws_lambda_permission.thumbnail_allow_bucket
  ]
}

9. Creation of CloudWatch log group for logging purpose and monitoring traces.

resource "aws_cloudwatch_log_group" "thumbnail_cloudwatch" {
  name = "/aws/lambda/${aws_lambda_function.thumbnail_lambda.function_name}"

  retention_in_days = 30
}

Side by side, we created 2 more files:

1.variables.tf

variable "aws_region" {
  description = "AWS region for all resources."

  type    = string
  default = "ap-south-1"
}

2. output.tf

output "iam_arn" {
  description = "IAM Policy ARN"
  value       = aws_iam_policy.thumbnail_s3_policy.arn
}

output "function_name" {
  description = "Lambda function name"
  value       = aws_lambda_function.thumbnail_lambda.function_name
}

output "cloud_watch_arn" {
  description = "Cloudwatch ARN"
  value       = aws_cloudwatch_log_group.thumbnail_cloudwatch.arn
}

Now, its time to do the deployment by executing below command:

1. terraform Init => This is where you initialize your code to download the requirements mentioned in your code.

2. terraform fmt => This is used to format the written terraform code.

3.terraform validate => This is to validate the written terraform code.

4.terraform plan => This is where you review changes and choose whether to simply accept them.

5.terraform apply => This is where you accept changes and apply them against real infrastructure.

Verification of S3 Bucket:

Verification of Lambda Creation:

Verification of CloudWatch Creation:

Now uploading one image “sample.jpg” of size 1.1MB into original S3 bucket “alok-original-image-bucket-0007”.

Verifying S3 Bucket for image uploaded:
Original:

Thumbnail

See the image size decreased from 1.1 MB to 20.7 KB.
You can destroy the resources created using “terraform destroy” command but before that you need to clean both the bucket. Otherwise terraform will raise an exception.

One of the best use cases of this project is to use in shortlisting candidate resume for some selected keyword, pick and move that resume to another s3 bucket.

Candidate will upload the resume and it will go into S3 original bucket and Lambda will get trigger after upload and on the basis of some selected keyword it will shortlist the resume and move the selected resume to shortlisted_s3 bucket 😊.

Amazon EKS Clusters Setup – Step by Step Instructions

Alok Kumar — Fri, 02 Dec 2022 06:44:12 +0000

A production-quality Kubernetes cluster requires planning and preparation. If your Kubernetes cluster is to run critical workloads, it must be configured to be resilient.

There are several deployment tools to do the Kubernetes cluster steps:

Bootstrapping clusters with kubeadm
Installing Kubernetes with KOPS
Installing Kubernetes with Kubespray
Turnkey Cloud Solution

We are going to use Turnkey Cloud Solution (Amazon EKS), using EKSCTL utility we are going to manage the production ready cluster.

There are several cloud providers who support creating of Kubernetes cluster setup, this blog concentrates on creating of cluster on amazon EKS.

First, we are going to launch a Linux instance (t2 micro), this instance is used to manage the k8s cluster and give all the necessary instruction to Kubernetes cluster using EKSCTL and KUBECLT utility.

Allow SSH, HTTP and HTTPs traffic to that instance, rest leave as default and launch instance.

SSH to machine using public IPv4 address.

Check the AWS CLI version, using “aws –version” command. Better to refer below link to use the current AWS CLI version:

https://docs.aws.amazon.com/eks/latest/userguide/getting-started-console.html

You can easily upgrade it to the latest by using below command:
For Linux, execute the below command, for other OS refer to below link:

curl "https://awscli.amazonaws.com/awscli-exe-linux-x86_64.zip" -o "awscliv2.zip"
unzip awscliv2.zip
sudo ./aws/install

https://docs.aws.amazon.com/cli/latest/userguide/getting-started-install.html

Above command will download the binaries and install the AWS CLI in your instance or override in case you have the older one.

In case new version does not appear then exit and re-login to machine as demonstrated below:

Now, we are going to install below item as prerequisites:

kubectl
Eksctl
Required IAM Permissions to Instance

You can refer below link for more details:

https://docs.aws.amazon.com/eks/latest/userguide/getting-started-eksctl.html

Kubectl is a command line tool for working with Kubernetes cluster.

For Linux machine, execute the below command, for other OS refer the link below:

curl -o kubectl https://s3.us-west-2.amazonaws.com/amazon-eks/1.24.7/2022-10-31/bin/linux/amd64/kubectl

https://docs.aws.amazon.com/eks/latest/userguide/install-kubectl.html

Now, apply execute permissions to the binary, and copy the binary to a folder in your PATH, you can check the PATH by executing “echo $PATH” as mentioned below:

chmod +x ./kubectl

Check kubectl version …

Now, install eksctl by executing below command for Linux machine, for other OS refer the link below:

curl --silent --location "https://github.com/weaveworks/eksctl/releases/latest/download/eksctl_$(uname -s)_amd64.tar.gz" | tar xz -C /tmp

https://docs.aws.amazon.com/eks/latest/userguide/eksctl.html

Binaries got download into the tmp folder, go to tmp and copy the binary to a folder in your PATH, same as mentioned below.

Now, its time to create an IAM Role with required permissions and attached it to the Linux EC2 Instance.

Eks_role, get created with below permissions attached, I am giving the full access but you can refine the permission related things at your end accordingly.

At backend, EKSCTL utility is using CloudFormation to do all the cluster creation, so EC2 machine must have all the required permission to perform the actions.

Now, assign the role to EC2 Linux instance.

Now, using eksctl utility, we are going to create an EKS Cluster.

This will create a cluster with name “alok-devops” in Mumbai region with 2 worker node of type t2.small.

Please be aware. this not comes into free-tier.

CloudFormation Stacks get created for Kubernetes cluster using eksctl utility. During creation of stack and work efficiently it creates several roles, this is the reason we provided EC2 machine with permission of IAM full access.

Successfully created the EKS cluster with 2 worker node. It take approximately 18 min.

Now, its time to validate the cluster using few Kubernetes command using kubectl utility.

You can view complete setup on my youtube video: