DEV Community: Sumit Mukharjee

What is DevOps?

Sumit Mukharjee — Sun, 13 Feb 2022 14:25:18 +0000

We have been hearing a buzz word DevOps which is gaining popularity in recent times. But what is actually is?

Is DevOps = Development + Operations ? Where do boundaries start and end? Which part of Development is not DevOps? Which part of Operations is not DevOps? Why was there a need for this? Let's see ...

We all know development and operations are the main important things in the whole application release process.
Development -> Operations -> Release

*Initial Software Release Process *

As you see above the whole process includes :

The idea of Application comes up.
Team gathers all the requirement
Developer Team codes the project
Testers test all sorts of test cases.
Then it's built and Deployed, Operated, and monitored.

All future updates and features are monitored and are being pushed.

*After Launch of Application *

Is there any problem with the application?
Are users experiencing any issues?
Can the application handle higher user loads?

Based on the above questions all sorts of new features are added, bugs are fixed and performance is optimized.
And the big part of this is that whenever new changes or fixes are made, it has to be accessible to the user immediately.

This process gives us a new term the Software Versioning which gives an endless cycle of improvements and continuous delivery of applications. And DevOps is making this process :

Fast
Bug-free**** or minimal errors. With DevOps improvements are delivered to users fast and they are of high quality and well-tested.

*Challenges that DevOps tries to solve *

Miss communication and lack of collaboration

Developers code the app but can't deploy and run the app whereas Operations deploy and operate the app but don't know how it works.
Developers don't consider where the app gets deployed.
Deployment guides are not well documented, so release takes longer. These stretches release period for weeks, days, or even months.

*Conflicts of Interest *

Developers want new features fast while Operations wants to maintain stability.

Security

Developers code it, test it, and build it.
Operations care about the system's stability and security.

Application testing

Testing specific features.
End to end tests.
Testing on different environments.
Performance tests.

These tests are often done manually and it takes a lot of resources and time but also we can't rely on fully automated tests.

How DevOps can be used as a solution?

First, let's see some info about DevOps,
DevOps is a combination of cultural philosophy, practices, and loads.

Anything that creates the process of releasing the software fast and with high quality.
Main part was that dev and ops should work together and more often.

How DevOps can be seen as a separate role ?

Previously, companies adopted different methods but gradually as it became more common they have now more common practices like -

*1. Planning and Collaboration.
*
**

Source code management and Package management.** **
CI/CD** 4. Infrastructure as A code(IAAC). **
Container Orchestration** 6. Cloud 7. Continuous Monitoring With these, DevOps evolved as separate roles as either developer doing DevOps or operations doing DevOps or someone is doing DevOps exclusively.

*CI/CD Pipeline
*

This picture describes DevOps. Or A CI/CD pipeline is a series of steps that must be performed in order to deliver a new version of the software. Continuous integration/continuous delivery (CI/CD) pipelines are a practice focused on improving software delivery using either a DevOps or site reliability engineering (SRE) approach.

Tools and concepts to know while learning DevOps

Concepts of Software Development (Development)

How developers work.
Git Workflow.
How the application is Configured.
Automated Testing.

OS and Linux Basics (Operations)

Preparing infrastructure to run applications.
CLI comfort.
Shell Commands.
Linux file systems.
Server Management Basics.
SSH keys.

Networking and Security

Firewall proxy servers.
Load Balancers.
HTTP/S.
DNS, IP, etc.

Containers

Virtualization.
Able to work with containerized applications ex - Docker.

Understand Packaging

Cloud Providers

AWS or Azure or GC
only learn services you need.

Container Orchestration

Kubernetes - deploy manage.

Monitoring

Monitor software.
Monitor infrastructure.
Ex - Prometheus or Nagios

IAAC

Terraform.
Ansible.

Scripting Language

Go, python or ruby.

You may be overwhelmed by thinking about why this many tools and concepts but Learn only one and most popular tools in each category and learn only those services which are needed.
You can see the reference image below -

Thanks for Reading!!

Introduction to Linux Commands

Sumit Mukharjee — Fri, 04 Feb 2022 05:09:37 +0000

I am learning DevOps for a while and I will be writing about everything I learn, which will eventually be beneficial for the community and aspiring DevOps learners.
I previously wrote about YAML which is very important for the DevOps journey have a look here.

Prerequisite

*1. A Linux terminal *
2. Enthusiasm for learning

For setting up Ubuntu in windows terminal head over to this article officially by Ubuntu.

Okk...Let's start with shell, this is the place where we write our commands but what it is??
A shell is a command-line interface that will take all our command as input, interprets them, and converts them into useful things.

For some commands I have not included screenshot as they have to done by self.

Here's an image of what shell looks like.

Shells are of many types like Bourne shell,c-shell,z-shell, etc but here we won't discuss that as it is a very different topic, but as always you can head over here to know about it.

Let's deep dive with the commands -

$ clear

``` - Clears the shell.

$ ls
- This command lists all files and folders in the current directory.

$ mkdir

``` - Makes new folder

$ cd - This one changes the directory if we write ```

cd ..

``` then this takes us one folder back.

$ whereis - This gives the exact directory of any file.
$ xdg-open - Opens particular directory.
$ ls -a - Shows hidden files and folders.

$ pwd - This prints the current working directory.

. -> current directory
.. -> previous directory

$ ls -l - Gives more arguments like writable, readable, and executable state of the file, permission, and stuff.

$ ls -R - Lists all-recursive folder i.e folder inside folder .... and so on
$ cat - This outputs the content of a file.

If there is no file then $ cat > hello.txt can be used to make a file and give inputs to it.

Also $ cat file.txt hello.txt > sumit.txt can be used to replace the content of sumit.txt with the other two.
$ echo "Hello World" > file.txt this replaces all content of file.txt with Hello-World.

$ man - This command gives information about a particular command. If you specify $ man sudo in the terminal you will get something like this 👇

$ touch - touch command create a new file.

$ touch new.txt

$ cp - copy contents of one file to another.

cp file.txt newFile.txt

$ mv - this can rename as well as move a file.

mv fike.txt newName.txt (This renames)

mv file.txt usr/local/bin (This copies)

$ rm - Remove a file

rm file.txt

$ rmdir - Removes a directory only if it is empty.

$ rmdir

$ sudo - This command gives administrative privileges, if you are a Linux user you may be fully aware of it.
$ df - gives a capacity of the disk.

df -m (Size in Megabytes)

df -k (Size in Kilobytes)

df -h (In human-readable form)

$ du - This gives disk usage statistics.

du -l

du -h (In human-readable form)

$ head - Used to vies first few lines of any file, by default, it's 10.

As you can see after using the head command it's only showing 10 lines.
$ tail command shows the last few lines.

$ diff - This differentiate content of a file.
$ locate ** - This locates any file. **$ locate ".txt" this will locate all the files which have .txt extension.
$ whoami - Displays username.

*File Permissions - * There are 3 file permissions Read, Write and Execute

$ chmod is the command to change file permissions.

*Performing action on multiple files *

If you wanna let's say remove multiple files at once then use:-

$ find . -type f -name "*.txt" -exec rm -rf {} +

basically {} is the placeholder and rm shows that remove these.

$ grep - Global regular expression print, grep allows to look for particular text in the file. GREP is case-sensitive. I have made a text file that contains names of different random people and applied the following commands 👇


$ grep "Kunal" names.txt


$ grep -w "Kunal" names.txt


``` (Shows complete word)

$ grep -i "kunal" names.txt

``` (shows case sensitive names too)


$ grep -iw "kunal" names.txt


``` (shows case sensitive names with word specified)

![Screenshot (15).png](https://cdn.hashnode.com/res/hashnode/image/upload/v1643281349556/Rz4x2zYHC.png)

$ grep -n "Kunal" names.txt

``` (Shows line number)


$ grep -win "Rahul" names.txt


``` (Combined with the word, case sensitive, and line number)

$ grep -b 3 "Rahul" ./.*txt"

``` (WIll search for Rahul in all txt files)


$ grep -rwin "Rahul" ./.*txt

``` (Will search recursively in all directories)


![Screenshot (16).png](https://cdn.hashnode.com/res/hashnode/image/upload/v1643281962227/9b3S-V2b_.png)

**Terminal Shortcuts** - 


1. *Ctrl + A* - Moves the cursor to begin.
2. *Ctrl + E* - Moves the cursor to end.
3 *Ctrl + U* - Removes Everything written.
4. *Ctrl + K* - Removes a word after the cursor.
5. *Up and Down Keys* - Previous commands.
6. *$ !<Previous_Command>* - With ! sign it will run the previous command.
7.  *$ command_1;command_2;command_3* - Multiple commands with semi-colon.
8. *$ sort names.txt* - will sort in Ascending order.
9. *$ sort -r names.txt* - will sort all the names in reverse order.
10. *$  jobs* - displays current job.
11. *$ ping <url>* - Check your server.
12. *$ wget <URL>* - Download file.
13. *$ top* - shows all the running processes.
14 . *$ kill <process_id>* - Kills the running process.
15. *$ zip file_name.zip file_to_be_zipped* - Zips the file

if this doesn't work then use   ```

 $ sudo apt install zip

 ``` (installs package). Multiple files can be zipped.

16. *$ unzip file_name.zip* - Unzipes the file
17. *$ hostname* - Displays hostname.
18. *$ hostname -i* - Displays IP too
19. *$ uname* - Gives OS name
20. *$ uname -m* - Gives Architecture of os.
20. *$ uname -r* - Gives Kernal version.
21. *$ cat /etc/os-release* - Gives Operating System Info.
22. *$ free -h* - Displays free memory.


**Networking Commands - **

 - ```

$ nslookup google.com

``` - Gives IP address of the particular site, here google.com .

- ```

$ netstat

``` - Looks all active stat.

**Some more useful commands - **

- ```

$ cut -c 1-2 names.txt

``` - Gives names after cutting two letters and we can specify the condition as we need.


![Screenshot (18).png](https://cdn.hashnode.com/res/hashnode/image/upload/v1643290282731/n5NuTAjSh.png)

- ```

$ ps aux

Gives all the processes and it'd ids.

So this was it from my side and there are tons of commands but you will get everything while learning. Things will come naturally.

If you have read till here..then thanks.
Keep Learning😊😊

YAML DataTypes and Real-World Examples

Sumit Mukharjee — Tue, 25 Jan 2022 18:50:48 +0000

This is the continuation of the YAML introduction head over here for part 1.
So let's continue with the remaining portion of YAML.
Key Datatype

Key-Value pairs

"apple" : "I am a red fruit"
1 : "This is a roll number"

List Datatype

- apple
- mango
- banannananna

Block Style

cities:
 - new delhi
 - mumbai
 - ahmedabad

YAML Parsers can be used to check if YAML is valid or not.
One such website is YAMLLINT.
Differentiating Between Documents

cities:
 - new delhi
 - mumbai
 - ahmedabad
 ---
 cities: [new Delhi, mumbai]
 ---
 {mango: "fruit", age:5}
 ...

--- is used to differentiate the type of document.
... is used to define that document is finished now.

JSON Files
Onlineyamltools is a website for conversion and stuff for YAML files.

YAML FILE 👇

cities:
 - new delhi
 - mumbai
 - ahmedabad

converted to JSON 👇

{
  "cities": [
    "new delhi",
    "mumbai",
    "ahmedabad"
  ]
}

Flow Type

 cities: [new Delhi, mumbai]

This doesn't give an indentation error

Comments
YAML doesn't support multiline comments, we have to use the # sign

# Mango
# Apple
# Grapes

String Variables

name: Sumit Mukharjee
fruit: "Apple"
job: 'swe'
message: !!str Hello There

Write a single line in multiple lines

message: >
this will
all be 
in one single line

same as This will all be in one single line

YAML auto detects data type

Specifying the data types

zero: !!int 0
positiveNum: !!int 45
negativeNum: !!int -45
binaryNum: !!int 0b11001
octalNum: !!int 06574
hexNum: !!int 0x45
commaValue: !!+540_000 # 540,000
exponentialNumbers: 6.023E56

Float Value:

marks: !!float 56.89
infinity: !!float .inf
noANumber: .nan

Boolean Value

booleanValues: !!bool No

Null Value

surname: !!null Null
~: this is a null key

DateTime in YAML

date: !!timestamp 2022-01-25
india time: 2001-12-15T02:59:43.10 +5:30
no time zone: 2001-12-15T02:59:43.10

Advanced-Data Type

When some of the sequences will be empty they are known as a sparse sequence.

```sparse seq:

hey
how
Null
sup ```

Nested Sequence
sequence inside sequence

 - marks
 - name
 - roll_no
- 
 - simplemarks
 - avgMarks

Maps DataType
key:value pairs are called map datatype
Nested Maps

```name: Sumit Mukharjee
role:
age: 78
job: student




**Pairs Datatype**
Sometimes one key may require duplicate values




```pair examples: !!pairs
 - job: student
 - job: teacher

Real World Example

Storing Above data in XML

<?xml version="1.0" encoding="UTF-8">
<School name="DPS" principal="Someone">
  <Students>
     <Student>
          <rno>23</rno>
          <name>"Sumit"</name>
          <marks>94</marks>
        </Student>
   </Students>
</School>

** In JSON**

{
    "School": [
        {
            "name": "DPS",
            "principal": "Someone",
            "Students": [
                {
                    "rno": 12,
                    "name": "Sumit Mukharjee",
                    "marks": 67
                }
            ]
        }
    ]
}

In YAML

  - name: DPS
    principal: Someone
    Students:
      - rno: 12
        name: Sumit Mukharjee
        marks: 67

This was it. Thanks for reading😊.

Introduction to YAML

Sumit Mukharjee — Tue, 25 Jan 2022 18:13:55 +0000

Let's start getting info about YAML by firstly knowing its full form.
YAML stands for YAML ain't markup language.
What is YAML?

YAML is actually a data format used to exchange data.
It is similar to XML and JSON data-type.
So, YAML is a simple human-readable language that can be used to represent data.
In YAML you can store only data and not commands, unlike other programming languages. Data Serialization and Deserialization Serialization - ** This is actually the process of converting the data objects into complex data structures or streams of bytes. Basically, data objects present in complex data structure into the stream of storage that can be used to transfer data in your physical device. The below image can be helpful to understand this concept: 👇 The above thing happens on JSON too in which we call **API which gets converted to JSON DATA which is more human-readable. The above image shows how the Serialization process stores data.
Objects are basically, code together with some data.
Data Objects are converted into a series of bytes which saves the state of an object in a form that is easily transmittable This is known as Serialization. Fields like Big Data, Machine Learning, DevOps, etc. uses this concept Serialization Languages: ** JSON,XML and YAML *De-serialization- * The file which was converted during serialization can be converted back to an object is Deserialization. **Object - > File (Serialization) File - > Object (Deserialization) See how simple could it be😊. Types of Objects YAML stores-
Configuration Files of any tools or whatever, some are Kubernetes Config File, Flutter Pubspec YAML file, Docker, etc.
Log files, caches, etc. Benefits of YAML
Simple and Easy to read.
It has a strict syntax(Mistakes aren't allowed like indentation).
Easily convertible to JSON, XML.
Most languages use YAML.
More powerful while representing complex data
Various tools are available like parsers.
Parsing is easy.

This was it for now, for the next and last article about YAML and it's datatypes click here.
Also available in Hashnode here

Go Introduction #1

Sumit Mukharjee — Sun, 26 Dec 2021 08:14:49 +0000

Introduction :

Go is the language made at Google by Robert Griesemer, Rob Pike, and Ken Thompson in 2007, which was open-sourced in 2009.
Go is statically-typed which means variables are declared explicitly and determined at runtime.

Why another programming language?

Whenever we learn any programming language the first question obviously comes to the mind why learn a different language when there are many others.
So the answers may be the following:-

Infrastructure changed a lot.
Multicore processors were included everywhere.
Cloud infrastructure became common.
Big Network Computation Clusters became universal.

However, existing languages were not able to take full advantage of it.
Here comes the use of the Go programming language which had Multicore concurrency support.
This support is on C++ and Java but they have complex code and are slow.

Go was designed to run on multiple cores and built to support concurrency(Dealing with lots of things at once).
Concurrency in Go is cheap and easy.

Use cases of GO

Writing applications that need to be very quick
Application that will run on modern, scaled, and distributed infrastructure with hundreds of thousands of servers typically on a cloud platform.

Go is used in server-side backend applications, these can be:

Microservices
Web-Applications
Data-Base services It is interesting to know that many cloud clusters are already written in Go. Docker, Kubernetes, and Cockroach Db are written in Go.

Go characteristics

Simple and Readable - Has syntax of dynamically typed language like Python
Efficiency and Safety - of lower-lever, statically-typed language like C++

Advantages

Simple syntax which makes it easy to learn and write code.
Fast in building time, startup, and running.
Requires fewer resources.
Easy to maintain.

Compiled Type Language-
Go compiles into single binary code(machine code) which can be run on any system unlike Python.
This was the end of 1st part in Go series more will be coming.
It's also available in my hashnode page here

BASICALLY simplicity + speed= GO........

Functional vs Class Component in React.js

Sumit Mukharjee — Sat, 04 Dec 2021 16:13:53 +0000

Components are the most important part of React, it let's us to write code in different piece and split in independent states.
It literally is a function which "returns something" like in JavaScript Functions. You write something you get that thing.

1.Functional Components

Way to define a functional component which accepts a prop can be :
function Welcome(props) { return <h1>Hello, {props.name}</h1>; }

Here input can be props and output can be JSX, very straight forward right??.
Functional components don't support State until React Hooks came into existence

2.Class Based Components

With react ES7 Snippet installed type rcc it's gonna give react class component :
class Welcome extends React.Component { render() { return <h1>Hello, {this.props.name}</h1>; } }

In class based function we have to first use render() then return something (whereas in functional components directly return something). A bunch of things can be written under render that comes under state and lifecycle topic, to know refer here.

That's all from my side, I will write next article continuing Components and how to use them with State and Props which are building blocks to learn and master React.

If there is anything I can add please let me know😊.

Things to get started as a Web Developer quickly.

Sumit Mukharjee — Thu, 02 Dec 2021 05:07:19 +0000

Woo.. you are in that part of your life when you want to start learning something new, something that excites you well you are on a good path in your life.
Today we look at how you can get yourself in the Computer Science world and be a web developer. We will be looking at quick steps without wasting any time, so let’s get started.

1. Learn HTML
The basic part of every web page. HyperText Markup Language defines the structure of the web page just like a skeleton in the human body, without this no one can imagine a page.

2. CSS
When you have a nice body you have to make yourself look good, just like that, a website needs styling to make it catchy to the user so that they come back again and again. UI is the most important part of any project, making it look cool makes you cool.

3. JavaScript
A webpage has to function for which it has been made, you have seen when you click on Google’s search button it redirects to another page and shows you some results, when you click login on your Instagram account it opens your feed. In this situation, JavaScript comes into play where you add functionality to your pages.

4. Projects
Stop right here, these were the basics of web development, now It’s time for you to make some projects by using these three. Make your simple clone projects or whatever you like, remember to get a good grasp on JavaScript and CSS.

Further
Later things you can learn are Create pages with API, then you can go further to learn React.JS, A database of your choice, and Node.JS which is very important to create a full-fledged awesome Website.
Thanks for reading, this was the first article I have written. If there’s a mistake please correct me I will surely improve in the future.