DEV Community: luismanuu

DevOps Project Part 1: 3-tier Web Application

luismanuu — Wed, 24 May 2023 19:48:55 +0000

As promised, the next posts will be about a DevOps project that covers various aspects. From setting up a website architecture manually to incorporating DevOps tools, and eventually exploring cloud containers and infrastructure as code. It's an exciting opportunity for me to gain practical experience in building resilient and scalable systems. I look forward to sharing my progress and insights with you as I continue this journey.

Overview

Our solution comprises several key components:

Infrastructure: AWS
Webserver: Red Hat Enterprise Linux 8
Database Server: Ubuntu 20.04 with MySQL
Storage Server: Red Hat Enterprise Linux 8 with NFS
Programming Language: PHP
Code Repository: GitHub

To visualize the architecture, we follow a common pattern where multiple stateless web servers share a centralized database, and they access shared files through the Network File System (NFS). This setup allows our web servers to seamlessly serve the same files, as if they were locally stored, providing efficient and reliable file access across the infrastructure.

Follow the steps provided on documentation to implement this architecture on AWS:

luismanuu / DevOps-3TierWebApp

3 Tier Web Application DevOpsPBL

DevOps-3TierWebApp

DevOps PBL

Implement a solution that consists of following components:

1.Infrastructure: AWS

2.Webserver Linux: Red Hat Enterprise Linux 8

3.Database Server: Ubuntu 20.04 + MySQL

4.Storage Server: Red Hat Enterprise Linux 8 + NFS Server

5.Programming Language: PHP

6.Code Repository: GitHub

View on GitHub

Important: Do not forget to STOP your EC2 instances after completion of the project to avoid extra costs. Also keep in mind instance DNS change after turning off.

Lessons learned (In my case):

-Understanding basic of AWS networking (subnets, private ips, Security groups inbound/outbound)

Creating partitions using **gdisk **utility.
Managing physical, logical and group volumes with pvcreate, vgcreate, lvcreate utilities.
Format logical volumes with **mkfs **utility.
Mount logical volumes in NFS server with mount *utility and make them persist by modifying */etc/fstab
Mount in web server directory and target to NFS server’s using mount utility
Installing and configuring a NFS server with nfs-utils

Next steps:

Adding Load Balancer
Implementing Jenkins as DevOps tool

Learning fundamentals

luismanuu — Fri, 19 May 2023 01:07:02 +0000

Hello!

Journey continues and I've been diving into research of essential topics, from software theory to networking intricacies. Alongside, I've discovered practical websites that can be valuable resources for those seeking additional assistance. Last but not less important, I have been practicing on some small tutorials to learn more about the tech stacks that we talk about in last post.

Important topics to research

Software Development Life Cycle (SDLC): The Software Development Life Cycle (SDLC) is a systematic approach to software development that ensures the delivery of high-quality software products. It consists of a series of well-defined phases, including requirements gathering, system design, implementation, testing, deployment, and maintenance. Each phase has its specific goals and activities, and following the SDLC helps teams maintain a structured and efficient development process. By adhering to the SDLC, organizations can ensure that software projects are completed on time, within budget, and meet the specified requirements.

'chmod' and 'chown' Commands in Linux: In Linux, 'chmod' and 'chown' are commands used to manage access rights and ownership of files and directories. 'chmod' (short for "change mode") allows you to modify the permissions granted to users, groups, and others on a file or directory. It controls who can read, write, and execute the file. +'chown' (short for "change owner") enables you to change the ownership of a file or directory, allowing you to transfer ownership between users or groups. Understanding and properly utilizing these commands is essential for managing file permissions and ensuring data security and access control in a Linux environment.

TCP and UDP Protocols and Commonly Used Ports: TCP (Transmission Control Protocol) and UDP (User Datagram Protocol) are two core protocols used in computer networks for transmitting data over the Internet. TCP is a reliable, connection-oriented protocol that guarantees the delivery of data packets in the order they were sent. UDP, on the other hand, is a connectionless protocol that offers faster transmission but does not guarantee the order or reliability of data delivery.

Database Management Systems: Can be categorized into Relational DBMS and NoSQL DBMS. Relational DBMS, such as MySQL and PostgreSQL, organize structured data into predefined schemas and employ SQL. They excel in maintaining data integrity and are suitable for complex transactions. NoSQL DBMS, like MongoDB and Cassandra, handle unstructured and rapidly changing data with flexible schema options. They prioritize scalability and high-performance retrieval. The key difference lies in the data models and trade-offs. Relational DBMS suit structured data and complex relationships, while NoSQL DBMS are ideal for unstructured data and scalability. The choice depends on factors like data nature, relationships, performance, and scalability needs.

Web Application Frameworks: Are software frameworks that simplify the development of web applications. They provide tools, libraries, and components for building efficient and structured web applications. There are two main types of web application frameworks: server-side (backend) frameworks and client-side (frontend) frameworks. Server-side frameworks, like Django, Ruby on Rails, and Express.js, handle the server-side logic of web applications. They manage routing, database integration, session management, authentication, and data processing. These frameworks generate HTML and deliver it to the client browser. Client-side frameworks, such as React, Angular, Vue.js, and Ember.js, focus on enhancing the user interface and user experience of web applications. They run in the browser and enable dynamic interactions without page reloads. These frameworks handle DOM manipulation, data binding, component management, and state management, facilitating the creation of responsive and interactive user interfaces.

RESTful API: Is a widely used concept in web development that enables different applications to communicate and exchange data. It follows a client-server architecture and utilizes standard HTTP methods to perform operations on resources. RESTful APIs promote scalability, modularity, and interoperability, making them essential for building and integrating web applications.

The OSI (Open Systems Interconnection) model: Is a conceptual framework consisting of seven layers that define how computer systems should communicate with each other. Each layer has a specific role in the communication process. Starting from the physical layer, which deals with the transmission of signals, the data link layer ensures reliable transmission between adjacent nodes. The network layer manages routing and addressing across multiple networks, while the transport layer ensures error-free delivery of data. Above that, the session layer establishes and manages connections, while the presentation layer handles data formatting and encryption. Finally, the application layer provides services and interfaces for end-user applications.

Load balancing: Is a technique used to distribute incoming network traffic across multiple servers or resources. It helps optimize resource utilization, improve performance, and ensure high availability of services. There are various load balancing techniques such as round robin, least connections, IP hash, weighted round robin, and least response time. Load balancing can be implemented using hardware or software-based solutions and plays a vital role in optimizing performance and scalability while maintaining reliability.

DevOps Tooling Solution: Jenkins – free and open source automation server used to build CI/CD pipelines. Kubernetes – an open-source container-orchestration system for automating computer application deployment, scaling, and management. Jfrog Artifactory – Universal Repository Manager supporting all major packaging formats, build tools and CI servers. Artifactory. Rancher – an open source software platform that enables organizations to run and manage Docker and Kubernetes in production. Grafana – a multi-platform open source analytics and interactive visualization web application. Prometheus – An open-source monitoring system with a dimensional data model, flexible query language, efficient time series database and modern alerting approach. Kibana – Kibana is a free and open user interface that lets you visualize your Elasticsearch data and navigate the Elastic Stack.

Useful websites for learning:

Hands on!

I have also documented some basic implementations of tech stack just to get used to the tools:

Coming next

In a series of posts, I will implement a completely real-world architecture consisting of the following:

Infrastructure: AWS
Webserver Linux: Red Hat Enterprise Linux 8
Database Server: Ubuntu 20.04 + MySQL
Storage Server: Red Hat Enterprise Linux 8 + NFS Server
Programming Language: PHP
Code Repository: GitHub
Load Balancing
DevOps Tool

First steps

luismanuu — Sat, 13 May 2023 18:01:01 +0000

I'm excited to take you along the first steps of my journey. I'll be diving into PBL (Project-Based Learning) projects focused on web stacks and Linux administration.

As a software engineer, I've come to understand that most of what I'll be working on revolves around software, websites, applications, and other tech-related solutions. To achieve this, there are various stacks of technologies that work together seamlessly, and these are commonly referred to as technology stacks. I'll need to understand and implement all of these as I progress in my journey.

In particular, I'll be checking the following tech stacks:

LAMP (Linux, Apache, MySQL, PHP or Python, or Perl)
LEMP (Linux, Nginx, MySQL, PHP or Python, or Perl)
MERN (MongoDB, ExpressJS, ReactJS, NodeJS)
MEAN (MongoDB, ExpressJS, AngularJS, NodeJS).

While I already have some knowledge of Python and Linux, I'll also be sharing documentation and resources for beginners. For example, if you're new to these topics, I highly recommend checking out these free video tutorials:

Python Tutorial for Beginners - Learn Python in 5 Hours FULL COURSE - FREE

The Complete Linux Course: Beginner to Power User! - FREE

In the upcoming posts, I'll be documenting my experience with implementing these tech stack projects. I hope that my future posts will serve as helpful tutorials for those looking to expand their skills.

Thanks for reading and stay tuned for more updates!

Building a Bridge to DevOps: My Journey to Becoming a Versatile Engineer

luismanuu — Sat, 13 May 2023 02:01:58 +0000

Hi, I'm Luis!

As a software engineer primarily focused on Quality Assurance, I've discovered a deep interest in the intersection of software development and IT operations, and now one of my main goals is to learn as much as possible in my free time.

Over the years, I've gained expertise in several programming languages like Python, C#, Java, and JavaScript. I've also worked with various QA testing tools such as Cypress, Selenium, Appium, JMeter, and K6. In addition to testing, I've had the chance to work with Linux and cloud platforms like AWS. These experiences have sparked my interest in DevOps, and I'm now actively pursuing opportunities to learn more about this exciting field.

To achieve my goal, I'm following a learning roadmap that covers everything from foundational concepts to advanced techniques like containerization, continuous integration, and deployment. As I progress along this path, I plan to document my learnings and insights in this blog.

DevOps Roadmap: Learn to become a DevOps Engineer or SRE

Community driven, articles, resources, guides, interview questions, quizzes for DevOps. Learn to become a modern DevOps engineer by following the steps, skills, resources and guides listed in this roadmap.

roadmap.sh

Thanks for joining me on this journey! I'm excited to share my experiences and learnings with you, and I hope you find them helpful in your own DevOps endeavors.