<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Marvellous D. Amos</title>
    <description>The latest articles on DEV Community by Marvellous D. Amos (@marvel_at_don).</description>
    <link>https://dev.to/marvel_at_don</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F897266%2F4ec17fd5-ab08-425a-aebe-97914ad728e7.jpg</url>
      <title>DEV Community: Marvellous D. Amos</title>
      <link>https://dev.to/marvel_at_don</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/marvel_at_don"/>
    <language>en</language>
    <item>
      <title>Getting Started With React</title>
      <dc:creator>Marvellous D. Amos</dc:creator>
      <pubDate>Thu, 23 Feb 2023 18:20:06 +0000</pubDate>
      <link>https://dev.to/marvel_at_don/getting-started-with-react-j5a</link>
      <guid>https://dev.to/marvel_at_don/getting-started-with-react-j5a</guid>
      <description>&lt;h2&gt;
  
  
  Introduction
&lt;/h2&gt;

&lt;p&gt;This article intends to provide you with all you need to know to get started with React. Here, you will understand the power of a front-end framework, and the concepts needed to assist you to begin building scalable applications with React.&lt;/p&gt;

&lt;h2&gt;
  
  
  What is React
&lt;/h2&gt;

&lt;p&gt;React is a JavaScript &lt;em&gt;library&lt;/em&gt; for building user interfaces.&lt;/p&gt;

&lt;p&gt;It is popular for being declarative, efficient, and flexible. It lets you build complex user interfaces from small, isolated code called &lt;strong&gt;components&lt;/strong&gt;.&lt;/p&gt;

&lt;h2&gt;
  
  
  Why React
&lt;/h2&gt;

&lt;p&gt;The &lt;a href="https://survey.stackoverflow.co/2022/#section-most-popular-technologies-web-frameworks-and-technologies" rel="noopener noreferrer"&gt;2022 Stack Overflow Developer Survey&lt;/a&gt; shows React to be one of the most effective and popular web frontend frameworks.&lt;br&gt;
This is a result of the following React features:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Declarative:&lt;/strong&gt; React allows you to define the final state of your desired user interface.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Component reusability:&lt;/strong&gt; React allows you, as a developer, to create components only once and reuse them throughout your application. This reduces code duplication and shortens the development process guaranteeing uniformity across the entire application.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;SEO friendly:&lt;/strong&gt; React has a positive impact on SEO (Search Engine Optimization) since it creates SPAs (Single Page Applications) that need JavaScript to display content so that it gets rendered.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Open-source support:&lt;/strong&gt; due to its popularity, React is well supported and maintained by the open-source community.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Design flexibility:&lt;/strong&gt; React is not opinionated, so it won't compel you to adhere to any particular design patterns, project organizational framework, or logical reasoning. Everything of it is up to you.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Smaller learning curve:&lt;/strong&gt; Compared to other Frontend libraries and frameworks, React is easier to learn, especially when familiar with JavaScript and HTML fundamentals.&lt;/p&gt;&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Getting started
&lt;/h2&gt;

&lt;p&gt;To get started with React, you need to understand one of the major pillars of React, &lt;strong&gt;Components&lt;/strong&gt;.&lt;/p&gt;

&lt;h3&gt;
  
  
  Components
&lt;/h3&gt;

&lt;p&gt;React makes use of reusable components in building its applications. A simple React application is divided into several independent and reusable pieces.&lt;/p&gt;

&lt;p&gt;React provides two types of components:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Function components:&lt;/strong&gt; Components defined using JavaScript functions
&lt;/li&gt;
&lt;/ul&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight jsx"&gt;&lt;code&gt;
&lt;span class="kd"&gt;function&lt;/span&gt; &lt;span class="nf"&gt;App&lt;/span&gt;&lt;span class="p"&gt;()&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;
   &lt;span class="k"&gt;return&lt;/span&gt; &lt;span class="p"&gt;&amp;lt;&lt;/span&gt;&lt;span class="nt"&gt;div&lt;/span&gt; &lt;span class="na"&gt;className&lt;/span&gt;&lt;span class="p"&gt;=&lt;/span&gt;&lt;span class="s"&gt;"App"&lt;/span&gt;&lt;span class="p"&gt;&amp;gt;&lt;/span&gt;Hello World!&lt;span class="p"&gt;&amp;lt;/&lt;/span&gt;&lt;span class="nt"&gt;div&lt;/span&gt;&lt;span class="p"&gt;&amp;gt;;&lt;/span&gt;
&lt;span class="p"&gt;}&lt;/span&gt;

&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Class components:&lt;/strong&gt; Components defined using JavaScript classes
&lt;/li&gt;
&lt;/ul&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight jsx"&gt;&lt;code&gt;
&lt;span class="kd"&gt;class&lt;/span&gt; &lt;span class="nc"&gt;App&lt;/span&gt; &lt;span class="kd"&gt;extends&lt;/span&gt; &lt;span class="nc"&gt;Component&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;
   &lt;span class="nf"&gt;constructor&lt;/span&gt;&lt;span class="p"&gt;()&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;
       &lt;span class="k"&gt;super&lt;/span&gt;&lt;span class="p"&gt;()&lt;/span&gt;
   &lt;span class="p"&gt;}&lt;/span&gt;

   &lt;span class="nf"&gt;render&lt;/span&gt;&lt;span class="p"&gt;()&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;
       &lt;span class="k"&gt;return &lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;
           &lt;span class="p"&gt;&amp;lt;&lt;/span&gt;&lt;span class="nt"&gt;div&lt;/span&gt; &lt;span class="na"&gt;className&lt;/span&gt;&lt;span class="p"&gt;=&lt;/span&gt;&lt;span class="s"&gt;"App"&lt;/span&gt;&lt;span class="p"&gt;&amp;gt;&lt;/span&gt;
               Hello World!
           &lt;span class="p"&gt;&amp;lt;/&lt;/span&gt;&lt;span class="nt"&gt;div&lt;/span&gt;&lt;span class="p"&gt;&amp;gt;&lt;/span&gt;
       &lt;span class="p"&gt;)&lt;/span&gt;
   &lt;span class="p"&gt;}&lt;/span&gt;
&lt;span class="p"&gt;}&lt;/span&gt;

&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;blockquote&gt;
&lt;p&gt;Read &lt;a href="https://dev.to/colocodes/react-class-components-vs-function-components-23m6"&gt;this&lt;/a&gt; article for more about React Components&lt;/p&gt;
&lt;/blockquote&gt;

&lt;p&gt;Now, let's get to a more practical approach to learning React.&lt;/p&gt;

&lt;h3&gt;
  
  
  &lt;strong&gt;Installation&lt;/strong&gt;
&lt;/h3&gt;

&lt;p&gt;&lt;code&gt;create-react-app&lt;/code&gt; is the official way to create single-page applications with React.&lt;/p&gt;

&lt;p&gt;To create a React application,&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Run the command below on a terminal.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;code&gt;npx create-react-app my-first-react-app&lt;/code&gt;&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fj9h6jcx2301u6r5oe46a.jpg" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fj9h6jcx2301u6r5oe46a.jpg" alt="Application installed" width="601" height="150"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;The above signifies that the application has been created successfully under the directory &lt;strong&gt;my-first-react-app&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Navigate into the applications directory using the command below.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;code&gt;cd my-first-react-app&lt;/code&gt;&lt;/p&gt;

&lt;p&gt;The directory looks like this:&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fy71ofn3n9h8odgmen7sa.jpg" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fy71ofn3n9h8odgmen7sa.jpg" alt="app directory structure" width="212" height="187"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;Let's discuss each folder in detail:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;node_modules:&lt;/strong&gt; This folder contains all installed dependencies and packages the React application needs. In essence, the packages you wish to import into your application are stored here.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;&lt;strong&gt;public:&lt;/strong&gt; This folder contains a variety of files but the major ones to consider are the &lt;code&gt;index.html&lt;/code&gt; and the &lt;code&gt;manifest.json&lt;/code&gt; files. Here,&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;the &lt;code&gt;index.html&lt;/code&gt; file serves as a template for generating the main file which gets rendered on the browser.&lt;/li&gt;
&lt;li&gt;the &lt;code&gt;manifest.json&lt;/code&gt; file contains metadata which determines the icons, names and branding colours to use when a user adds the applications to their home screen.&lt;/li&gt;
&lt;/ul&gt;


&lt;/li&gt;

&lt;/ul&gt;

&lt;p&gt;Visit this &lt;a href="https://developers.google.com/web/fundamentals/engage-and-retain/web-app-manifest/" rel="noopener noreferrer"&gt;web app manifest guide&lt;/a&gt; to get a better understanding of how this file affects the user experience.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;p&gt;&lt;strong&gt;src:&lt;/strong&gt; This folder serves as the heart of the application's interface, containing all major components and styles created to run the application. It includes major components like:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;code&gt;index.js&lt;/code&gt;, which serves as the entry point to the React application. It contains some syntax including the &lt;code&gt;&amp;lt;App&amp;gt;&lt;/code&gt; component as a React element and the DOM element, &lt;code&gt;root&lt;/code&gt;, as the supplied container.
This &lt;code&gt;root&lt;/code&gt; DOM element is referenced from the &lt;code&gt;index.html&lt;/code&gt;.&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;App.js&lt;/code&gt; which serves as the root component of the application. A typical React application structure would be to build React components and use this &lt;code&gt;App&lt;/code&gt; component as a host to render them to the browser.&lt;/li&gt;
&lt;/ul&gt;


&lt;/li&gt;

&lt;li&gt;&lt;p&gt;&lt;strong&gt;package.json&lt;/strong&gt; This file includes a list of the packages your project can use and the versions of those packages on which it depends. Together with the package-lock.json, it makes your build repeatable and simpler to share with other developers.&lt;/p&gt;&lt;/li&gt;

&lt;/ul&gt;

&lt;h2&gt;
  
  
  Run The Application
&lt;/h2&gt;

&lt;p&gt;To run your application&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Ensure you are in the application's directory in your terminal&lt;/li&gt;
&lt;/ul&gt;

&lt;blockquote&gt;
&lt;p&gt;That is &lt;code&gt;C:\users\...\my-first-react-app&amp;gt;&lt;/code&gt;&lt;/p&gt;
&lt;/blockquote&gt;

&lt;ul&gt;
&lt;li&gt;&lt;p&gt;Run the command &lt;code&gt;npm start&lt;/code&gt;&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;Open the &lt;code&gt;http://localhost:3000&lt;/code&gt; local server to view the application.&lt;/p&gt;&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fa8az2g7mpdnjf8vom5n8.jpg" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fa8az2g7mpdnjf8vom5n8.jpg" alt="React App Screen" width="800" height="783"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;Congratulations! You have created your first React application.&lt;/p&gt;

&lt;h2&gt;
  
  
  Conclusion
&lt;/h2&gt;

&lt;p&gt;This article has given you a rundown of the React frontend web library and its basic setup and structure. Now get creative and begin creating applications with React.&lt;/p&gt;

&lt;p&gt;Visit the &lt;a href="https://beta.reactjs.org/" rel="noopener noreferrer"&gt;React Documentation&lt;/a&gt; to get more tutorials and content on React&lt;/p&gt;

</description>
      <category>ai</category>
      <category>productivity</category>
      <category>githubcopilot</category>
      <category>tests</category>
    </item>
    <item>
      <title>Design Quality software with the SDLC</title>
      <dc:creator>Marvellous D. Amos</dc:creator>
      <pubDate>Sat, 15 Oct 2022 13:11:52 +0000</pubDate>
      <link>https://dev.to/marvel_at_don/design-quality-software-with-the-sdlc-1fn5</link>
      <guid>https://dev.to/marvel_at_don/design-quality-software-with-the-sdlc-1fn5</guid>
      <description>&lt;h2&gt;
  
  
  Table of content
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;&lt;p&gt;Introduction&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;What is the SDLC&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;Brief history of the SDLC&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;Advantages of the SDLC&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;Phases of the SDLC&lt;/p&gt;&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Introduction
&lt;/h2&gt;

&lt;p&gt;It is the wish of every software Organization and development team to produce quality software that exceeds customer expectations, meets customer deadlines and is cost-effective.&lt;/p&gt;

&lt;p&gt;This article will help development teams and software organizations archive this by giving a basic understanding of the SDLC and how to apply its phases in producing quality software products&lt;/p&gt;

&lt;h2&gt;
  
  
  What is the SDLC
&lt;/h2&gt;

&lt;p&gt;The SDLC or Software development lifecycle is a systematic process taken to develop quality software. It defines tasks performed at each phase of the software development process which leads to the production of software that meets stipulated requirements.&lt;/p&gt;

&lt;p&gt;It also serves to improve the quality and the development process of the software&lt;/p&gt;

&lt;h2&gt;
  
  
  Brief history of the SDLC
&lt;/h2&gt;

&lt;p&gt;Due to the growing complexity of software development projects, in the mid-1960s, there came a need for these projects to take a more detailed approach toward their development. This need resulted in the birth of the Software development lifecycle&lt;/p&gt;

&lt;h2&gt;
  
  
  Advantages of the SDLC
&lt;/h2&gt;

&lt;p&gt;The advantages of Utilizing the SDLC include&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;&lt;p&gt;Each team member has a well-defined role, thus, reducing complexity and overlapping responsibility&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;problem-solving methods are incorporated early in the design /process&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;It improves efficiency and reduces the risk of failure&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;It enables team members to know what aspect of the project they are to work on and when&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;It provides room for interaction, making it possible to respond to changing requirements&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;It facilitates communication among stakeholders&lt;/p&gt;&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Phases of the SDLC
&lt;/h2&gt;

&lt;p&gt;There are 6 phases involved in the SDLC. These include the;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;&lt;p&gt;planning&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;Design&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;Development&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;Testing&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;Deployment and&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;Maintenance phases&lt;/p&gt;&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Planning Phase&lt;/strong&gt;: During this phase, the team gathers, analyzes, documents and prioritizes the software requirements. Factors influencing the software such as resource allocation, risk identification, purpose, users, legal compliance, input/output data, quality assurance and project scheduling are considered during this phase.&lt;/p&gt;

&lt;p&gt;Labour time, teams and roles are also identified and allocated in this phase.&lt;/p&gt;

&lt;p&gt;All requirements identified in this stage are then documented in an &lt;strong&gt;SRS&lt;/strong&gt;(Software Requirement Specification) document.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Design Phase&lt;/strong&gt;: During this phase, the requirements gathered in the SRS document are used to develop the architecture of the software. A &lt;em&gt;Design document&lt;/em&gt; is then created.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Development Phase&lt;/strong&gt;: Here, the designers use the design document to decide on and assign coding tasks. The software developers in the team then begin building upon the design architecture.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Testing Phase&lt;/strong&gt;: Here, the testers carry out tests on the software to ensure that the stability, security and other SRS requirements are met.&lt;/p&gt;

&lt;p&gt;Various levels of tests are carried out during this phase including unit, integration, system and acceptance tests.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Deployment Phase&lt;/strong&gt;: During this phase, the application is released into a production environment and made available to users.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Maintenance Phase&lt;/strong&gt;: During this phase, later requirements, user interface issues, bugs and code enhancements are identified and rectified.&lt;/p&gt;

&lt;p&gt;Conclusion&lt;/p&gt;

&lt;p&gt;This article has introduced you to;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;&lt;p&gt;the software development lifecycle(SDLC)&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;the history and need for the SDLC&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;the advantages of the SDLC and&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;the general phases involved in the SDLC&lt;/p&gt;&lt;/li&gt;
&lt;/ul&gt;

</description>
      <category>career</category>
      <category>software</category>
      <category>engineers</category>
      <category>development</category>
    </item>
    <item>
      <title>Understanding Big Data</title>
      <dc:creator>Marvellous D. Amos</dc:creator>
      <pubDate>Sun, 18 Sep 2022 15:23:51 +0000</pubDate>
      <link>https://dev.to/marvel_at_don/understanding-big-data-26if</link>
      <guid>https://dev.to/marvel_at_don/understanding-big-data-26if</guid>
      <description>&lt;h2&gt;
  
  
  Get To Know: Big Data
&lt;/h2&gt;

&lt;p&gt;Data is a term referring to facts and statistics collected together for reference or analytical purposes.&lt;br&gt;
In this digital world, everyone leaves a digital footprint. Be it through lifestyle documentation, entertainment media, content creation or even posts on social media, the number of internet-connected devices we interact with daily record vast amounts of data about us and our environment.&lt;br&gt;
This "vast amount of data" has been tagged &lt;strong&gt;Big Data&lt;/strong&gt;.&lt;/p&gt;

&lt;h2&gt;
  
  
  Defining Big Data
&lt;/h2&gt;

&lt;p&gt;Big Data, is a term used to describe large, hard-to-manage volumes of data. It refers to large, fast and complex data that is difficult, if not impossible, to process using traditional methods. It requires new and innovative ways to be collected, stored, processed and exploited.&lt;/p&gt;

&lt;h2&gt;
  
  
  Characteristics of big data
&lt;/h2&gt;

&lt;p&gt;The innate characteristics of big data include;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;value&lt;/li&gt;
&lt;li&gt;variety&lt;/li&gt;
&lt;li&gt;volume&lt;/li&gt;
&lt;li&gt;velocity&lt;/li&gt;
&lt;li&gt;veracity&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;These characteristics are often referred to as the 5v's of big data&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Value&lt;/strong&gt;: this refers to the benefits collected data possess. It relates to what organizations can do with acquired data and is the major reason organizations spend time and effort studying big data.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Variety&lt;/strong&gt;: this refers to the type and nature of the data. Data today could be in various formats(text, image, video or audio). Variety aims at the diversity of data and its sources (such as people, machines and organizations).&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Volume&lt;/strong&gt;: this refers to the scale or increase in the amount of collected and stored data. It is the basis of &lt;strong&gt;BIG&lt;/strong&gt; data as it refers to the size and amount of data collected.&lt;br&gt;
The volume of big data is mainly composed of data gotten from sensors, devices, social media, enterprise data and voiceovers.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Velocity&lt;/strong&gt;: Daily, data is being generated at a fast rate in a never-ending process. The speed, at which this data is being generated and processed is referred to as velocity. This is a very important aspect for companies that need their data flowing as quickly as possible.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Veracity&lt;/strong&gt;: this refers to how trustworthy the sources of data are. It accounts for the quality and origin of data, conforming to facts and accuracy. Attributes such as consistency, completeness and integrity play a huge role in determining the veracity of data.&lt;/p&gt;

&lt;h2&gt;
  
  
  Benefits of Big Data
&lt;/h2&gt;

&lt;p&gt;Big data comes with a handful of benefits which include:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;improved operational efficiency&lt;/li&gt;
&lt;li&gt;improved problem-solving approaches&lt;/li&gt;
&lt;li&gt;optimized product development&lt;/li&gt;
&lt;li&gt;enable smart decision making&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Application of Big Data
&lt;/h2&gt;

&lt;p&gt;By combining big data with high-performance analysis, certain business tasks can be addressed. These include:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Early detection of fraudulent activities&lt;/li&gt;
&lt;li&gt;Calculation of risk portfolios&lt;/li&gt;
&lt;li&gt;predictive maintenance of machines and equipment&lt;/li&gt;
&lt;li&gt;improved customer experience through user specification and
advanced client interaction&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Challenges of big data
&lt;/h2&gt;

&lt;p&gt;Like every other field, big data is not without its challenges and limitations. It is important to understand these challenges to avoid getting stuck at the initial stages of big-data-driven projects due to a lack of awareness or capacity to tackle their challenges.&lt;/p&gt;

&lt;p&gt;Some of these challenges include;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;&lt;p&gt;Inadequate storage capacity for big data: This is a pressing challenge for industries and individuals alike as the amount of data stored in data centres and databases continues to increase exponentially.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;Rapid change of big data technologies: keeping up with the latest data technology could prove to be a challenge to certain individuals who have already familiarized themselves with certain methods of processing data.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;Lack of data professionals: Data professionals such as data scientists, data analysts and data engineers who are experienced in working with appropriate data management tools are of great importance to a data-driven industry. However, these professionals are currently in short supply.&lt;/p&gt;&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  conclusion:
&lt;/h2&gt;

&lt;p&gt;This article has allowed you to understand;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;&lt;p&gt;the definition of big data and what differentiates it from normal data.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;the characteristics of big data and how they affect an industry&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;the benefits and applications of big data and lastly,&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;the current challenges and limitations faced by big data professionals and industries.&lt;/p&gt;&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;If you are aware of any other challenges, or better still, possible solutions to the challenges listed above, share your thoughts using the comment section below&lt;/p&gt;

</description>
      <category>bigdata</category>
      <category>database</category>
      <category>datascience</category>
      <category>beginners</category>
    </item>
    <item>
      <title>Laying the foundation: Data Engineers</title>
      <dc:creator>Marvellous D. Amos</dc:creator>
      <pubDate>Fri, 09 Sep 2022 05:22:39 +0000</pubDate>
      <link>https://dev.to/marvel_at_don/laying-the-foundation-data-engineers-51b9</link>
      <guid>https://dev.to/marvel_at_don/laying-the-foundation-data-engineers-51b9</guid>
      <description>&lt;p&gt;Getting into the field of data engineering, you must have the basic yet conceptual knowledge of the field as this would provide you with a solid foundation to develop further.&lt;/p&gt;

&lt;p&gt;In this article, You will understand the steps in which data flows within an organization, who are data engineers, and their responsibilities.&lt;/p&gt;

&lt;h2&gt;
  
  
  Data Workflow
&lt;/h2&gt;

&lt;p&gt;A workflow is a series of activities performed to do a specific task. Data workflow involves the steps in which data flows through an organization.&lt;/p&gt;

&lt;p&gt;There are four general steps involved in this process:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;&lt;p&gt;data collection and storage,&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;data preparation,&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;exploration and visualization and finally,&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;experimentation and prediction&lt;/p&gt;&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Data collection and storage&lt;/strong&gt;: In this step, data professionals collect data from various sources such as surveys, browser history, social media etc. Due to the massive amount of data generated daily in various formats and from various sources, this task becomes a daunting one. After this collection, the data is stored in its raw format.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Data preparation&lt;/strong&gt;: In this step, data is cleaned to enable the discovery of instances of missing or duplicated values. This step also involves the conversion of data into a more organized format. This leads to the next step&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Data exploration and visualization&lt;/strong&gt;: In this step, statistical techniques are used to identify and describe the structure of the data, the relationship between different data values and other crucial concepts which would enable the creation of visual aids (such as dashboards and diagrams) for tracking and comparing changes in datasets.&lt;/p&gt;

&lt;p&gt;This step enables you to gain a good grasp of your data before you move on to the final step&lt;/p&gt;

&lt;blockquote&gt;
&lt;p&gt;A dataset is a collection of related data.&lt;/p&gt;
&lt;/blockquote&gt;

&lt;p&gt;&lt;strong&gt;Experimentation and prediction&lt;/strong&gt;: In this step, it is assumed you have a good grasp of your data and are thus ready to perform certain tasks such as running experiments or building predictive models.&lt;/p&gt;

&lt;h2&gt;
  
  
  Data Engineers
&lt;/h2&gt;

&lt;p&gt;Having understood the flow of data in an organization the answer to the question of the role of a data engineer becomes clearer.&lt;/p&gt;

&lt;p&gt;Data engineers are responsible for the first step of the data workflow, which involves collecting and storing data.&lt;/p&gt;

&lt;p&gt;They are the foundation of the data workflow process as they lay the groundwork for other professionals such as data analysts, data scientists and machine learning engineers who would prepare, explore and experiment with the data. Data engineers ensure that correct data is delivered efficiently, in the right format and to the right people.&lt;/p&gt;

&lt;p&gt;Data engineers ingest data from various sources, optimize the databases for analysis, and manage data corruption. They develop, construct, test and maintain architectures such as databases and large-scale processing systems to process and handle the massive amount of data gotten from different sources.&lt;/p&gt;

&lt;p&gt;In simple terms, they collect data from many sources and manage it for other data professionals to access and use.&lt;/p&gt;

&lt;h2&gt;
  
  
  Conclusion;
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;&lt;p&gt;data engineers are responsible for the first step in the data workflow, collecting and storing data&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;they lay the groundwork for data analysts, data scientists and machine learning engineers ensuring that data is not scattered, corrupted or difficult to access.&lt;/p&gt;&lt;/li&gt;
&lt;/ul&gt;

</description>
      <category>data</category>
      <category>datascience</category>
      <category>bigdata</category>
      <category>beginners</category>
    </item>
  </channel>
</rss>
