<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Barbara Morara</title>
    <description>The latest articles on DEV Community by Barbara Morara (@moraraba1).</description>
    <link>https://dev.to/moraraba1</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F3716566%2Ffd1139a9-1969-4d65-8bd6-5040db049592.png</url>
      <title>DEV Community: Barbara Morara</title>
      <link>https://dev.to/moraraba1</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/moraraba1"/>
    <language>en</language>
    <item>
      <title>Regression and Regularization: A Beginner’s Guide to Better Predictive Models</title>
      <dc:creator>Barbara Morara</dc:creator>
      <pubDate>Fri, 24 Jul 2026 18:18:55 +0000</pubDate>
      <link>https://dev.to/moraraba1/regression-and-regularization-a-beginners-guide-to-better-predictive-models-59pn</link>
      <guid>https://dev.to/moraraba1/regression-and-regularization-a-beginners-guide-to-better-predictive-models-59pn</guid>
      <description>&lt;h2&gt;
  
  
  Introduction
&lt;/h2&gt;

&lt;p&gt;Sometimes, in data science, there is a need to predict the future results based on some historical data. The regression is a machine learning method used for finding relations between variables and making predictions on the numeric values like prices, sales or demands.&lt;/p&gt;

&lt;p&gt;But complex models are prone to the effect of overfitting, which means that they study the training data too accurately and have poor results on the testing ones. That is why regularization is necessary to avoid this problem and make models simpler and better-generalized.&lt;/p&gt;

&lt;h2&gt;
  
  
  What Is Regression?
&lt;/h2&gt;

&lt;p&gt;The regression is the supervised machine learning method which predicts the numeric value depending on one or several input variables.&lt;/p&gt;

&lt;p&gt;For instance, the real estate company may use regression to find the price of houses according to:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Size of the house.&lt;/li&gt;
&lt;li&gt;Number of bedrooms.&lt;/li&gt;
&lt;li&gt;Location.&lt;/li&gt;
&lt;li&gt;Age of the house.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Types of Regression
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;Linear Regression&lt;/strong&gt;&lt;br&gt;
Linear regression is the simplest regression method which supposes linear dependence between the input variables and target value.&lt;/p&gt;

&lt;p&gt;Example:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="kn"&gt;from&lt;/span&gt; &lt;span class="n"&gt;sklearn.linear_model&lt;/span&gt; &lt;span class="kn"&gt;import&lt;/span&gt; &lt;span class="n"&gt;LinearRegression&lt;/span&gt;

&lt;span class="n"&gt;model&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nc"&gt;LinearRegression&lt;/span&gt;&lt;span class="p"&gt;()&lt;/span&gt;
&lt;span class="n"&gt;model&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;fit&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;X_train&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;y_train&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;&lt;strong&gt;Multiple Linear Regression&lt;/strong&gt;&lt;br&gt;
The regression method which uses several predictors for its estimations, for instance, predicting the salary according to the education level, experience and job role of the employee.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Polynomial Regression&lt;/strong&gt;&lt;br&gt;
The regression method used in cases where the dependencies between the variables are more complicated and do not depend on the straight line.&lt;/p&gt;
&lt;h2&gt;
  
  
  The Problem of Overfitting
&lt;/h2&gt;

&lt;p&gt;If the machine learning model has extremely good performance on training data, but poor performance on testing ones – then it probably suffers from overfitting.&lt;br&gt;
It means that the model studied some noises or unnecessary dependencies while studying training data.&lt;br&gt;
To solve this problem, regularization is needed.&lt;/p&gt;
&lt;h2&gt;
  
  
  What is Regularization?
&lt;/h2&gt;

&lt;p&gt;Regularization is a method where a penalty term is added to the regression model to avoid over-fitting or complexity in the model. It makes sure that the model doesn't become dependent on specific features.&lt;/p&gt;

&lt;p&gt;Types of Regularization are:&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Ridge Regression (L2)&lt;/strong&gt;&lt;br&gt;
Ridge shrinks the coefficients without excluding the features.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="kn"&gt;from&lt;/span&gt; &lt;span class="n"&gt;sklearn.linear_model&lt;/span&gt; &lt;span class="kn"&gt;import&lt;/span&gt; &lt;span class="n"&gt;Ridge&lt;/span&gt;

&lt;span class="n"&gt;model&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nc"&gt;Ridge&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;alpha&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="mf"&gt;1.0&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;** Lasso Regression (L1)**&lt;br&gt;
Lasso shrinks some of the coefficients to make them zero, which means some features would be excluded.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="kn"&gt;from&lt;/span&gt; &lt;span class="n"&gt;sklearn.linear_model&lt;/span&gt; &lt;span class="kn"&gt;import&lt;/span&gt; &lt;span class="n"&gt;Lasso&lt;/span&gt;

&lt;span class="n"&gt;model&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nc"&gt;Lasso&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;alpha&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="mf"&gt;0.1&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h2&gt;
  
  
  Elastic Net
&lt;/h2&gt;

&lt;p&gt;It combines Ridge and Lasso together to get both the benefits of both.&lt;/p&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Regression&lt;/th&gt;
&lt;th&gt;Regularization&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;Used for prediction and understanding relationships&lt;/td&gt;
&lt;td&gt;Used to improve model performance&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Minimizes prediction errors&lt;/td&gt;
&lt;td&gt;Reduces model complexity&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Can overfit with many features&lt;/td&gt;
&lt;td&gt;Helps prevent overfitting&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;Regression is one of the most commonly used models in data science to predict numerical results. There are two important concepts of regression, namely regularization and regression.&lt;br&gt;
Regularization helps in creating simpler models that are more robust in the case of real-world applications.&lt;/p&gt;

</description>
      <category>beginners</category>
      <category>datascience</category>
      <category>machinelearning</category>
      <category>tutorial</category>
    </item>
    <item>
      <title>Machine Learning Explained: Understanding the Different Types of Machine Learning</title>
      <dc:creator>Barbara Morara</dc:creator>
      <pubDate>Fri, 24 Jul 2026 17:57:55 +0000</pubDate>
      <link>https://dev.to/moraraba1/machine-learning-explained-understanding-the-different-types-of-machine-learning-b3a</link>
      <guid>https://dev.to/moraraba1/machine-learning-explained-understanding-the-different-types-of-machine-learning-b3a</guid>
      <description>&lt;h2&gt;
  
  
  Introduction
&lt;/h2&gt;

&lt;p&gt;Currently, our everyday lives generate a lot of data. From recommending products while online shopping and predicting which posts will be in your social media feed, through detecting fraud and medical diagnosis – all of these require algorithms that can learn from data and make decisions. Machine Learning (ML) is here for that.&lt;/p&gt;

&lt;p&gt;Machine Learning is a branch of Artificial Intelligence (AI), which is aimed at teaching machines to learn from data, identify patterns, and make decisions with little or no human involvement. It differs from traditional software programs as they follow certain instructions, while machine learning algorithms analyze data samples, learn relationships between them, and draw conclusions.&lt;/p&gt;

&lt;p&gt;From the perspective of a data scientist, ML is one of the key techniques to extract insights from the available data and apply it to automation.&lt;/p&gt;

&lt;h2&gt;
  
  
  What is Machine Learning?
&lt;/h2&gt;

&lt;p&gt;Machine Learning is an algorithmic process that includes learning patterns in the historical data and applying them to predictions or tasks execution.&lt;/p&gt;

&lt;p&gt;Traditionally, program is created according to this pattern:&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Rules + Data → Output&lt;/strong&gt;&lt;br&gt;
The programmer writes a set of rules to calculate taxes depending on income.&lt;/p&gt;

&lt;p&gt;The machine learning program works differently:&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Data + Expected Outputs → Learning Algorithm → Model&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;The computer discovers rules by examining examples.&lt;/p&gt;

&lt;p&gt;Instead of writing a program that will distinguish between spam email and not spam, we feed the learning algorithm thousands of examples, and the model learns to detect spam.&lt;/p&gt;
&lt;h2&gt;
  
  
  Why Machine Learning is Important?
&lt;/h2&gt;

&lt;p&gt;Machine Learning has become a must in the world of data and advanced computing capabilities. Organizations implement ML in order to solve problems.&lt;/p&gt;

&lt;p&gt;A few common applications of machine learning are:&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;1. Recommendation Systems&lt;/strong&gt;&lt;br&gt;
Recommendation systems on sites such as Netflix, YouTube, and other online stores are developed using machine learning algorithms which suggest content or products based on user activities.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;2. Healthcare&lt;/strong&gt;&lt;br&gt;
Machine learning algorithms are useful for disease detection, analyzing medical images, and predicting risk for patients.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;3. Finance&lt;/strong&gt;&lt;br&gt;
Banks utilize machine learning for fraud detection, credit scoring, and market analysis.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;4. Transportation&lt;/strong&gt;&lt;br&gt;
Autonomous vehicles use machine learning algorithms to understand surroundings and take appropriate driving actions.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;5. Marketing&lt;/strong&gt;&lt;br&gt;
Companies analyze customer behavior to design customized advertisements.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Machine Learning Types&lt;/strong&gt;&lt;br&gt;
Machine learning can be broadly classified into four major categories:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Supervised learning&lt;/li&gt;
&lt;li&gt;Unsupervised learning&lt;/li&gt;
&lt;li&gt;Semi-supervised learning&lt;/li&gt;
&lt;li&gt;Reinforcement learning
These types differ based on how they learn from the data and the problem they solve.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;1. Supervised learning&lt;/strong&gt;&lt;br&gt;
Supervised learning is the most popular form of machine learning. In supervised learning models, learning occurs based on data where the output has been provided. The input data already contains the answer or label.&lt;/p&gt;

&lt;p&gt;The objective is to learn the relationship between input variables and output variables in order to be able to predict future instances of data.&lt;/p&gt;

&lt;p&gt;Example:&lt;br&gt;
Suppose we wish to predict the prices of houses.&lt;/p&gt;

&lt;p&gt;The dataset may contain:&lt;/p&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Size of House&lt;/th&gt;
&lt;th&gt;Number of Rooms&lt;/th&gt;
&lt;th&gt;Location&lt;/th&gt;
&lt;th&gt;Price&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;1200 sq ft&lt;/td&gt;
&lt;td&gt;3&lt;/td&gt;
&lt;td&gt;Nairobi&lt;/td&gt;
&lt;td&gt;8 million&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;2000 sq ft&lt;/td&gt;
&lt;td&gt;5&lt;/td&gt;
&lt;td&gt;Nairobi&lt;/td&gt;
&lt;td&gt;15 million&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;The algorithm will learn about the relation of size and location to prices so that we may predict prices of a new house.&lt;/p&gt;
&lt;h2&gt;
  
  
  Types of Supervised Learning:
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;a) Regression&lt;/strong&gt;&lt;br&gt;
Regression involves predicting continuous numeric values.&lt;/p&gt;

&lt;p&gt;Example:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Predicting house prices.&lt;/li&gt;
&lt;li&gt;Sales forecasting.&lt;/li&gt;
&lt;li&gt;Temperature prediction.&lt;/li&gt;
&lt;li&gt;Forecasting future stock prices.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Common regression algorithms are:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Linear Regression&lt;/li&gt;
&lt;li&gt;Decision Tree Regression&lt;/li&gt;
&lt;li&gt;Random Forest Regression&lt;/li&gt;
&lt;li&gt;Support Vector Regression&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Example&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="kn"&gt;from&lt;/span&gt; &lt;span class="n"&gt;sklearn.linear_model&lt;/span&gt; &lt;span class="kn"&gt;import&lt;/span&gt; &lt;span class="n"&gt;LinearRegression&lt;/span&gt;

&lt;span class="n"&gt;model&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nc"&gt;LinearRegression&lt;/span&gt;&lt;span class="p"&gt;()&lt;/span&gt;

&lt;span class="n"&gt;model&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;fit&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;X_train&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;y_train&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;

&lt;span class="n"&gt;prediction&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;model&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;predict&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;X_test&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;&lt;strong&gt;b) Classification&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Classification predicts classes or categories.&lt;/p&gt;

&lt;p&gt;Examples:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Email: Spam or Not Spam&lt;/li&gt;
&lt;li&gt;Disease prediction: Positive or Negative&lt;/li&gt;
&lt;li&gt;Client: Will purchase or Will not purchase&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Examples of classification algorithms:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Logistic Regression&lt;/li&gt;
&lt;li&gt;Decision Trees&lt;/li&gt;
&lt;li&gt;Random Forest&lt;/li&gt;
&lt;li&gt;Support Vector Machines&lt;/li&gt;
&lt;li&gt;Neural Networks&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Example:&lt;/p&gt;

&lt;p&gt;A bank might use classification to check if the transaction is fraudulent.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;2. Unsupervised Learning&lt;/strong&gt;&lt;br&gt;
In contrast with the supervised learning, the data used in the unsupervised learning is unlabeled. In other words, the machine learning algorithm gets data and there are no answers given to the algorithm.&lt;br&gt;
The aim of the unsupervised learning is to find out natural structure in data.&lt;/p&gt;

&lt;p&gt;Example:&lt;/p&gt;

&lt;p&gt;A firm has client data but it does not know client clusters. Machine learning algorithm can automatically discover the clusters according to their purchasing behavior.&lt;/p&gt;

&lt;h2&gt;
  
  
  Types of Unsupervised Learning
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;a) Clustering&lt;/strong&gt;&lt;br&gt;
Clustering groups together similar data.&lt;/p&gt;

&lt;p&gt;Examples:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Customer segmentation&lt;/li&gt;
&lt;li&gt;Similar documents grouping&lt;/li&gt;
&lt;li&gt;Communities detection in networks&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Clustering algorithms:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;K-Means Clustering&lt;/li&gt;
&lt;li&gt;Hierarchical Clustering&lt;/li&gt;
&lt;li&gt;DBSCAN&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Example:&lt;/p&gt;

&lt;p&gt;A supermarket could group customers into:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Frequent buyers&lt;/li&gt;
&lt;li&gt;Occasional buyers&lt;/li&gt;
&lt;li&gt;Important clients&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;b) Dimensionality Reduction&lt;/strong&gt;&lt;br&gt;
Dimensionality reduction reduces the number of variables while keeping important information.&lt;br&gt;
Sometimes large dataset includes hundreds of features and it becomes impossible to analyze data. Therefore, it is necessary to simplify data.&lt;/p&gt;

&lt;p&gt;Popular dimensionality reduction techniques:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Principal Component Analysis (PCA)&lt;/li&gt;
&lt;li&gt;t-SNE&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Applications of dimensionality reduction:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Data visualization&lt;/li&gt;
&lt;li&gt;Faster model training&lt;/li&gt;
&lt;li&gt;Unnecessary features removal&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;3. Semi-Supervised Learning&lt;/strong&gt;&lt;br&gt;
Semi-supervised learning is a combination of both supervised and unsupervised learning.&lt;/p&gt;

&lt;p&gt;It uses:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Labeled data (a little bit)&lt;/li&gt;
&lt;li&gt;Unlabeled data (a lot)&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Labelling data can be expensive and time consuming. Semi-supervised learning is useful when the number of labeled data is limited.&lt;/p&gt;

&lt;p&gt;For instance,&lt;/p&gt;

&lt;p&gt;A firm needs to develop an image recognition system. Rather than labeling all million images manually, it would label some of the images and let the model learn on its own from the unlabeled images.&lt;/p&gt;

&lt;p&gt;Applications include:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Image Classification&lt;/li&gt;
&lt;li&gt;Speech Recognition&lt;/li&gt;
&lt;li&gt;Medical data analysis&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;4. Reinforcement Learning&lt;/strong&gt;&lt;br&gt;
Reinforcement learning is grounded on learning from interaction with the environment.&lt;/p&gt;

&lt;p&gt;The agent learns through:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Performing actions&lt;/li&gt;
&lt;li&gt;Getting rewarded or penalized&lt;/li&gt;
&lt;li&gt;Improving future decisions&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The objective is to increase the rewards in the future.&lt;/p&gt;

&lt;p&gt;For instance,&lt;/p&gt;

&lt;p&gt;A robot learning &lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;How to move around the room&lt;/li&gt;
&lt;li&gt;Getting the rewards for moving right&lt;/li&gt;
&lt;li&gt;Being punished for hitting obstacles&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;In the long run, it learns the optimal path&lt;/p&gt;

&lt;h2&gt;
  
  
  Applications of Reinforcement Learning
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;Gaming&lt;/strong&gt;&lt;br&gt;
AI agents use reinforcement learning to master gaming and come up with effective strategies.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Robotics&lt;/strong&gt;&lt;br&gt;
Robots learn how to perform certain operations such as walking, grasping objects, etc.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Autonomous Vehicles&lt;/strong&gt;&lt;br&gt;
Vehicles learn driving behavior based on various situations.&lt;br&gt;
Machine Learning Workflow&lt;/p&gt;

&lt;p&gt;Machine learning projects usually consist of the following steps:&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;1. Data Collection&lt;/strong&gt;&lt;br&gt;
Collection of the relevant data from the database, website, sensors, survey, etc.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;2. Data Cleaning&lt;/strong&gt;&lt;br&gt;
Eliminating errors and missing values from the dataset.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;3. Feature Selection&lt;/strong&gt;&lt;br&gt;
Selecting relevant variables that will assist in predictions.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;4. Model Training&lt;/strong&gt;&lt;br&gt;
Learning of patterns in training dataset by the algorithm.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;5. Model Evaluation&lt;/strong&gt;&lt;br&gt;
Evaluation of the model through accuracy, precision, recall, Mean Squared Error, etc.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;6. Model Deployment&lt;/strong&gt;&lt;br&gt;
Deployment of the learned model into production&lt;/p&gt;

&lt;h2&gt;
  
  
  Challenges in Machine Learning
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;1. Poor Data&lt;/strong&gt;&lt;br&gt;
Low-quality data generates low-quality predictions.&lt;/p&gt;

&lt;p&gt;The popular phrase in the data science industry goes as follows:&lt;/p&gt;

&lt;p&gt;"Garbage in, garbage out."&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;2. Overfitting&lt;/strong&gt;&lt;br&gt;
Overfitting takes place when a machine learning model trains too closely to the training data and does not function properly with other data.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;3. Bias&lt;/strong&gt;&lt;br&gt;
Bias in the data causes bias in the results generated by machine learning algorithms.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;4. Computing Requirements&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Large-scale machine learning models require lots of computing power.&lt;/p&gt;

&lt;h2&gt;
  
  
  Differences between AI and Machine Learning
&lt;/h2&gt;

&lt;p&gt;While these terms are interchangeable, they refer to different things.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Artificial Intelligence&lt;/strong&gt; is the general idea of creating machines capable of performing the tasks that require human intellect.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Machine Learning&lt;/strong&gt; is a subfield of Artificial Intelligence concerned with providing such machines with the ability to learn from the data.&lt;/p&gt;

&lt;p&gt;Relationship is as follows:&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Artificial Intelligence -&amp;gt; Machine Learning -&amp;gt; Deep Learning&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Deep Learning is a field within machine learning where the artificial neural networks are used to solve challenging problems.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Conclusion&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Machine Learning has completely revolutionized data analysis, automation, and decision making processes in modern businesses. Thanks to machine learning, computers can be trained on experience.&lt;br&gt;
Major machine learning types such as supervised learning, unsupervised learning, semi-supervised learning, and reinforcement learning give various ways to solve specific problems based on the data type and required outcome.&lt;/p&gt;

&lt;p&gt;For everyone stepping into the field of data science, knowing about the machine learning is crucial as these concepts represent the core of model and data-driven solution creation.&lt;/p&gt;

</description>
      <category>ai</category>
      <category>algorithms</category>
      <category>datascience</category>
      <category>machinelearning</category>
    </item>
    <item>
      <title>Parametric vs Non-Parametric Statistical Tests</title>
      <dc:creator>Barbara Morara</dc:creator>
      <pubDate>Fri, 24 Jul 2026 16:59:25 +0000</pubDate>
      <link>https://dev.to/moraraba1/parametric-vs-non-parametric-statistical-tests-30mo</link>
      <guid>https://dev.to/moraraba1/parametric-vs-non-parametric-statistical-tests-30mo</guid>
      <description>&lt;p&gt;In statistics, statistical tests refer to specific procedures and techniques for data analysis aimed at decision-making, pattern recognition, and determining whether observed effects are significant and happened not accidentally. There are two main classes of statistical tests: parametric and non-parametric tests. To understand their distinctions and to pick up the right one in specific cases, it is vital to learn the peculiarities of each type.&lt;/p&gt;

&lt;h2&gt;
  
  
  Parametric Tests
&lt;/h2&gt;

&lt;p&gt;First of all, what is the definition of parametric tests? This is a class of tests that assumes that the data distribution is known. In many cases, it is assumed to be normally distributed. Besides, parametric tests are based on the assumption that some parameters can describe the analyzed population.&lt;/p&gt;

&lt;p&gt;Some examples of parametric tests are:&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;T-tests&lt;/strong&gt;, which allow comparing means of two groups;&lt;br&gt;
&lt;strong&gt;ANOVA (analysis of variance)&lt;/strong&gt;, which enables comparison of means of three and more groups;&lt;br&gt;
&lt;strong&gt;Pearson correlation test&lt;/strong&gt;, which measures the correlation between two continuous variables.&lt;/p&gt;

&lt;p&gt;Thus, for instance, a data scientist uses a t-test to define the difference in average income between two groups of customers.&lt;/p&gt;

&lt;p&gt;The good thing about parametric tests is that their results are more precise when all assumptions are met. Moreover, they have higher statistical power than other tests, and, therefore, they are more effective when detecting differences.&lt;/p&gt;

&lt;p&gt;At the same time, there are some requirements for data:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;It must be approximately normally distributed;&lt;/li&gt;
&lt;li&gt;Observations must be independent;&lt;/li&gt;
&lt;li&gt;Some cases require the similarity of variances between groups.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  What Are Non-Parametric Tests?
&lt;/h2&gt;

&lt;p&gt;Non-parametric tests are statistical tools that do not require strict requirements regarding the data distribution. In other words, these tests are known as distribution-free tests because they are applicable even when the data is not distributed normally.&lt;/p&gt;

&lt;p&gt;The most popular examples of non-parametric tests are:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Mann-Whitney U test&lt;/strong&gt; - alternative for the independent t-test.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Wilcoxon signed-rank test&lt;/strong&gt; - for comparisons of paired observations.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Kruskal-Wallis test&lt;/strong&gt; - alternative for ANOVA.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Spearman's rank correlation test&lt;/strong&gt; - used to measure relationships between ranked variables.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;For instance, when a data scientist uses customer satisfaction ratings gathered using the rating from 1 to 5, such data is not likely to fit the requirements for a parametric test.&lt;/p&gt;

&lt;p&gt;Using non-parametric tests allows handling:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Small samples.&lt;/li&gt;
&lt;li&gt;Ordinal data (ranked data).&lt;/li&gt;
&lt;li&gt;Data containing outliers.&lt;/li&gt;
&lt;li&gt;Non-normal distributions.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;However, the main drawback of these tests is the lower power compared to the parametric approach.&lt;/p&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Feature&lt;/th&gt;
&lt;th&gt;Parametric Tests&lt;/th&gt;
&lt;th&gt;Non-Parametric Tests&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;Data assumptions&lt;/td&gt;
&lt;td&gt;Require assumptions about distribution&lt;/td&gt;
&lt;td&gt;Few or no distribution assumptions&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Data type&lt;/td&gt;
&lt;td&gt;Mainly continuous numerical data&lt;/td&gt;
&lt;td&gt;Can handle ordinal and non-normal data&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Main measurement&lt;/td&gt;
&lt;td&gt;Uses means and variances&lt;/td&gt;
&lt;td&gt;Often uses ranks or medians&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Statistical power&lt;/td&gt;
&lt;td&gt;Higher when assumptions are met&lt;/td&gt;
&lt;td&gt;Lower but more flexible&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Examples&lt;/td&gt;
&lt;td&gt;T-test, ANOVA, Pearson correlation&lt;/td&gt;
&lt;td&gt;Mann–Whitney, Kruskal–Wallis, Spearman correlation&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;h2&gt;
  
  
  When Should Data Scientists Use Each Approach?
&lt;/h2&gt;

&lt;p&gt;Choosing between parametric and non-parametric tests depends on the features of the dataset.&lt;/p&gt;

&lt;p&gt;Choose Parametric Tests in Cases Where:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;The dataset is sufficiently large and normally distributed.&lt;/li&gt;
&lt;li&gt;Variables are measurements.&lt;/li&gt;
&lt;li&gt;Test assumptions can be checked.&lt;/li&gt;
&lt;li&gt;More powerful statistical analyses are needed.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;For example, studying the average test scores of the students of a large population is the right scenario to use a t-test.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Choose Non-Parametric Tests in Cases Where:&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;The data is not normally distributed.&lt;/li&gt;
&lt;li&gt;The sample size is low.&lt;/li&gt;
&lt;li&gt;The dataset includes outliers.&lt;/li&gt;
&lt;li&gt;Data is categorical or ranked.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;For example, analyzing customer reviews or satisfaction rankings may require non-parametric methods because the data is ordinal rather than continuous.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Role of These Tests in Data Science
&lt;/h2&gt;

&lt;p&gt;Both parametric and non-parametric tests play an important role in modern data science. Before building machine learning models, data scientists often perform statistical tests to understand relationships between variables, evaluate hypotheses, and identify important features.&lt;/p&gt;

&lt;p&gt;Parametric tests are commonly used in predictive modeling, experimental analysis, and A/B testing because they provide efficient estimates when assumptions are met. For example, companies may use statistical tests to determine whether a new website design improves customer conversion rates.&lt;/p&gt;

&lt;p&gt;Non-parametric tests are valuable in real-world datasets where data is often messy, incomplete, or does not follow ideal distributions. They allow data scientists to analyze information without forcing unrealistic assumptions.&lt;/p&gt;

&lt;p&gt;Ultimately, the choice between parametric and non-parametric tests depends on understanding the data. A good data scientist does not automatically choose one method but evaluates the dataset, checks assumptions, and selects the statistical approach that provides the most reliable insights.&lt;/p&gt;

&lt;h2&gt;
  
  
  Conclusion
&lt;/h2&gt;

&lt;p&gt;Parametric and non-parametric tests are both important tools in statistical analysis. Parametric tests offer powerful analysis when data meets specific assumptions, while non-parametric tests provide flexibility when those assumptions are not satisfied. In data science, knowing when to apply each method helps professionals make accurate conclusions, improve models, and make better data-driven decisions.&lt;/p&gt;

</description>
      <category>data</category>
      <category>learning</category>
      <category>science</category>
    </item>
    <item>
      <title>Why Hypothesis Testing Matters in Data Science: Understanding the Tests Every Data Scientist Should Know</title>
      <dc:creator>Barbara Morara</dc:creator>
      <pubDate>Fri, 24 Jul 2026 16:38:22 +0000</pubDate>
      <link>https://dev.to/moraraba1/why-hypothesis-testing-matters-in-data-science-understanding-the-tests-every-data-scientist-2fhp</link>
      <guid>https://dev.to/moraraba1/why-hypothesis-testing-matters-in-data-science-understanding-the-tests-every-data-scientist-2fhp</guid>
      <description>&lt;p&gt;Data science encompasses more than model creation and visualization. A significant portion of data science consists of evidence-based decision-making. Often when dealing with data, we have to answer such questions as:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Did the newly introduced marketing strategy contribute to sales growth?&lt;/li&gt;
&lt;li&gt;Is there any advantage in applying a novel treatment method?&lt;/li&gt;
&lt;li&gt;Are there any significant differences between groups?&lt;/li&gt;
&lt;li&gt;Is the pattern that we observe true or happened by mere coincidence?&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;It is where hypothesis testing comes into play.&lt;br&gt;
Hypothesis testing is a statistical procedure aimed at determining if there is sufficient evidence in a sample to back up a claim or refute an assumption.&lt;br&gt;
In order to reach conclusions based on data, hypothesis testing allows going beyond mere assumptions and observations.&lt;/p&gt;

&lt;h2&gt;
  
  
  What Is Hypothesis Testing?
&lt;/h2&gt;

&lt;p&gt;Hypothesis testing involves the following two claims:&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Null Hypothesis (H₀)&lt;/strong&gt;&lt;br&gt;
The null hypothesis represents an assumption that there is no significant difference or relationship.&lt;/p&gt;

&lt;p&gt;Examples:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;The newly applied teaching approach does not influence student performance.&lt;/li&gt;
&lt;li&gt;A product's price does not impact its popularity.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Alternative Hypothesis (H₁)&lt;/strong&gt;&lt;br&gt;
The alternative hypothesis stands for what we want to prove.&lt;/p&gt;

&lt;p&gt;Examples:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;The newly applied teaching approach influences student performance.&lt;/li&gt;
&lt;li&gt;A product's price impacts its popularity.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The purpose of hypothesis testing is to analyze data and find out if there is sufficient evidence to reject the null hypothesis.&lt;/p&gt;

&lt;h2&gt;
  
  
  Why Hypothesis Testing Is Important in Data Science
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;1. Helps with Evidence-Based Decision Making&lt;/strong&gt;&lt;br&gt;
Data scientists usually face incomplete data. Hypothesis testing helps identify which patterns in data are meaningful.&lt;/p&gt;

&lt;p&gt;For instance:&lt;br&gt;
A firm introduces a new design of the website and finds out that it is followed by sales growth.&lt;/p&gt;

&lt;p&gt;Now we have a question:&lt;br&gt;
Was the growth caused by introducing the new design, or did it happen randomly?&lt;/p&gt;

&lt;p&gt;A hypothesis test will tell whether the improvement is statistically significant.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;2. Useful in Validation of Machine Learning Features&lt;/strong&gt;&lt;br&gt;
Before developing machine learning models, data scientists try to understand relationships between variables.&lt;/p&gt;

&lt;p&gt;For instance:&lt;br&gt;
A data scientist wants to forecast house prices.&lt;br&gt;
He/she may ask:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;Does the location significantly impact the house price?&lt;/li&gt;
&lt;li&gt;Does the house size influence the price?&lt;/li&gt;
&lt;li&gt;Does the number of rooms influence the price?&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;Hypothesis tests help to find out which features should be included in the models.&lt;/p&gt;

&lt;h2&gt;
  
  
  Commonly Used Hypothesis Tests in Data Science
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;1. Z-Test&lt;/strong&gt;&lt;br&gt;
Z-test is used when we need to compare the sample mean with the population mean, the population variance is known, and the sample size is large.&lt;/p&gt;

&lt;p&gt;For instance:&lt;/p&gt;

&lt;p&gt;A company says that the average delivery time is 30 minutes.&lt;br&gt;
A data scientist obtains data about delivery time from 100 customers.&lt;br&gt;
The question:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Is the real delivery time different from 30 minutes?
Z-test will tell us whether the company's statement is correct.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;em&gt;&lt;strong&gt;Importance in Data Science:&lt;/strong&gt;&lt;/em&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Tests business statements&lt;/li&gt;
&lt;li&gt;Comparison of big datasets&lt;/li&gt;
&lt;li&gt;Quality control analysis&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;2. T-Test&lt;/strong&gt;&lt;br&gt;
T-test is used when we need to compare the means of two groups to find whether the difference between them is statistically significant.&lt;/p&gt;

&lt;p&gt;Different types:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;One-sample t-test&lt;/li&gt;
&lt;li&gt;Independent two-sample t-test&lt;/li&gt;
&lt;li&gt;Paired t-test&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;For instance:&lt;br&gt;
A company wants to know whether employees trained perform better than those who were not trained.&lt;/p&gt;

&lt;p&gt;Group A:&lt;br&gt;
Untrained employees&lt;br&gt;
Group B:&lt;br&gt;
Trained employees&lt;/p&gt;

&lt;p&gt;T-test will show whether there is a significant difference in their performance.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;&lt;em&gt;Importance in Data Science:&lt;/em&gt;&lt;/strong&gt;&lt;br&gt;
T-tests are used in:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;A/B testing&lt;/li&gt;
&lt;li&gt;Customer group comparison&lt;/li&gt;
&lt;li&gt;Experiments analysis&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;For instance:&lt;br&gt;
Streaming company tests two recommendation systems.&lt;/p&gt;

&lt;p&gt;Version A → Old system&lt;br&gt;
Version B → New system&lt;/p&gt;

&lt;p&gt;The t-test helps determine if the new system improves user engagement.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;3. Chi-Square Test&lt;/strong&gt;&lt;br&gt;
The Chi-square test is applied to test an association between categorical variables.&lt;/p&gt;

&lt;p&gt;Example:&lt;br&gt;
A company wants to check whether the gender of customers influences product preferences.&lt;/p&gt;

&lt;p&gt;Data:&lt;/p&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Gender&lt;/th&gt;
&lt;th&gt;Product Choice&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;Male&lt;/td&gt;
&lt;td&gt;Laptop&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Female&lt;/td&gt;
&lt;td&gt;Phone&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;The Chi-square test checks whether the preference for the products depends on gender.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;&lt;em&gt;Importance in Data Science:&lt;/em&gt;&lt;/strong&gt;&lt;br&gt;
Used for:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Feature selection&lt;/li&gt;
&lt;li&gt;Customer behavior analysis&lt;/li&gt;
&lt;li&gt;Survey data analysis&lt;/li&gt;
&lt;li&gt;Category relationship testing&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Example:&lt;br&gt;
In machine learning, a data scientist could apply Chi-square tests for feature selection before the model training.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;4. ANOVA (Analysis of Variance)&lt;/strong&gt;&lt;br&gt;
ANOVA is used when we need to compare the means of three or more groups.&lt;br&gt;
A t-test compares only two groups while ANOVA allows us to make many comparisons.&lt;/p&gt;

&lt;p&gt;Example:&lt;br&gt;
A company wants to test three advertising approaches:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Facebook ads&lt;/li&gt;
&lt;li&gt;Google ads&lt;/li&gt;
&lt;li&gt;Instagram ads&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The question:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Which approach generates higher sales?
ANOVA will tell us whether the differences between groups are statistically significant.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;em&gt;&lt;strong&gt;Importance in Data Science:&lt;/strong&gt;&lt;/em&gt;&lt;br&gt;
Used in:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Experiment analysis&lt;/li&gt;
&lt;li&gt;Market research&lt;/li&gt;
&lt;li&gt;Product testing&lt;/li&gt;
&lt;li&gt;Scientific research&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;5. Correlation Tests&lt;/strong&gt;&lt;br&gt;
Correlation tests check whether two variables are related.&lt;br&gt;
Popular tests are:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Pearson correlation&lt;/li&gt;
&lt;li&gt;Spearman correlation&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Example:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;A data scientist would like to test whether there is any relation between study hours and exam scores.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Correlation test measures the relation between the increase of study hours and score increase.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;&lt;em&gt;Importance in Data Science:&lt;/em&gt;&lt;/strong&gt;&lt;br&gt;
Used for:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Exploratory data analysis&lt;/li&gt;
&lt;li&gt;Feature selection&lt;/li&gt;
&lt;li&gt;Variables relationship detection
However, correlation doesn't imply causation.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Example:&lt;br&gt;
There can be a positive correlation between ice cream sales and number of drownings because both variables grow during summer.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;6. Tests for Normal Distribution&lt;/strong&gt;&lt;br&gt;
Before carrying out some statistical tests, it is important to know whether your data fits a normal distribution.&lt;/p&gt;

&lt;p&gt;Normality tests are:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Shapiro-Wilk test&lt;/li&gt;
&lt;li&gt;Kolmogorov-Smirnov test&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Example:&lt;/p&gt;

&lt;p&gt;A data scientist would like to analyze the spending patterns of customers.&lt;/p&gt;

&lt;p&gt;Before conducting a t-test, he/she will determine:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Is the distribution of the customer spending normal?&lt;/li&gt;
&lt;li&gt;If not, a non-parametric test will be carr
ied out.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;&lt;em&gt;Importance of this Test in Data Science:&lt;/em&gt;&lt;/strong&gt;&lt;br&gt;
Helps in:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Determining the appropriate tests to apply&lt;/li&gt;
&lt;li&gt;Understanding the behavior of the data&lt;/li&gt;
&lt;li&gt;Making better assumptions&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;7. Non-Parametric Tests&lt;/strong&gt;&lt;br&gt;
Non-parametric tests are conducted when certain assumptions required for traditional tests do not hold.&lt;/p&gt;

&lt;p&gt;Examples:&lt;br&gt;
&lt;strong&gt;Mann-Whitney U test&lt;/strong&gt;&lt;br&gt;
Alternative to the independent t-test.&lt;/p&gt;

&lt;p&gt;When you compare two groups without assuming a normal distribution.&lt;/p&gt;

&lt;p&gt;Example:&lt;/p&gt;

&lt;p&gt;Comparing the customer satisfaction between two companies.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Wilcoxon Signed-rank test&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Alternative to a paired t-test.&lt;/p&gt;

&lt;p&gt;Example:&lt;/p&gt;

&lt;p&gt;Comparing the customer satisfaction levels before and after service improvement.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Kruskal-Wallis test&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Alternative to ANOVA.&lt;/p&gt;

&lt;p&gt;When you compare three or more groups.&lt;/p&gt;

&lt;p&gt;Example:&lt;/p&gt;

&lt;p&gt;Comparing salaries in different industries.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;8. Runs Test&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Runs test determines if the data is randomly distributed.&lt;/p&gt;

&lt;p&gt;Example:&lt;/p&gt;

&lt;p&gt;An analyst would like to know if there is any pattern in stock prices.&lt;br&gt;
He/She uses the runs test to determine the randomness of data.&lt;/p&gt;

&lt;p&gt;&lt;em&gt;&lt;strong&gt;Importance of this Test in Data Science:&lt;/strong&gt;&lt;/em&gt;&lt;/p&gt;

&lt;p&gt;Applied in:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Time series analysis&lt;/li&gt;
&lt;li&gt;Financial modeling&lt;/li&gt;
&lt;li&gt;Quality control&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;9. Kolmogorov-Smirnov (K-S) Test&lt;/strong&gt;&lt;br&gt;
This test is used to compare the distribution of the data to that of the theoretical distribution.&lt;/p&gt;

&lt;p&gt;Example:&lt;/p&gt;

&lt;p&gt;A data scientist would like to find out:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Is this dataset normally distributed?&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The K-S test measures the difference between the observed and the theoretical distribution.&lt;/p&gt;

&lt;p&gt;&lt;em&gt;Importance:&lt;/em&gt;&lt;br&gt;
Applied in:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Data preprocessing&lt;/li&gt;
&lt;li&gt;Model assumptions&lt;/li&gt;
&lt;li&gt;Dataset comparison&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Examples of Hypothesis Testing in Real Data Science Projects&lt;/strong&gt;&lt;br&gt;
Let's imagine that a company plans to introduce a new mobile application.&lt;/p&gt;

&lt;p&gt;A data scientist can apply:&lt;/p&gt;

&lt;p&gt;&lt;em&gt;T-test&lt;/em&gt;&lt;br&gt;
To test user engagement before and after the app update.&lt;/p&gt;

&lt;p&gt;&lt;em&gt;Chi-square test&lt;/em&gt;&lt;br&gt;
To analyze whether demographic variables influence app usage.&lt;/p&gt;

&lt;p&gt;&lt;em&gt;ANOVA&lt;/em&gt;&lt;br&gt;
To compare the performance of different marketing campaigns.&lt;/p&gt;

&lt;p&gt;&lt;em&gt;Correlation analysis&lt;/em&gt;&lt;br&gt;
To reveal the factors affecting customer retention.&lt;/p&gt;

&lt;p&gt;&lt;em&gt;Normality tests&lt;/em&gt;&lt;br&gt;
To choose the methods for statistical analysis.&lt;/p&gt;

&lt;p&gt;All these tests provide proof for making more informed decisions.&lt;/p&gt;

&lt;h2&gt;
  
  
  Limitations of Hypothesis Testing
&lt;/h2&gt;

&lt;p&gt;Despite the power of hypothesis testing, there are some limitations.&lt;/p&gt;

&lt;p&gt;&lt;em&gt;1. Statistical significance doesn't mean practical significance&lt;/em&gt;&lt;br&gt;
The finding can be statistically significant but have no practical value.&lt;/p&gt;

&lt;p&gt;For example:&lt;br&gt;
The loading time of the website is reduced by 0.2 seconds after an update. The difference can be statistically significant but irrelevant for users.&lt;/p&gt;

&lt;p&gt;&lt;em&gt;2. Big sample sizes can increase the chances of getting statistically significant results&lt;/em&gt;&lt;br&gt;
With millions of observations, even slight differences can become significant.&lt;/p&gt;

&lt;p&gt;&lt;em&gt;3. Results depend on certain assumptions&lt;/em&gt;&lt;br&gt;
Some tests make assumptions about:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Sample size&lt;/li&gt;
&lt;li&gt;Distribution&lt;/li&gt;
&lt;li&gt;Independence of observations&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Conclusion&lt;/strong&gt;&lt;br&gt;
Hypothesis testing is one of the cornerstones of data science as it allows us to base our decisions on proof and not just assumptions.&lt;br&gt;
T-test, Chi-square test, ANOVA, normality test, and non-parametric tests serve different purposes.&lt;br&gt;
A good data scientist is not just able to create models but also understand the statistical background of the data.&lt;br&gt;
By knowing how to conduct hypothesis testing, data scientists can answer questions and prove their findings.&lt;/p&gt;

</description>
      <category>analytics</category>
      <category>data</category>
      <category>datascience</category>
    </item>
    <item>
      <title>Understanding Data Distributions and Their Impact on Data Science</title>
      <dc:creator>Barbara Morara</dc:creator>
      <pubDate>Fri, 24 Jul 2026 15:30:59 +0000</pubDate>
      <link>https://dev.to/moraraba1/understanding-data-distributions-and-their-impact-on-data-science-18m8</link>
      <guid>https://dev.to/moraraba1/understanding-data-distributions-and-their-impact-on-data-science-18m8</guid>
      <description>&lt;p&gt;When you first start learning data science, there are some areas like code, machine learning algorithms, and visualization tools that might draw your attention. However, one thing to note from all of this is data distribution.&lt;/p&gt;

&lt;p&gt;Knowing about the data distribution will help you make informed decisions while cleaning data, visualizing, performing statistical analysis, and training the machine learning algorithm. Prior to training a machine learning algorithm, it is advisable to get acquainted with data distribution.&lt;/p&gt;

&lt;p&gt;In this article, we will be discussing what data distributions are, why are they important, and also how we can visualize them using examples in Python.&lt;/p&gt;

&lt;h2&gt;
  
  
  What It A  Data Distribution?
&lt;/h2&gt;

&lt;p&gt;It is a way through which data in a dataset is described in terms of:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Where the values cluster&lt;/li&gt;
&lt;li&gt;Is it uniformly distributed or not?&lt;/li&gt;
&lt;li&gt;Outliers in the data&lt;/li&gt;
&lt;li&gt;Symmetry in the distribution or skewness in it&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Imagine a class room setting where students write an exam in mathematics. If most of the students have scored between 70 and 80 marks, then the distribution is clustered around these values. Also, if a few students have extremely low or high scores, then the distribution changes.&lt;br&gt;
Getting this insight is crucial for data scientists before analyzing the dataset.&lt;/p&gt;
&lt;h2&gt;
  
  
  Importance of Data Distribution
&lt;/h2&gt;

&lt;p&gt;It is crucial to know data distribution as it will help:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Pick appropriate statistical methods&lt;/li&gt;
&lt;li&gt;Identify outliers&lt;/li&gt;
&lt;li&gt;Manage missing values&lt;/li&gt;
&lt;li&gt;Figure out if data should be transformed&lt;/li&gt;
&lt;li&gt;Use the correct machine learning algorithms&lt;/li&gt;
&lt;li&gt;Boost model performance&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Lack of knowledge about data distribution leads to incorrect results and predictions.&lt;/p&gt;
&lt;h2&gt;
  
  
  Types of Data Distributions
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;1. Normal Distribution&lt;/strong&gt;&lt;br&gt;
Normal distribution is among the most common distributions in statistics.&lt;br&gt;
It is characterized by a bell-shaped graph where:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Values tend to cluster around the center.&lt;/li&gt;
&lt;li&gt;Mean, median, and mode are approximately equal.&lt;/li&gt;
&lt;li&gt;Frequencies decline while moving away from the center.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Some examples include:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Height of people&lt;/li&gt;
&lt;li&gt;IQ score distribution&lt;/li&gt;
&lt;li&gt;Random measurement error&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;2. Skewed Distribution&lt;/strong&gt;&lt;br&gt;
Skewed distribution does not have symmetry.&lt;br&gt;
There are two subtypes:&lt;/p&gt;

&lt;p&gt;&lt;em&gt;Right-Skewed (Positive Skew)&lt;/em&gt;&lt;br&gt;
The majority of values are low while there are a few high values.&lt;br&gt;
Examples:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Income&lt;/li&gt;
&lt;li&gt;Housing prices&lt;/li&gt;
&lt;li&gt;Online spending&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;em&gt;Left-Skewed (Negative Skew)&lt;/em&gt;&lt;br&gt;
Values are mostly high while there are few low values.&lt;br&gt;
Examples:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Exam grade distribution after an easy test&lt;/li&gt;
&lt;li&gt;Consumer satisfaction&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;3. Uniform Distribution&lt;/strong&gt;&lt;br&gt;
A uniform distribution is where all values have the same probability.&lt;br&gt;
Example:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Rolling a dice.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Any number from 1 to 6 is equally likely to show up.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;4. Bimodal Distribution&lt;/strong&gt;&lt;br&gt;
Bimodal distribution has two peaks.&lt;br&gt;
It usually happens in case data is drawn from two populations.&lt;br&gt;
Example:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Height distribution of male and female students.&lt;/li&gt;
&lt;/ul&gt;
&lt;h2&gt;
  
  
  Measuring Distribution with Statistics
&lt;/h2&gt;

&lt;p&gt;Besides visualization, we can summarize distributions using statistical measures.&lt;/p&gt;

&lt;p&gt;&lt;em&gt;&lt;strong&gt;Mean&lt;/strong&gt;&lt;/em&gt;&lt;br&gt;
The average value.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="kn"&gt;import&lt;/span&gt; &lt;span class="n"&gt;numpy&lt;/span&gt; &lt;span class="k"&gt;as&lt;/span&gt; &lt;span class="n"&gt;np&lt;/span&gt;

&lt;span class="n"&gt;data&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="mi"&gt;12&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;15&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;18&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;20&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;25&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;

&lt;span class="nf"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;np&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;mean&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;data&lt;/span&gt;&lt;span class="p"&gt;))&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;&lt;em&gt;&lt;strong&gt;Median&lt;/strong&gt;&lt;/em&gt;&lt;br&gt;
The middle value after sorting the data.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="kn"&gt;import&lt;/span&gt; &lt;span class="n"&gt;numpy&lt;/span&gt; &lt;span class="k"&gt;as&lt;/span&gt; &lt;span class="n"&gt;np&lt;/span&gt;

&lt;span class="n"&gt;data&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="mi"&gt;12&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;15&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;18&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;20&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;25&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;

&lt;span class="nf"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;np&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;median&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;data&lt;/span&gt;&lt;span class="p"&gt;))&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Median comes in handy in the case of outliers since it is not sensitive to extreme data points.&lt;/p&gt;

&lt;p&gt;&lt;em&gt;&lt;strong&gt;Standard Deviation&lt;/strong&gt;&lt;/em&gt;&lt;/p&gt;

&lt;p&gt;Standard deviation shows how much the data is spread out.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="kn"&gt;import&lt;/span&gt; &lt;span class="n"&gt;numpy&lt;/span&gt; &lt;span class="k"&gt;as&lt;/span&gt; &lt;span class="n"&gt;np&lt;/span&gt;

&lt;span class="n"&gt;data&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="mi"&gt;12&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;15&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;18&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;20&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;25&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;

&lt;span class="nf"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;np&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;std&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;data&lt;/span&gt;&lt;span class="p"&gt;))&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Small standard deviation – data points are closely packed together.&lt;br&gt;
Large standard deviation – data points are more spread out from the mean.&lt;/p&gt;

&lt;p&gt;&lt;em&gt;&lt;strong&gt;Skewness Detection&lt;/strong&gt;&lt;/em&gt;&lt;/p&gt;

&lt;p&gt;In Python, Pandas provides an easy way to calculate skewness.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="kn"&gt;import&lt;/span&gt; &lt;span class="n"&gt;pandas&lt;/span&gt; &lt;span class="k"&gt;as&lt;/span&gt; &lt;span class="n"&gt;pd&lt;/span&gt;

&lt;span class="n"&gt;data&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;pd&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nc"&gt;Series&lt;/span&gt;&lt;span class="p"&gt;([&lt;/span&gt;&lt;span class="mi"&gt;2&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;3&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;4&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;5&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;6&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;20&lt;/span&gt;&lt;span class="p"&gt;])&lt;/span&gt;

&lt;span class="nf"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;data&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;skew&lt;/span&gt;&lt;span class="p"&gt;())&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Positive value → Right-skewed&lt;br&gt;
Negative value → Left-skewed&lt;br&gt;
Near zero → Approximately normal&lt;/p&gt;

&lt;h2&gt;
  
  
  Why Data Distribution Is Important for Machine Learning?
&lt;/h2&gt;

&lt;p&gt;Most of the machine learning models work with data which is distributed in a particular way.&lt;/p&gt;

&lt;p&gt;For instance:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Linear regression works better with approximately normally distributed variables.&lt;/li&gt;
&lt;li&gt;Logistic regression is positively influenced by good behavior of input features.&lt;/li&gt;
&lt;li&gt;Naive bayes assumes probability distribution in many cases.&lt;/li&gt;
&lt;li&gt;Some clustering and anomaly detection methods depend on distribution assumptions.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;When your data is highly skewed, model accuracy will likely decrease.&lt;/p&gt;

&lt;h2&gt;
  
  
  Non-Normal Data Handling Techniques
&lt;/h2&gt;

&lt;p&gt;What should be done when your data doesn't follow a normal distribution? Don't panic – here are several options:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Remove or investigate potential outliers.&lt;/li&gt;
&lt;li&gt;Apply transformation – logarithmic, square root, etc.&lt;/li&gt;
&lt;li&gt;Normalize or scale the data.&lt;/li&gt;
&lt;li&gt;Use algorithms which are less sensitive to distribution of data.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The most effective depends on your data and problem to solve.&lt;/p&gt;

&lt;h2&gt;
  
  
  Best Practices
&lt;/h2&gt;

&lt;p&gt;Before implementing a machine learning algorithm, do the following things:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Investigate your data using histograms or box plots.&lt;/li&gt;
&lt;li&gt;Detect skewness and outliers.&lt;/li&gt;
&lt;li&gt;Calculate summary statistics.&lt;/li&gt;
&lt;li&gt;Understand whether your data fulfills the requirements of your model.&lt;/li&gt;
&lt;li&gt;Apply transformations if required&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;It is crucial to have an understanding of how data is distributed for any data scientist. The knowledge allows you to understand better your data set, apply proper statistical methods, and develop machine learning algorithms effectively.&lt;/p&gt;

&lt;p&gt;Always take some time to explore your data before starting with training models. In five minutes, you may get valuable information about your dataset that could remain hidden from you otherwise. "Knowing your data before making your model know it."&lt;/p&gt;

&lt;p&gt;Be it customer analytics, sales forecast, or AI solutions development; understanding data distribution would help you to make better decisions.&lt;/p&gt;

</description>
      <category>data</category>
      <category>datascience</category>
      <category>machinelearning</category>
      <category>python</category>
    </item>
    <item>
      <title>Python and Its Role in Data Analytics</title>
      <dc:creator>Barbara Morara</dc:creator>
      <pubDate>Mon, 25 May 2026 14:20:31 +0000</pubDate>
      <link>https://dev.to/moraraba1/python-and-its-role-in-data-analytics-876</link>
      <guid>https://dev.to/moraraba1/python-and-its-role-in-data-analytics-876</guid>
      <description>&lt;h2&gt;
  
  
  Introduction
&lt;/h2&gt;

&lt;p&gt;Technology has affected the way that both people and organizations make their decisions today. It is common practice for corporations, governmental bodies, schools, hospitals, and even small businesses to use information in understanding the problem and offering an improved service. The process of collecting, cleansing, analyzing, and interpreting data is called data analytics. One of the programming languages that are widely used in this context is Python.&lt;/p&gt;

&lt;p&gt;Python has become one of the essential technologies in the modern world since it is easy to learn, versatile, and highly efficient. Beginners have no difficulties mastering the syntax, while professionals use this language for machine learning, artificial intelligence, automation, and big data analysis. In data analytics, Python is helpful in performing such activities as cleaning raw data, carrying out calculations, generating charts, and making predictions.&lt;/p&gt;

&lt;p&gt;This article provides a brief explanation of what Python is, why it has gained popularity among data analysts, which libraries are employed for analytics, how Python is used in practice, and what benefits can beginners derive from studying this language.&lt;/p&gt;

&lt;h2&gt;
  
  
  What Is Python?
&lt;/h2&gt;

&lt;p&gt;It is a high-level language developed by Guido van Rossum and launched in the year 1991. The language was developed in such a way that it would be easy to learn. As compared to other programming languages that have difficult syntaxes, Python has straightforward commands similar to English.&lt;/p&gt;

&lt;p&gt;For example, printing a message in Python only requires:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="nf"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;Hello World&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Such an easy and flexible language is ideal for beginners learning programming.&lt;/p&gt;

&lt;p&gt;Moreover, Python is an open-source programming language. This means that people can get access to it and install it without paying any fee. It runs on several operating systems such as Windows, Linux, and Mac OS. The versatility of Python has enabled it to be applied in the following fields:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Web development&lt;/li&gt;
&lt;li&gt;Data analytics&lt;/li&gt;
&lt;li&gt;Artificial intelligence&lt;/li&gt;
&lt;li&gt;Machine learning&lt;/li&gt;
&lt;li&gt;Cybersecurity&lt;/li&gt;
&lt;li&gt;Automation&lt;/li&gt;
&lt;li&gt;Scientific computing&lt;/li&gt;
&lt;li&gt;Software development&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;From among the above applications, it is worth noting that one area that has seen Python gain immense popularity is data analytics.&lt;/p&gt;

&lt;h2&gt;
  
  
  Understanding Data Analytics
&lt;/h2&gt;

&lt;p&gt;Before getting into the use of Python in analytics, it is necessary to know the concept of data analytics.&lt;/p&gt;

&lt;p&gt;Data analytics can be understood as the activity of analyzing data in order to uncover some patterns, trends, and useful information. Various organizations have a lot of data available every day. For instance:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Banks get customer transaction data.&lt;/li&gt;
&lt;li&gt;Hospitals maintain patient data.&lt;/li&gt;
&lt;li&gt;Schools have data about student performance.&lt;/li&gt;
&lt;li&gt;Social media maintains data related to interactions between users.&lt;/li&gt;
&lt;li&gt;Retail stores maintain sales data.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Raw data itself is not valuable unless analyzed properly through data analytics. Some of the questions that organizations ask by using data analytics include:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Which products are sold the most?&lt;/li&gt;
&lt;li&gt;What leads to customer complaints?&lt;/li&gt;
&lt;li&gt;Which marketing method should be followed?&lt;/li&gt;
&lt;li&gt;How should costs be minimized?&lt;/li&gt;
&lt;li&gt;What will be the future trends?&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;These tasks can be done effectively using Python.&lt;/p&gt;

&lt;h2&gt;
  
  
  Why Python Is Popular in Data Analytics
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;1. Easy to Learn and Use&lt;/strong&gt;&lt;br&gt;
Firstly, another important reason for the popularity of Python is its simplicity. Python language offers clear syntax that is easy to learn. Even beginners can easily learn Python programming without much knowledge of computer science.&lt;/p&gt;

&lt;p&gt;Python is a language that does not require many lines of codes to perform tasks. This helps save time and simplifies things.&lt;/p&gt;

&lt;p&gt;For example:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="n"&gt;numbers&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="mi"&gt;1&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;2&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;3&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;4&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;5&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;
&lt;span class="nf"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="nf"&gt;sum&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;numbers&lt;/span&gt;&lt;span class="p"&gt;))&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;The code above calculates the sum of numbers in a simple way.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;2. Large Collection of Libraries&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A lot of libraries exist in Python that make data analysis simpler. A library can be described as pre-written code by programmers which enables other programmers to perform tasks faster.&lt;/p&gt;

&lt;p&gt;Some well-known libraries for data analytics in Python include:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Pandas&lt;/li&gt;
&lt;li&gt;NumPy&lt;/li&gt;
&lt;li&gt;Matplotlib&lt;/li&gt;
&lt;li&gt;Seaborn&lt;/li&gt;
&lt;li&gt;Scikit-learn&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;3. Big Community Support&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;There is a big global community of Python developers and data analysts. That means when you start to learn this programming language, you can find many tutorials, videos, forums, and documents online.&lt;/p&gt;

&lt;p&gt;If you experience any issues while writing your code, there is a high probability that someone else has already found a solution and posted it online.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;4. Integrations With Other Technologies&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;It allows integration with databases, APIs, cloud platforms, and web services. That makes Python useful for modern systems for working with data.&lt;/p&gt;

&lt;p&gt;For instance, Python can be connected to:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;MySQL databases&lt;/li&gt;
&lt;li&gt;Excel spreadsheets&lt;/li&gt;
&lt;li&gt;JSON APIs&lt;/li&gt;
&lt;li&gt;web applications&lt;/li&gt;
&lt;li&gt;Machine learning systems&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;5. Perfect Visualization Capabilities&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;It is important to visualize your data because charts and graphs allow you to interpret information quickly. Python offers perfect visualization capabilities which allow you to generate:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Bar charts&lt;/li&gt;
&lt;li&gt;Pie charts&lt;/li&gt;
&lt;li&gt;Histograms&lt;/li&gt;
&lt;li&gt;Scatter plots&lt;/li&gt;
&lt;li&gt;Heat maps&lt;/li&gt;
&lt;li&gt;Dashboards&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Python Libraries Used in Data Analytics
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;1.Pandas&lt;/strong&gt;&lt;br&gt;
Pandas library is among the most significant libraries in Python for data analysis. It facilitates easy data analysis using tabular data known as DataFrames.&lt;/p&gt;

&lt;p&gt;With Pandas, analysts can:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Read CSV and JSON files&lt;/li&gt;
&lt;li&gt;Clean data&lt;/li&gt;
&lt;li&gt;Remove duplicates&lt;/li&gt;
&lt;li&gt;Filter rows&lt;/li&gt;
&lt;li&gt;Sort values&lt;/li&gt;
&lt;li&gt;Calculate statistics&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Example:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="kn"&gt;import&lt;/span&gt; &lt;span class="n"&gt;pandas&lt;/span&gt; &lt;span class="k"&gt;as&lt;/span&gt; &lt;span class="n"&gt;pd&lt;/span&gt;

&lt;span class="n"&gt;data&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;pd&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;read_csv&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;sales.csv&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="nf"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;data&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;head&lt;/span&gt;&lt;span class="p"&gt;())&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;This code reads a CSV file and displays the first rows.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;2. NumPy&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;NumPy is a library that deals with numerics and mathematics. It handles arrays and matrices.&lt;/p&gt;

&lt;p&gt;Functions of NumPy by analysts include:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Mathematical computations&lt;/li&gt;
&lt;li&gt;Statistical computations&lt;/li&gt;
&lt;li&gt;Analysis of large datasets&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Example:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="kn"&gt;import&lt;/span&gt; &lt;span class="n"&gt;numpy&lt;/span&gt; &lt;span class="k"&gt;as&lt;/span&gt; &lt;span class="n"&gt;np&lt;/span&gt;

&lt;span class="n"&gt;numbers&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;np&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;array&lt;/span&gt;&lt;span class="p"&gt;([&lt;/span&gt;&lt;span class="mi"&gt;10&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;20&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;30&lt;/span&gt;&lt;span class="p"&gt;])&lt;/span&gt;
&lt;span class="nf"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;numbers&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;mean&lt;/span&gt;&lt;span class="p"&gt;())&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;&lt;strong&gt;3. Matplotlib&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Matplotlib is used for creating charts and graphs.&lt;/p&gt;

&lt;p&gt;Example:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="kn"&gt;import&lt;/span&gt; &lt;span class="n"&gt;matplotlib.pyplot&lt;/span&gt; &lt;span class="k"&gt;as&lt;/span&gt; &lt;span class="n"&gt;plt&lt;/span&gt;

&lt;span class="n"&gt;x&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="mi"&gt;1&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="mi"&gt;2&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="mi"&gt;3&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;
&lt;span class="n"&gt;y&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="mi"&gt;4&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="mi"&gt;5&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="mi"&gt;6&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;

&lt;span class="n"&gt;plt&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;plot&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;x&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="n"&gt;y&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="n"&gt;plt&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;show&lt;/span&gt;&lt;span class="p"&gt;()&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;This creates a simple line graph.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;4. Seaborn&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Seaborn is built on top of Matplotlib and produces appealing statistical graphics.&lt;/p&gt;

&lt;p&gt;Some common uses include:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Heat maps&lt;/li&gt;
&lt;li&gt;Correlation graphs&lt;/li&gt;
&lt;li&gt;Distribution graphics&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;5. Scikit-Learn&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Scikit-Learn is used for machine learning and predictive analysis.&lt;/p&gt;

&lt;p&gt;It enables analysts to:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Construct predictive models&lt;/li&gt;
&lt;li&gt;Categorize data&lt;/li&gt;
&lt;li&gt;Identify patterns&lt;/li&gt;
&lt;li&gt;Conduct regression analysis&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Uses of Python in Data Analytics
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;1. Data Collection&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;The first step in any data analytics process is collecting data. In Python, we can get data from the following sources:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Websites&lt;/li&gt;
&lt;li&gt;APIs&lt;/li&gt;
&lt;li&gt;Database&lt;/li&gt;
&lt;li&gt;CSV Files&lt;/li&gt;
&lt;li&gt;Excel Spreadsheets&lt;/li&gt;
&lt;li&gt;JSON Files&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;For instance, data is retrieved from APIs using the requests module.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="kn"&gt;import&lt;/span&gt; &lt;span class="n"&gt;requests&lt;/span&gt;

&lt;span class="n"&gt;response&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;requests&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;get&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;https://dummyjson.com/products&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="n"&gt;data&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;response&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;json&lt;/span&gt;&lt;span class="p"&gt;()&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;&lt;strong&gt;2. Data Cleaning&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Raw data may have some errors or missing information including:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Missing data&lt;/li&gt;
&lt;li&gt;Duplicate data&lt;/li&gt;
&lt;li&gt;Inaccurate data&lt;/li&gt;
&lt;li&gt;Formatting problems&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Pandas in Python makes data cleaning easy.&lt;/p&gt;

&lt;p&gt;Example&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="n"&gt;data&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;drop_duplicates&lt;/span&gt;&lt;span class="p"&gt;()&lt;/span&gt;
&lt;span class="n"&gt;data&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;fillna&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="mi"&gt;0&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Data cleaning enhances accuracy in data analysis.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;3. Data Analysis&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Data analysis involves finding patterns from the cleaned data by analysts.&lt;/p&gt;

&lt;p&gt;Python can compute:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Averages&lt;/li&gt;
&lt;li&gt;Percentages&lt;/li&gt;
&lt;li&gt;Correlation&lt;/li&gt;
&lt;li&gt;Trends&lt;/li&gt;
&lt;li&gt;Rates of growth&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Example&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="n"&gt;data&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;sales&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;].&lt;/span&gt;&lt;span class="nf"&gt;mean&lt;/span&gt;&lt;span class="p"&gt;()&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;&lt;strong&gt;4. Data Visualization&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Visualization aids in clear communication of findings.&lt;/p&gt;

&lt;p&gt;Charts that can be created using Python include:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Sales trend analysis over time&lt;/li&gt;
&lt;li&gt;Demographics of customers&lt;/li&gt;
&lt;li&gt;Product performance graphs&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Example:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="n"&gt;plt&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;bar&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;products&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;sales&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;&lt;strong&gt;5. Predictive Analytics&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Additionally, Python is used to predict possible outcomes through machine learning.&lt;/p&gt;

&lt;p&gt;These include:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Prediction of customer behavior&lt;/li&gt;
&lt;li&gt;Sales forecasts&lt;/li&gt;
&lt;li&gt;Detection of fraud&lt;/li&gt;
&lt;li&gt;Prediction of diseases
The algorithms are trained using previous datasets and patterns.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Uses of Python in Data Analytics in the Real World
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;1. Healthcare&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Hospitals use Python to analyze their patient records to enhance the delivery of health services.&lt;/p&gt;

&lt;p&gt;These uses include:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Disease prediction&lt;/li&gt;
&lt;li&gt;Analysis of medical images&lt;/li&gt;
&lt;li&gt;Patient monitoring&lt;/li&gt;
&lt;li&gt;Pharmaceutical research&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;For instance, disease trends can be identified from patient records.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;2. Banking and Financial Services&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Python is used by banks to:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Detect fraud&lt;/li&gt;
&lt;li&gt;Transaction analysis&lt;/li&gt;
&lt;li&gt;Risk prediction&lt;/li&gt;
&lt;li&gt;Automate reporting tasks&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Institutions use Python in decision making as well as security.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;3. E-Commerce&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;E-commerce stores analyze their customers' behavior using Python.&lt;/p&gt;

&lt;p&gt;These include:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Product recommendations&lt;/li&gt;
&lt;li&gt;Sales analysis&lt;/li&gt;
&lt;li&gt;Customer profiling&lt;/li&gt;
&lt;li&gt;Stock management&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Firms such as Amazon use the data for product recommendations.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;4. Social Media&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Social media firms conduct user engagement analysis.&lt;/p&gt;

&lt;p&gt;Data analysis enables these companies to:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Understand user interests&lt;/li&gt;
&lt;li&gt;Trends in different social media platforms&lt;/li&gt;
&lt;li&gt;Advertising effects&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;5. Education&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Educational institutions use the data to keep track of student progress.&lt;/p&gt;

&lt;p&gt;Python helps educational institutions:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Find out poor performers&lt;/li&gt;
&lt;li&gt;Enhance learning&lt;/li&gt;
&lt;li&gt;Attendance analysis&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Reasons Why Beginners Should Learn Python
&lt;/h2&gt;

&lt;p&gt;&lt;em&gt;1. Very High in Demand in The Job Market&lt;/em&gt;&lt;/p&gt;

&lt;p&gt;Skills of using Python are in high demand globally. Most employers seek individuals familiar with Python and data analytics.&lt;/p&gt;

&lt;p&gt;Career pathways that one can pursue include being:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Data Analyst&lt;/li&gt;
&lt;li&gt;Data Scientist&lt;/li&gt;
&lt;li&gt;Machine Learning Engineer&lt;/li&gt;
&lt;li&gt;Business Analyst&lt;/li&gt;
&lt;li&gt;Software Developer&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;em&gt;2. Easier to Learn than Other Programming Languages&lt;/em&gt;&lt;br&gt;
Python programming language is easy for beginners to learn.&lt;/p&gt;

&lt;p&gt;&lt;em&gt;3. Flexibility&lt;/em&gt;&lt;/p&gt;

&lt;p&gt;Knowing Python makes an individual flexible in choosing different career paths since after gaining knowledge in analytics, one can explore into:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Artificial intelligence&lt;/li&gt;
&lt;li&gt;Web Development&lt;/li&gt;
&lt;li&gt;Cybersecurity&lt;/li&gt;
&lt;li&gt;Automation&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;em&gt;4. Rich Learning Materials Available&lt;/em&gt;&lt;br&gt;
There is plenty of material to help one master Python programming, including:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Tutorial websites&lt;/li&gt;
&lt;li&gt;YouTube videos&lt;/li&gt;
&lt;li&gt;Online documentation&lt;/li&gt;
&lt;li&gt;Online course materials&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;This material is readily available online for no cost.&lt;/p&gt;

&lt;p&gt;&lt;em&gt;5. Enhances Problem Solving Skills&lt;/em&gt;&lt;br&gt;
Python encourages learners to be analytical in their problem-solving skills.&lt;/p&gt;

&lt;h2&gt;
  
  
  Challenges Associated with the Use of Python in Data Analytics
&lt;/h2&gt;

&lt;p&gt;Despite its numerous benefits, Python still poses challenges when used in data analytics, including:&lt;/p&gt;

&lt;p&gt;&lt;em&gt;1. Python is Slower than Other Languages&lt;/em&gt;&lt;br&gt;
Python is slow compared to other programming languages because Python uses interpretation instead of compilation.&lt;/p&gt;

&lt;p&gt;&lt;em&gt;2. Consumes Large Amount of Memory&lt;/em&gt;&lt;br&gt;
Handling large data sets in Python requires huge storage space.&lt;/p&gt;

&lt;p&gt;&lt;em&gt;3. Complex to Work With when Handling Large Projects&lt;/em&gt;&lt;br&gt;
While easy for beginners to work with, Python is relatively complex when handling large projects.&lt;/p&gt;

&lt;h2&gt;
  
  
  Future of Python in Data Analytics
&lt;/h2&gt;

&lt;p&gt;The future for python programming language is bright as companies keep producing lots of data that require analytics tools.&lt;/p&gt;

&lt;p&gt;Some factors that will keep making Python vital include:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Rapid advancement of artificial intelligence&lt;/li&gt;
&lt;li&gt;Development of big data technology&lt;/li&gt;
&lt;li&gt;Increased automation activities&lt;/li&gt;
&lt;li&gt;High demand for machine learning solutions&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Most universities currently incorporate Python in their curriculum.&lt;/p&gt;

&lt;h2&gt;
  
  
  Conclusion
&lt;/h2&gt;

&lt;p&gt;Python is one of the most effective programming languages utilized in data analysis. It is not only a user-friendly and flexible tool but also has an impressive library base.&lt;/p&gt;

&lt;p&gt;Python can help an analyst perform all steps associated with data management effectively and easily. With the use of various libraries like pandas, NumPy, and Matplotlib, data analysis becomes much more efficient.&lt;/p&gt;

&lt;p&gt;The use of Python in healthcare, financial institutions, educational facilities, and other areas helps companies make better decisions on the basis of collected information. This language will remain crucial in the development of the field under changing technologies.&lt;/p&gt;

&lt;p&gt;For beginners who are interested in technology, data analysis and problem solving, Python is a great choice.&lt;/p&gt;

</description>
      <category>analytics</category>
      <category>datascience</category>
      <category>programming</category>
      <category>python</category>
    </item>
    <item>
      <title>Connecting Power BI to a SQL Database: A Complete Guide</title>
      <dc:creator>Barbara Morara</dc:creator>
      <pubDate>Wed, 08 Apr 2026 19:36:46 +0000</pubDate>
      <link>https://dev.to/moraraba1/connecting-power-bi-to-a-sql-database-a-complete-guide-1h43</link>
      <guid>https://dev.to/moraraba1/connecting-power-bi-to-a-sql-database-a-complete-guide-1h43</guid>
      <description>&lt;h2&gt;
  
  
  Introduction
&lt;/h2&gt;

&lt;p&gt;Microsoft Power BI is a software for performing business intelligence analysis and generating data visualizations for making decisions. The software can be used for building interactive reports and dashboards.&lt;/p&gt;

&lt;p&gt;Modern enterprises use databases for storing their structured information. PostgreSQL is one of the popular SQL databases used to store data. SQL databases are necessary as they enable efficient storage and management of information.&lt;/p&gt;

&lt;p&gt;An organization can use Power BI to connect to its database in order to:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Use real-time data&lt;/li&gt;
&lt;li&gt;Undertake more complex analysis&lt;/li&gt;
&lt;li&gt;Make dashboards automatically&lt;/li&gt;
&lt;li&gt;Make strategic decisions
Storing data is only half the task; Power BI will help you make useful decisions out of it.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Connecting Power BI with a PostgreSQL Database Running Locally
&lt;/h2&gt;

&lt;p&gt;Connecting Power BI with a local PostgreSQL database is easy and can be achieved in just a few simple steps.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Step 1: Launch Power BI Desktop&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Open Power BI Desktop from your PC.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Step 2: Select “Get Data”&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Click on Get Data from the Home tab.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Step 3: Select PostgreSQL Database&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Select PostgreSQL database from the list of data connectors.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fa8my51zkbrkavahvc6dm.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fa8my51zkbrkavahvc6dm.png" alt=" " width="598" height="658"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Step 4: Connection Details&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Here a pop-up window opens where you will fill in the following details:&lt;/p&gt;

&lt;p&gt;Server: example- localhost&lt;br&gt;
Database: enter the name of your database&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Step 5: Connection Modes&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;You will be able to choose one of the two modes below:&lt;/p&gt;

&lt;p&gt;Import (importing data into Power BI)&lt;br&gt;
DirectQuery (querying data)&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Step 6: Login Details&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Enter your PostgreSQL:&lt;/p&gt;

&lt;p&gt;Username&lt;br&gt;
Password&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Step 7: Load Data&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Following successful login:&lt;br&gt;
Navigator pop-up will open&lt;br&gt;
Choose the required table(s)&lt;/p&gt;

&lt;p&gt;Click “Load”&lt;/p&gt;

&lt;p&gt;Your PostgreSQL data is now loaded into Power BI.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2F19uhrboch8c8v7xsjwf8.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2F19uhrboch8c8v7xsjwf8.png" alt=" " width="800" height="450"&gt;&lt;/a&gt; &lt;/p&gt;

&lt;h2&gt;
  
  
  Connecting Power BI to a Cloud Database (Aiven PostgreSQL)
&lt;/h2&gt;

&lt;p&gt;Cloud databases such as Aiven PostgreSQL have further steps involved.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Step 1: Get Connection Information from Aiven&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Information to gather from your Aiven console include:&lt;/p&gt;

&lt;p&gt;Host (server name)&lt;br&gt;
Port (eg;5432)&lt;br&gt;
Name of the database&lt;br&gt;
Username&lt;br&gt;
Password&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Step 2: Download SSL Certificate&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;As Aiven insists on secure connections, it will be necessary to download the SSL certificate found in the console.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Step 3: Connect Power BI&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;In Power BI:&lt;/p&gt;

&lt;p&gt;Go to Get Data &amp;gt; PostgreSQL database&lt;br&gt;
Add:&lt;br&gt;
Server: host:port&lt;br&gt;
Database name&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Step 4: Set up SSL&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Make an encrypted connection&lt;br&gt;
Supply the SSL certificate if needed&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Ff8nsgz7hhrmr898e18cg.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Ff8nsgz7hhrmr898e18cg.png" alt=" " width="592" height="481"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Ftalku8w1bcuhru67apjo.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Ftalku8w1bcuhru67apjo.png" alt=" " width="786" height="638"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Importance of SSL&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;SSL certificates provide:&lt;/p&gt;

&lt;p&gt;Encryption of data in transit&lt;br&gt;
Prevention of interceptions&lt;br&gt;
Authentication of clients and servers&lt;/p&gt;

&lt;p&gt;Without SSL, sensitive business information might get intercepted while in transit.&lt;/p&gt;

&lt;h2&gt;
  
  
  Loading and Data Modeling in Power BI
&lt;/h2&gt;

&lt;p&gt;Once your connection is set up, you can load tables such as:&lt;/p&gt;

&lt;p&gt;Customers table&lt;br&gt;
Products table&lt;br&gt;
Sales table&lt;br&gt;
Inventory table&lt;/p&gt;

&lt;p&gt;After that, Power BI identifies the relationships, but you can define them manually.&lt;/p&gt;

&lt;h2&gt;
  
  
  Creating Relationships
&lt;/h2&gt;

&lt;p&gt;The most common relationships include:&lt;/p&gt;

&lt;p&gt;Customers table → Sales table (Customer ID)&lt;br&gt;
Products table → Sales table (Product ID)&lt;br&gt;
Products table → Inventory table (Product ID)&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Concepts of Data Modeling&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Data modeling helps organize tables to enable Power BI to analyze data accurately:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Primary keys uniquely identify each row&lt;/li&gt;
&lt;li&gt;Foreign keys connect different tables&lt;/li&gt;
&lt;li&gt;Establishing relationships ensures proper aggregation and filtering of data&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;For instance:&lt;/p&gt;

&lt;p&gt;A sales report can properly aggregate revenue by customer&lt;br&gt;
An inventory report can relate inventory information to sales&lt;/p&gt;

&lt;p&gt;Data modeling enhances:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Performance&lt;/li&gt;
&lt;li&gt;Accuracy&lt;/li&gt;
&lt;li&gt;Usability of reports&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Conclusion: The Importance of SQL for Power BI Analysts&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;SQL skills are crucial for all Power BI analysts. Although Power BI comes with robust visualization features, SQL allows users to effectively interact with data sources.&lt;/p&gt;

&lt;p&gt;Through SQL, analysts will be able to:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Query for the datasets they need&lt;/li&gt;
&lt;li&gt;Filter the data&lt;/li&gt;
&lt;li&gt;Perform aggregations such as SUM, COUNT, AVG&lt;/li&gt;
&lt;li&gt;Combine multiple tables&lt;/li&gt;
&lt;li&gt;Generate clean datasets prior to visualization&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Using SQL together with Power BI in practical applications helps generate faster, accurate, and scalable reports.&lt;/p&gt;

&lt;p&gt;Connecting Power BI to SQL databases such as PostgreSQL, whether hosted locally or in the cloud, maximizes the capabilities of data analysis. Through this knowledge on how to connect, secure the connection using SSL, and model data, analysts can gain valuable insights from data.&lt;/p&gt;

</description>
      <category>database</category>
      <category>microsoft</category>
      <category>sql</category>
      <category>tutorial</category>
    </item>
    <item>
      <title>Understanding Joins and Window Functions in SQL</title>
      <dc:creator>Barbara Morara</dc:creator>
      <pubDate>Mon, 02 Mar 2026 19:44:09 +0000</pubDate>
      <link>https://dev.to/moraraba1/understanding-joins-and-window-functions-in-sql-10b9</link>
      <guid>https://dev.to/moraraba1/understanding-joins-and-window-functions-in-sql-10b9</guid>
      <description>&lt;p&gt;Two of the most powerful SQL concepts a data person, like a data analyst or a backend developer, will use are "Joins" and "Window Functions." "Joins" are used to combine data from multiple tables, and "Window Functions" are used to perform complex calculations on related rows of data without aggregating the results.&lt;/p&gt;

&lt;p&gt;In this article, I will explain what "Joins" and "Window Functions" are, along with examples, in a very simple way.&lt;/p&gt;

&lt;h2&gt;
  
  
  Part 1: SQL Join
&lt;/h2&gt;

&lt;p&gt;In relational databases, data is often stored in multiple tables. For example, you might have:&lt;br&gt;
    • customers table&lt;br&gt;
    • orders table&lt;/p&gt;

&lt;p&gt;Each table stores different information, but they are connected using a common key like customer_id.&lt;/p&gt;

&lt;h2&gt;
  
  
  What Is a Join?
&lt;/h2&gt;

&lt;p&gt;A JOIN combines rows from two or more tables based on a related column.&lt;/p&gt;

&lt;p&gt;Think of it like matching records from one Excel sheet to another using a common ID&lt;/p&gt;

&lt;h2&gt;
  
  
  Types of Joins
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;1. INNER JOIN&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Returns only the matching records in both tables.&lt;br&gt;
&lt;code&gt;SELECT &lt;br&gt;
     c.customer_id,&lt;br&gt;
     c.name,&lt;br&gt;
     o.order_id,&lt;br&gt;
     o.order_date&lt;br&gt;
FROM customers c&lt;br&gt;
INNER JOIN orders o&lt;br&gt;
   ON c.customer_id=o.customer_id;&lt;/code&gt;&lt;/p&gt;

&lt;p&gt;This query returns customers who have placed orders.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;2. LEFT JOIN&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Returns all records from the left table and matching records from the right table. If there is no match, NULL values appear.&lt;/p&gt;

&lt;p&gt;&lt;code&gt;SELECT &lt;br&gt;
    c.customer_id,&lt;br&gt;
    c.name,&lt;br&gt;
    o.order_id&lt;br&gt;
FROM customers c&lt;br&gt;
LEFT JOIN orders o&lt;br&gt;
    ON c.customer_id = o.customer_id;&lt;/code&gt;&lt;/p&gt;

&lt;p&gt;This shows all customers, even those who haven’t placed any orders.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;3. RIGHT JOIN&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Returns all records from the right table and matching ones from the left.&lt;/p&gt;

&lt;p&gt;&lt;code&gt;SELECT &lt;br&gt;
    c.customer_id,&lt;br&gt;
    c.name,&lt;br&gt;
    o.order_id&lt;br&gt;
FROM customers c&lt;br&gt;
RIGHT JOIN orders o&lt;br&gt;
    ON c.customer_id = o.customer_id;&lt;/code&gt;&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;4. FULL OUTER JOIN&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Returns all records from both tables, whether they match or not.&lt;/p&gt;

&lt;p&gt;&lt;code&gt;SELECT &lt;br&gt;
    c.customer_id,&lt;br&gt;
    c.name,&lt;br&gt;
    o.order_id&lt;br&gt;
FROM customers c&lt;br&gt;
FULL OUTER JOIN orders o&lt;br&gt;
    ON c.customer_id = o.customer_id;&lt;/code&gt;&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;How I Understand Joins&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Joins are about relationships.&lt;br&gt;
If two tables share a key, a join lets you bring their data together into one meaningful result.&lt;/p&gt;

&lt;p&gt;Without joins, working with relational databases would be extremely limited.&lt;/p&gt;

&lt;h2&gt;
  
  
  Part 2: Window Functions
&lt;/h2&gt;

&lt;p&gt;Window functions are more advanced and extremely powerful.&lt;/p&gt;

&lt;p&gt;Unlike GROUP BY, window functions do not collapse rows. Instead, they perform calculations across a set of rows related to the current row.&lt;/p&gt;

&lt;p&gt;That “set of rows” is called a window.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Basic Syntax&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;&lt;code&gt;FUNCTION_NAME() OVER (&lt;br&gt;
    PARTITION BY column&lt;br&gt;
    ORDER BY column&lt;br&gt;
)&lt;/code&gt;&lt;/p&gt;

&lt;p&gt;•PARTITION BY → splits data into groups&lt;br&gt;
•ORDER BY → defines row order inside each group&lt;/p&gt;

&lt;h2&gt;
  
  
  Common Window Functions
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;1. ROW_NUMBER()&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Assigns a unique number to each row.&lt;br&gt;
&lt;code&gt;SELECT &lt;br&gt;
    customer_id,&lt;br&gt;
    order_id,&lt;br&gt;
    ROW_NUMBER() OVER (&lt;br&gt;
        PARTITION BY customer_id&lt;br&gt;
        ORDER BY order_date DESC&lt;br&gt;
    ) AS row_num&lt;br&gt;
FROM orders;&lt;/code&gt;&lt;/p&gt;

&lt;p&gt;This ranks each customer’s orders from newest to oldest.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;2. RANK()&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Assigns ranking, but allows ties.&lt;/p&gt;

&lt;p&gt;&lt;code&gt;SELECT &lt;br&gt;
    product_id,&lt;br&gt;
    revenue,&lt;br&gt;
    RANK() OVER (&lt;br&gt;
        ORDER BY revenue DESC&lt;br&gt;
    ) AS revenue_rank&lt;br&gt;
FROM products;&lt;/code&gt;&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;3. SUM() as a Window Function&lt;/strong&gt;&lt;br&gt;
&lt;code&gt;SELECT &lt;br&gt;
    customer_id,&lt;br&gt;
    order_date,&lt;br&gt;
    amount,&lt;br&gt;
    SUM(amount) OVER (&lt;br&gt;
        PARTITION BY customer_id&lt;br&gt;
        ORDER BY order_date&lt;br&gt;
    ) AS running_total&lt;br&gt;
FROM orders;&lt;/code&gt;&lt;/p&gt;

&lt;p&gt;This calculates a running total per customer.&lt;/p&gt;

&lt;h2&gt;
  
  
  GROUP BY vs Window Functions
&lt;/h2&gt;

&lt;p&gt;GROUP BY reduces rows.&lt;br&gt;
Window functions keep all rows and add calculated columns.&lt;/p&gt;

&lt;p&gt;Example using GROUP BY:&lt;br&gt;
&lt;code&gt;SELECT &lt;br&gt;
    customer_id,&lt;br&gt;
    SUM(amount) AS total_spent&lt;br&gt;
FROM orders&lt;br&gt;
GROUP BY customer_id;&lt;/code&gt;&lt;/p&gt;

&lt;p&gt;Example using Window Function:&lt;br&gt;
&lt;code&gt;SELECT &lt;br&gt;
    customer_id,&lt;br&gt;
    amount,&lt;br&gt;
    SUM(amount) OVER (PARTITION BY customer_id) AS total_spent&lt;br&gt;
FROM orders;&lt;/code&gt;&lt;/p&gt;

&lt;p&gt;The second query keeps each order visible while still showing total spent.&lt;/p&gt;

&lt;h2&gt;
  
  
  Why Joins and Window Functions Matter
&lt;/h2&gt;

&lt;p&gt;If you’re working in analytics (Power BI, Excel, SQL Server, PostgreSQL, etc.), these two skills are essential:&lt;br&gt;
•Joins help you combine datasets.&lt;br&gt;
•Window functions help you analyze patterns within those datasets.&lt;/p&gt;

&lt;p&gt;In real-world analysis:&lt;br&gt;
•You join sales with customers.&lt;br&gt;
•You calculate rankings.&lt;br&gt;
•You create running totals.&lt;br&gt;
•You detect duplicates.&lt;br&gt;
•You identify top-performing products.&lt;/p&gt;

&lt;p&gt;These are daily tasks for data analysts and backend engineers.&lt;/p&gt;

&lt;h2&gt;
  
  
  Summary of Key Points
&lt;/h2&gt;

&lt;p&gt;1.Joins combine data from multiple tables using related columns.&lt;br&gt;
2.INNER JOIN returns matching records only.&lt;br&gt;
3.LEFT JOIN keeps all records from the left table.&lt;br&gt;
4.Window functions perform calculations without grouping rows.&lt;br&gt;
5.PARTITION BY divides data into logical groups.&lt;br&gt;
6.Window functions are powerful for ranking, running totals, and advanced analytics.&lt;/p&gt;

&lt;p&gt;If you truly understand Joins and Window Functions, you’ve crossed an important milestone in SQL mastery.&lt;/p&gt;

&lt;p&gt;Joins teach you how data connects.&lt;br&gt;
Window functions teach you how data behaves.&lt;/p&gt;

&lt;p&gt;Master both — and you unlock advanced analytics capabilities that tools like Power BI and Tableau rely on under the hood.&lt;/p&gt;

</description>
      <category>beginners</category>
      <category>database</category>
      <category>sql</category>
      <category>tutorial</category>
    </item>
    <item>
      <title>How Analysts Translate Messy Data, DAX, and Dashboards into Action Using Power BI</title>
      <dc:creator>Barbara Morara</dc:creator>
      <pubDate>Mon, 09 Feb 2026 11:33:00 +0000</pubDate>
      <link>https://dev.to/moraraba1/how-analysts-translate-messy-data-dax-and-dashboards-into-action-using-power-bi-2ahn</link>
      <guid>https://dev.to/moraraba1/how-analysts-translate-messy-data-dax-and-dashboards-into-action-using-power-bi-2ahn</guid>
      <description>&lt;p&gt;In today’s information-driven world, lack of information is not what hurts the organization; what hurts the organization is how it interprets the information it has. As discussed, raw data is incomplete, inconsistent, and scattered across many sources, and here is where Power BI analysts come in.&lt;/p&gt;

&lt;p&gt;While it is a visualization tool, it is more than that. Used well, Power BI is a decision-making machine that turns chaotic data into insights that leaders can act upon. In a sense, this article is a presentation of how analysts can use data cleaning, data analysis expression, and data visualization to drive business decisions.&lt;/p&gt;

&lt;h2&gt;
  
  
  1. From Messy Data to Reliable Information
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;Reality of Raw Data&lt;/strong&gt;: &lt;br&gt;
In actual businesses, data is never clean:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Missing Values&lt;/li&gt;
&lt;li&gt;Similar Records&lt;/li&gt;
&lt;li&gt;Misdated Information&lt;/li&gt;
&lt;li&gt;Inconsistent use of names (e.g. "Nairobi", "NRB","Nai")&lt;/li&gt;
&lt;li&gt;Negative Prices/Unrealistic Discounts&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;If this data is analyzed without cleaning, decisions made from the analysis will be wrong.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;How analysts utilize Power BI to remedy this problem&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Analysts can leverage Power Query for:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Remove Duplicates and Errors&lt;/li&gt;
&lt;li&gt;Handle missing values logically&lt;/li&gt;
&lt;li&gt;Standardized Columns &amp;amp; Formats&lt;/li&gt;
&lt;li&gt;Merge data from various sources (e.g., Excel, database, API)
&lt;strong&gt;Business Impact&lt;/strong&gt;: Clean data helps to promote trust. Managerial decisions are easier to make with accurate reports.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  2. Converting Data to Meaning with DAX
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;What is DAX really used for?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;DAX, or Data Analysis Expressions, is less about complex formula writing and more about the articulation of business logic.&lt;br&gt;
Analysts use DAX to answer questions like the following:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;What are total sales this month vs. last month?&lt;/li&gt;
&lt;li&gt;Which are the growing and which are the declining products?&lt;/li&gt;
&lt;li&gt;What is the average time of delivery?&lt;/li&gt;
&lt;li&gt;Do discounts affect the profit?&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Example of business logic with DAX&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Instead of just showing the numbers of sales, analysts produce:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;YTD Sales&lt;/li&gt;
&lt;li&gt;Profit margins&lt;/li&gt;
&lt;li&gt;Percentages of growth&lt;/li&gt;
&lt;li&gt;Performance rankings&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Business impacts&lt;/strong&gt;: DAX changes raw numbers into KPIs, which are understood and used by the executives.&lt;/p&gt;

&lt;h2&gt;
  
  
  3. Dashboards that Tell a Story, Not Just Show Charts
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;Why Dashboards Matter&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A good dashboard should answer questions at a glance:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;What is going on?&lt;/li&gt;
&lt;li&gt;Why is it happening?&lt;/li&gt;
&lt;li&gt;What should we do next?&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Analysts create dashboards with:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Clear KPIs (Sales, Profit, Growth&lt;/li&gt;
&lt;li&gt;Filters (Date, Region, Product)&lt;/li&gt;
&lt;li&gt;Trends and comparisons&lt;/li&gt;
&lt;li&gt;Alerts for poor performance&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Business Impact&lt;/strong&gt;: Decision-makers save time and act faster, as dashboards are intuitive and focused&lt;/p&gt;

&lt;h2&gt;
  
  
  4. Translating Insights into Action
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;Power BI in real business decisions&lt;/strong&gt;&lt;br&gt;
Power BI insights lead to actions such as:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Increasing stock levels for high-performing products&lt;/li&gt;
&lt;li&gt;Cutting down on discounts affecting profit&lt;/li&gt;
&lt;li&gt;Determining the underperforming&lt;/li&gt;
&lt;li&gt;Improving delivery timelines&lt;/li&gt;
&lt;li&gt;Adjusting sales strategies&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Example&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A dashboard indicates:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;Sales are strong, but profit is declining&lt;/li&gt;
&lt;li&gt;DAX shows heavy discounting in one region&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;&lt;strong&gt;Action:&lt;/strong&gt;Management adjusts pricing strategy to increase profitability. &lt;br&gt;
**Business Impact: **Power BI helps organizations act, not just observe.&lt;/p&gt;

&lt;h2&gt;
  
  
  5. Why Power BI Analysts Are Valuable
&lt;/h2&gt;

&lt;p&gt;Those working in power BI analytics occupy an intermediate position between data and decision-makers. The value they offer lies in:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Understanding Business Problems&lt;/li&gt;
&lt;li&gt;Correctly clean and model the data&lt;/li&gt;
&lt;li&gt;Writing Meaningful DAX Measures&lt;/li&gt;
&lt;li&gt;Designing dashboards that communicate clearly&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;They don't simply build reports; they build better decisions.&lt;/p&gt;

&lt;p&gt;Power BI is more than just a technical tool. When used well, it can become a bridge between messy data and action-worthy meaning. Data cleaning, calculations in DAX, and dashboards all help create a better future for an organization, whether that future is full of opportunities or threats.&lt;br&gt;
In a world full of data, the true power is in making an impact from the insights, and Power BI offers just that&lt;/p&gt;

</description>
      <category>analytics</category>
      <category>data</category>
      <category>datascience</category>
      <category>microsoft</category>
    </item>
    <item>
      <title>Understanding Schemas and Data Modelling in Power BI</title>
      <dc:creator>Barbara Morara</dc:creator>
      <pubDate>Mon, 02 Feb 2026 13:55:50 +0000</pubDate>
      <link>https://dev.to/moraraba1/understanding-schemas-and-data-modelling-in-power-bi-31on</link>
      <guid>https://dev.to/moraraba1/understanding-schemas-and-data-modelling-in-power-bi-31on</guid>
      <description>&lt;h2&gt;
  
  
  Introduction
&lt;/h2&gt;

&lt;p&gt;Power BI is a powerful business intelligence tool that enables users to convert raw data into useful insights using interactive reports and dashboards. Nevertheless, the quality, performance, and accuracy of Power BI reports greatly rely on the way the data is modelled.&lt;br&gt;
Data modelling is the process of structuring the data into tables, specifying the relationships between the tables, and selecting the correct schema. This article discusses the key concepts of data modelling for Power BI, which include schema, fact tables, dimension tables, relationships, star schema, and snowflake schema.&lt;/p&gt;

&lt;h2&gt;
  
  
  What Is Data Modelling in Power BI?
&lt;/h2&gt;

&lt;p&gt;Data modelling in Power BI is defined as the process of organizing and structuring data in such a way that it can be easily analyzed and reported on. Data modelling in Power BI comprises:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Organizing the data in a logical table structure&lt;/li&gt;
&lt;li&gt;Establishing relationships between the tables&lt;/li&gt;
&lt;li&gt;Selecting the most appropriate schema&lt;/li&gt;
&lt;li&gt;Ensuring the accuracy and efficiency of the data&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Data modelling in Power BI helps in creating reports that are not only efficient but also easier to understand.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Fact Tables&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A fact table holds data that is measurable and can be analyzed. This data is usually in numbers and is quite large in size.&lt;br&gt;
Examples of data in a fact table:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Sales value&lt;/li&gt;
&lt;li&gt;Number of units sold&lt;/li&gt;
&lt;li&gt;Profit&lt;/li&gt;
&lt;li&gt;Discount
Fact tables usually have foreign keys that refer to dimension tables.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Dimension Tables&lt;/strong&gt;&lt;br&gt;
A dimension table holds data that describes the data in the fact table. &lt;/p&gt;

&lt;p&gt;Examples of data in a dimension table:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;Customer name&lt;/li&gt;
&lt;li&gt; Product category &lt;/li&gt;
&lt;li&gt;Date&lt;/li&gt;
&lt;li&gt;Region or location
Dimension tables are smaller and hold text data.&lt;/li&gt;
&lt;/ol&gt;

&lt;h2&gt;
  
  
  Relationships in Power BI
&lt;/h2&gt;

&lt;p&gt;Relationships describe how tables are related in a data model. Power BI uses these relationships to merge data from different tables during analysis.&lt;/p&gt;

&lt;h2&gt;
  
  
  Common Types of Relationships
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;One-to-Many (1:*) – Most common (e.g., one customer → many sales)&lt;/li&gt;
&lt;li&gt;One-to-One (1:1) – Rare&lt;/li&gt;
&lt;li&gt;Many-to-Many (:) – Used cautiously&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Relationship Direction
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;Single direction (recommended for simplicity and performance)&lt;/li&gt;
&lt;li&gt;Both directions (can cause ambiguity if misused)&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Well-defined relationships are essential to ensure correct calculations and avoid incorrect aggregations.&lt;/p&gt;

&lt;h2&gt;
  
  
  Schemas in Data Modelling
&lt;/h2&gt;

&lt;p&gt;A schema is a method of organizing tables and relationships in a data model. The two most common schemas used in Power BI are Star Schema and Snowflake Schema.&lt;/p&gt;

&lt;h2&gt;
  
  
  Star Schema
&lt;/h2&gt;

&lt;p&gt;A star schema is a data model that has a central fact table directly linked to multiple dimension tables. The data model looks like a star.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Features of Star Schema&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;There is only one fact table in the schema.&lt;/li&gt;
&lt;li&gt;The dimension tables are not linked to each other.&lt;/li&gt;
&lt;li&gt;The schema is simple and easy to understand.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Benefits of Star Schema&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;It has faster query execution times.&lt;/li&gt;
&lt;li&gt;DAX calculations are simpler.&lt;/li&gt;
&lt;li&gt;It is easier to maintain.&lt;/li&gt;
&lt;li&gt;Recommended by Microsoft for Power BI.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;em&gt;Example&lt;/em&gt;&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;FactSales&lt;/li&gt;
&lt;li&gt;DimCustomer&lt;/li&gt;
&lt;li&gt;DimProduct&lt;/li&gt;
&lt;li&gt;DimDate&lt;/li&gt;
&lt;li&gt;DimRegion&lt;/li&gt;
&lt;li&gt;DimRegion&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;Each dimension table is directly linked to the fact table.&lt;/p&gt;

&lt;h2&gt;
  
  
  Snowflake Schema
&lt;/h2&gt;

&lt;p&gt;A snowflake schema is an extension of the star schema where the dimension tables are further normalized into multiple related tables.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Characteristics of Snowflake Schema&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Dimension tables are divided into sub-dimension tables&lt;/li&gt;
&lt;li&gt;More complex structure&lt;/li&gt;
&lt;li&gt;Uses more relationships&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Advantages of Snowflake Schema&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Reduces data redundancy&lt;/li&gt;
&lt;li&gt;Saves storage space&lt;/li&gt;
&lt;li&gt;Disadvantages of Snowflake Schema&lt;/li&gt;
&lt;li&gt;Slower performance compared to star schema&lt;/li&gt;
&lt;li&gt;More complex relationships&lt;/li&gt;
&lt;li&gt;Difficult for a beginner to understand&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;In Power BI, snowflake schemas are less preferred due to performance issues.&lt;/p&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Feature&lt;/th&gt;
&lt;th&gt;Star Schema&lt;/th&gt;
&lt;th&gt;Snowflake Schema&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;Complexity&lt;/td&gt;
&lt;td&gt;Simple&lt;/td&gt;
&lt;td&gt;Complex&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Performance&lt;/td&gt;
&lt;td&gt;Faster&lt;/td&gt;
&lt;td&gt;Slower&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Number of Tables&lt;/td&gt;
&lt;td&gt;Fewer&lt;/td&gt;
&lt;td&gt;More&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Ease of Use&lt;/td&gt;
&lt;td&gt;Very Easy&lt;/td&gt;
&lt;td&gt;Moderate to Difficult&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Recommended in Power BI&lt;/td&gt;
&lt;td&gt;Yes&lt;/td&gt;
&lt;td&gt;Rarely&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fm243n9wxqhei63n3k6j9.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fm243n9wxqhei63n3k6j9.png" alt=" " width="800" height="533"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Why Good Data Modelling Is Critical in Power BI&lt;/strong&gt;&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;&lt;p&gt;Improves Performance&lt;br&gt;
Data modeling can improve query speed and minimize relationships, hence improving user experience through quicker report loading.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;Ensures Accurate Reporting&lt;br&gt;
Good data modeling ensures that relationships are correct to avoid:&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;Double counting&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;Incorrect totals&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;Misleading business decisions&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;Simplifies DAX Calculations&lt;br&gt;
Star schema modeling simplifies DAX formula writing, reading, and debugging.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;Enhances Scalability&lt;br&gt;
Data modeling can handle large volumes of data and can grow with business requirements.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;Improves User Experience&lt;br&gt;
Data modeling can ensure that users can understand data correctly and slice it correctly for easier decision-making.&lt;/p&gt;&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;&lt;strong&gt;Best Practices for Data Modelling in Power BI&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Use star schema modeling&lt;/li&gt;
&lt;li&gt;Dimension tables must be descriptive&lt;/li&gt;
&lt;li&gt;Avoid many-to-many relationships&lt;/li&gt;
&lt;li&gt;Use meaningful names&lt;/li&gt;
&lt;li&gt;Validate relationships&lt;/li&gt;
&lt;li&gt;Minimize bi-directional filter&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Data modeling is a critical aspect of successful Power BI reporting. Understanding different schemas, fact tables, dimension tables, and relationships enables analysts to create successful data models for Power BI reporting. Among different schemas, star schema modeling is highly recommended for use in Power BI reporting because of its simplicity and ability to improve query speed. By using good data modeling practices, users can unlock the full potential of Power BI reporting.&lt;/p&gt;

</description>
      <category>analytics</category>
      <category>data</category>
      <category>dataengineering</category>
      <category>microsoft</category>
    </item>
    <item>
      <title>Introduction to MS Excel for Data Analytics</title>
      <dc:creator>Barbara Morara</dc:creator>
      <pubDate>Wed, 28 Jan 2026 15:58:39 +0000</pubDate>
      <link>https://dev.to/moraraba1/introduction-to-ms-excel-for-data-analytics-2jlj</link>
      <guid>https://dev.to/moraraba1/introduction-to-ms-excel-for-data-analytics-2jlj</guid>
      <description>&lt;h2&gt;
  
  
  Beginner-friendly guide
&lt;/h2&gt;

&lt;p&gt;Microsoft Excel is one of the most widely used applications for data management. It is not necessary to be a programmer or a data scientist to begin analyzing data using Microsoft Excel. It has simple features such as tables, formulas, sorting, filtering, and charts that enable a beginner to understand the data, identify patterns, and make informed decisions.&lt;br&gt;
This article is intended to provide information on the application of MS Excel as a simple data analytics tool.&lt;/p&gt;

&lt;h2&gt;
  
  
  What is Data Analytics?
&lt;/h2&gt;

&lt;p&gt;Data analytics is the process of collecting, cleaning, organizing, and analyzing the data to extract valuable information.&lt;br&gt;
In simple words, data analytics helps us find answers to the following questions:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;How many were sold?&lt;/li&gt;
&lt;li&gt;Which product performed the best?&lt;/li&gt;
&lt;li&gt;What is the total, average, or maximum value?
Excel assists us in finding the answers to these questions quickly and graphically.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Getting Started with MS Excel
&lt;/h2&gt;

&lt;p&gt;When you start Excel, you see a sheet consisting of rows (numbered on the left side) and columns (lettered on the top). The intersection of each row and column is called a cell.&lt;br&gt;
The most effective way to use Excel is when you organize your data in a table format.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fmag6odriwss1ud5pxmu6.jpeg" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fmag6odriwss1ud5pxmu6.jpeg" alt=" " width="800" height="1422"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;This small data set will help us learn the basic concepts of data analysis.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2F1d8d2htuvp0woaybbjyu.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2F1d8d2htuvp0woaybbjyu.png" alt=" " width="598" height="627"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  Using Basic Formulas in Excel
&lt;/h2&gt;

&lt;p&gt;One of the most powerful tools in Excel is the use of formulas. Formulas enable Excel to calculate data.&lt;/p&gt;

&lt;h2&gt;
  
  
  Calculating Total Sales
&lt;/h2&gt;

&lt;p&gt;To calculate the total sales of each product:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;Add a new column and name it Total&lt;/li&gt;
&lt;li&gt;In the first cell of the Total column, type
&lt;code&gt;=B2*C2&lt;/code&gt;
&lt;/li&gt;
&lt;li&gt;Press Enter&lt;/li&gt;
&lt;li&gt;Drag the formula down to calculate the totals for the other products&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fcbugyflpbtw21ui4cxt3.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fcbugyflpbtw21ui4cxt3.png" alt=" " width="647" height="652"&gt;&lt;/a&gt;&lt;br&gt;
This multiplies the quantity by the price.&lt;/p&gt;

&lt;h2&gt;
  
  
  Using Common Excel Functions
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;SUM Function&lt;/strong&gt;&lt;br&gt;
The SUM function is used to add total sales.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fvrxnealwv2795dirp3qr.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fvrxnealwv2795dirp3qr.png" alt=" " width="547" height="555"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;This gives the total sales amount.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Average Function&lt;/strong&gt;&lt;br&gt;
The AVERAGE function finds the average value.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fugnez37mq1nv6uemuc4h.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fugnez37mq1nv6uemuc4h.png" alt=" " width="683" height="576"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;This is the average sales amount.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Sorting Data&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Sorting data helps you arrange information in a useful way.&lt;br&gt;
For instance, you can sort items from highest to lowest total sales as follows:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;Select the data&lt;/li&gt;
&lt;li&gt; Click Sort &amp;amp; Filter&lt;/li&gt;
&lt;li&gt;Select Sort Largest to Smallest&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fykmup243yc0ugkie1gfv.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fykmup243yc0ugkie1gfv.png" alt=" " width="561" height="691"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;This helps you identify the best-performing items.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Filtering Data&lt;/strong&gt;&lt;br&gt;
Filtering enables you to show data based on your needs.&lt;br&gt;
Example: Display products with a quantity above 8.&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;Select your table&lt;/li&gt;
&lt;li&gt; Click Filter&lt;/li&gt;
&lt;li&gt;Use the drop-down arrows to apply conditions&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2F3or7023kwbhnrqycy0xf.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2F3or7023kwbhnrqycy0xf.png" alt=" " width="561" height="719"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Creating Simple Charts&lt;/strong&gt;&lt;br&gt;
Charts enable you to visualize data and understand insights easily.&lt;br&gt;
To create a chart:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;Select the data&lt;/li&gt;
&lt;li&gt; Click Insert&lt;/li&gt;
&lt;li&gt;Select a Column Chart or Bar Chart&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fl2dgi833ny1w9oe6nmqr.jpeg" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fl2dgi833ny1w9oe6nmqr.jpeg" alt=" " width="800" height="1422"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Why Excel is Good for Beginners in Data Analytics&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Excel is good for beginners in data analytics because:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;It is easy to learn&lt;/li&gt;
&lt;li&gt;No programming skills are required &lt;/li&gt;
&lt;li&gt;Calculations are automatic&lt;/li&gt;
&lt;li&gt;Data visualization is easy&lt;/li&gt;
&lt;li&gt;It is used in most schools and work environments&lt;/li&gt;
&lt;/ol&gt;

&lt;h2&gt;
  
  
  Conclusion
&lt;/h2&gt;

&lt;p&gt;Microsoft Excel is a powerful data analysis tool that is also suitable for beginners. It is easy to learn and use, and its mastery will provide a good foundation for more advanced data analysis tools in the future.&lt;br&gt;
If you are a beginner in data analysis, then Excel is the best place to start.&lt;/p&gt;

</description>
    </item>
    <item>
      <title>A Beginner’s Guide to Version Control with Git: Tracking, Pushing, and Pulling Code</title>
      <dc:creator>Barbara Morara</dc:creator>
      <pubDate>Sat, 17 Jan 2026 14:54:47 +0000</pubDate>
      <link>https://dev.to/moraraba1/a-beginners-guide-to-version-control-with-git-tracking-pushing-and-pulling-code-4j63</link>
      <guid>https://dev.to/moraraba1/a-beginners-guide-to-version-control-with-git-tracking-pushing-and-pulling-code-4j63</guid>
      <description>&lt;p&gt;A problem that programmers, especially beginners, often encounter is:&lt;br&gt;
you make changes to the code, something goes wrong, and you would like to go back to a previous state. That is where a “version control” tool comes in to help you.&lt;br&gt;
In this article, you will learn:&lt;br&gt;
-What version control is and why it is important&lt;br&gt;
-Git Changes Tracking&lt;br&gt;
-How to push code on GitHub&lt;br&gt;
-How to pull code from GitHub&lt;/p&gt;

&lt;p&gt;What Is Version Control?&lt;br&gt;
Version Control is the process wherein changes that have been made to files are tracked. With versioning, you have the ability to:&lt;br&gt;
-Record a history of your work&lt;br&gt;
-See what was changed and when&lt;br&gt;
-Restore previous versions of code &lt;br&gt;
-Work together with others without overwriting their work&lt;/p&gt;

&lt;p&gt;What Is Git?&lt;br&gt;
Git is a version control system that you install and operate from your computer. It assists you with:&lt;br&gt;
-Monitoring changes made in files&lt;br&gt;
-Save copies of your project (known as "commits")&lt;br&gt;
-Working Offline&lt;br&gt;
-Manage your project effectively&lt;br&gt;
Git operates locally. This means all the changes occur on your personal machine.&lt;/p&gt;

&lt;p&gt;What Is GitHub?&lt;br&gt;
GitHub is an online hosting service used for storing Git repositories. It enables you to:&lt;br&gt;
-Online code backups&lt;br&gt;
-Collaborate on projects with others&lt;br&gt;
-Work together on team projects&lt;/p&gt;

&lt;h2&gt;
  
  
  Key Git Concepts for Beginners
&lt;/h2&gt;

&lt;p&gt;Repository (Repo): A project folder managed with Git&lt;br&gt;
Commit: A saved snapshot of changes&lt;br&gt;
Staging Area: This refers to where changes to be committed to the project's source code will be&lt;br&gt;
Push: Code Uploads to GitHub&lt;br&gt;
Pull: Downloading updated code from GitHub&lt;/p&gt;

&lt;h2&gt;
  
  
  Tracking Changes with Git
&lt;/h2&gt;

&lt;p&gt;To see the state of your files, use:&lt;/p&gt;

&lt;p&gt;&lt;code&gt;git status&lt;/code&gt;&lt;/p&gt;

&lt;p&gt;This indicates which files have been updated or are ready to be committed.&lt;/p&gt;

&lt;p&gt;To prepare files for saving, add them to the staging area:&lt;br&gt;
&lt;code&gt;git add .&lt;/code&gt;&lt;/p&gt;

&lt;p&gt;To save the changes permanently, create a commit:&lt;br&gt;
&lt;code&gt;git commit -m "Describe what changed"&lt;/code&gt;&lt;/p&gt;

&lt;p&gt;In a commit message, you should describe the update you implemented.&lt;/p&gt;

&lt;h2&gt;
  
  
  Pushing Code to GitHub
&lt;/h2&gt;

&lt;p&gt;After committing, however, your changes exist only on your own computer.&lt;br&gt;
To upload the files to GitHub,use:&lt;br&gt;
&lt;code&gt;git push&lt;/code&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  Pulling Code from GitHub
&lt;/h2&gt;

&lt;p&gt;If an update is done on GitHub, the local project could become stale. &lt;br&gt;
To update it, run:&lt;br&gt;
&lt;code&gt;git pull&lt;/code&gt;&lt;/p&gt;

&lt;p&gt;Git can appear intimidating at first, but learning the fundamentals of version control, change tracking, pushing, and pulling code can make development a much safer and more organized process. Git can become a powerful and very simple tool if you practice using it frequently.&lt;/p&gt;

&lt;p&gt;Happy coding &lt;/p&gt;

</description>
      <category>beginners</category>
      <category>git</category>
      <category>github</category>
      <category>tutorial</category>
    </item>
  </channel>
</rss>
