Garbage In, Garbage Out: A Beginner’s Guide to Data Cleaning

Muhammad Muntazir — Tue, 14 Jul 2026 06:32:59 +0000

When you first dive into machine learning, it is easy to get swept up in the excitement of building complex models and neural networks. However, there is a golden rule in data science that every beginner must learn early: Garbage In, Garbage Out (GIGO).

No matter how sophisticated or powerful your AI algorithm is, if you feed it messy, inaccurate, or incomplete data, it will produce useless predictions. In fact, professional data scientists spend roughly 80% of their time cleaning and preparing data, and only 20% building models.

This post is your quick, beginner-friendly roadmap to understanding what data cleaning is, why it matters, and how to perform the most common cleaning steps.

Why is Raw Data "Garbage"?

Real-world data is collected from sensors, human inputs, web scraping, and diverse databases. Because of this, raw datasets are almost always messy. Common issues include:

Missing values (e.g., a user skipped entering their age on a form).
Duplicates (e.g., a system error recorded the same transaction twice).
Inconsistent formatting (e.g., writing a date as "07/14/2026", "14 July 2026", or "2026-07-14").
Outliers (e.g., a data entry typo listing a house price as $10 billion instead of $1 million).

If you feed these anomalies into an AI, the model will assume they are valid patterns, completely throwing off its calculations.

The 4 Core Steps of Data Cleaning

To turn "garbage" data into gold, data scientists follow a structured preprocessing pipeline. Here are the four foundational steps:

1. Handling Missing Data

When a dataset has missing values (often represented as NaN or Null in programming), you have two main choices:

Deletion: Remove the entire row or column containing the missing value.

Rule of thumb: Only do this if you have a massive dataset and the missing values make up less than 5% of your data.
Imputation: Fill in the missing values with a logical estimate. For numerical data (like salary), you might fill the blank space with the mean (average) or median value of that column. For categorical data (like country), you might fill it with the mode (the most common value).

2. Removing Duplicates

Duplicate rows are a silent killer in machine learning. If the exact same data point appears multiple times, your model will over-prioritize that specific point, leading to biased results.

The Fix: Use simple coding functions (like .drop_duplicates() in the Python Pandas library) to scan your dataset and keep only the first unique instance of each row.

3. Dealing with Outliers

An outlier is a data point that is vastly different from the rest of the dataset. While some outliers are real, valuable exceptions, many are simply typos or sensor glitches.

How to spot them: Data scientists use simple statistical rules (like the Interquartile Range, or IQR) to identify numbers that sit too far outside the normal distribution.
The Fix: If the outlier is a clear error (e.g., Age = 350), delete or correct it. If it is a real but extreme case, you may want to keep it or cap it at a maximum threshold to prevent it from skewing the model's training.

4. Standardizing and Formatting

AI models are excellent at math, but terrible at interpreting different text formats. Before training, you must standardize your data:

Text Normalization: Convert all text data to lowercase and remove accidental spaces (e.g., turning " New York " and "new york" both into "new york").
Type Conversion: Ensure numbers are saved as numerical data types (integers/floats) rather than text strings, so your model can perform mathematical equations on them.

Summary: A Clean Start

Data cleaning isn’t a chore that gets in the way of machine learning; it is the most critical part of machine learning.

By taking the time to handle missing values, remove duplicates, filter out errors, and standardize your formats, you build a solid foundation. When you feed clean data into even a simple machine learning model, you will get incredibly accurate, highly reliable results.

Remember: Clean data beats a fancy algorithm every single time.

DEV Community: Muhammad Muntazir