Understanding 6 Common Data Formats in Data Analytics

SRIMATHI S — Wed, 08 Oct 2025 05:07:42 +0000

In the world of data analytics, information comes in many different formats — from simple spreadsheets to structured databases and modern big data files. Choosing the right format affects storage efficiency, speed, and compatibility with tools like Python, Spark, or SQL engines.

In this article, we’ll explore six popular data formats used in analytics:

CSV (Comma-Separated Values)
SQL (Relational Table Format)
JSON (JavaScript Object Notation)
Parquet (Columnar Storage Format)
XML (Extensible Markup Language)
Avro (Row-Based Storage Format)

Sample Dataset
Name Register Number Subject Marks
Anitha 101 Data Analytics 85
Bala 102 Cloud Computing 90
Charan 103 Machine Learning 88

1.CSV (Comma-Separated Values)

What it is:
CSV is one of the simplest and most widely used data formats. Each row represents a record, and columns are separated by commas. It’s human-readable and supported by almost every data tool.

Example (data.csv):

Name,RegisterNumber,Subject,Marks
Anitha,101,Data Analytics,85
Bala,102,Cloud Computing,90
Charan,103,Machine Learning,88

2.SQL (Relational Table Format)

What it is:
SQL format represents data stored in a relational database table. Each row is a record, and the structure (columns, types) is defined by a schema.

Example (data.sql):

CREATE TABLE Students (
  Name VARCHAR(50),
  RegisterNumber INT,
  Subject VARCHAR(50),
  Marks INT
);

INSERT INTO Students VALUES
('Anitha', 101, 'Data Analytics', 85),
('Bala', 102, 'Cloud Computing', 90),
('Charan', 103, 'Machine Learning', 88);

3.JSON (JavaScript Object Notation)
What it is:
JSON is a lightweight format used for structured and semi-structured data. It’s easy for humans to read and easy for machines to parse.

Example (data.json):

[
  {
    "Name": "Anitha",
    "RegisterNumber": 101,
    "Subject": "Data Analytics",
    "Marks": 85
  },
  {
    "Name": "Bala",
    "RegisterNumber": 102,
    "Subject": "Cloud Computing",
    "Marks": 90
  },
  {
    "Name": "Charan",
    "RegisterNumber": 103,
    "Subject": "Machine Learning",
    "Marks": 88
  }
]

4.Parquet (Columnar Storage Format)

What it is:
Parquet is a columnar storage format developed for efficient big data processing. Instead of storing row-by-row like CSV, it stores data column-by-column, which saves space and speeds up analytics queries.

Example (Conceptual View):

Columns:
Name → ["Anitha", "Bala", "Charan"]
RegisterNumber → [101, 102, 103]
Subject → ["Data Analytics", "Cloud Computing", "Machine Learning"]
Marks → [85, 90, 88]

5.XML (Extensible Markup Language)

What it is:
XML uses tags to describe data, similar to HTML. It’s widely used for configuration files and data interchange between systems.

Example (data.xml):

<Students>
  <Student>
    <Name>Anitha</Name>
    <RegisterNumber>101</RegisterNumber>
    <Subject>Data Analytics</Subject>
    <Marks>85</Marks>
  </Student>
  <Student>
    <Name>Bala</Name>
    <RegisterNumber>102</RegisterNumber>
    <Subject>Cloud Computing</Subject>
    <Marks>90</Marks>
  </Student>
  <Student>
    <Name>Charan</Name>
    <RegisterNumber>103</RegisterNumber>
    <Subject>Machine Learning</Subject>
    <Marks>88</Marks>
  </Student>
</Students>

6.Avro (Row-Based Storage Format)

What it is:
Avro is a binary row-based data format developed by Apache. It stores both the schema and the data, making it ideal for streaming and serialization in Hadoop/Spark environments.

Example (Conceptual View):

{
  "type": "record",
  "name": "Student",
  "fields": [
    {"name": "Name", "type": "string"},
    {"name": "RegisterNumber", "type": "int"},
    {"name": "Subject", "type": "string"},
    {"name": "Marks", "type": "int"}
  ],
  "records": [
    {"Name": "Anitha", "RegisterNumber": 101, "Subject": "Data Analytics", "Marks": 85},
    {"Name": "Bala", "RegisterNumber": 102, "Subject": "Cloud Computing", "Marks": 90},
    {"Name": "Charan", "RegisterNumber": 103, "Subject": "Machine Learning", "Marks": 88}
  ]
}

Conclusion

Every data format serves a unique purpose.
Use CSV/JSON for simplicity and readability.
Choose SQL/XML for structured data exchange.
Opt for Parquet/Avro when handling big data at scale.
Understanding these formats helps you pick the right tool for efficient data storage, transfer, and analytics in the cloud.

Exploring MongoDB

SRIMATHI S — Fri, 05 Sep 2025 15:49:55 +0000

As part of exploring modern databases, I decided to work with MongoDB.
It uses JSON-like documents to store data, making it very intuitive to query and manipulate.
Compared to traditional SQL databases, it offers great flexibility and speed for unstructured datasets.
In this post, I’ll share my learning experience and some hands-on tasks I completed.

1.Setting Up MongoDB

I installed MongoDB (you can either install locally or use MongoDB Atlas Cloud).
After installation, I verified the setup using:
mongod --version
mongo --version

MongoDB was up and running!

2.Importing Dataset

For this project, I used a sample Yelp Reviews Dataset (JSON format).

3.Insert Records Manually

I inserted 10 sample records into the collection:

4.Queries

Find Top 5 Businesses with Highest Average Rating.

Count How Many Reviews Contain the Word “good”.

Get All Reviews for a Specific Business ID.

Update a review and delete a record.

Conclusion

Through this hands-on project, I learned how to:

Insert, query, update, and delete records in MongoDB
Perform aggregation queries
Use regex for text search
Export query results to JSON/CSV

MongoDB’s flexibility and power make it a great tool for handling real-world datasets.

DEV Community: SRIMATHI S

Understanding 6 Common Data Formats in Data Analytics

Exploring MongoDB

4.Queries