DEV Community

IntelliTools
IntelliTools

Posted on

Convert Nested JSON to CSV with Python – A Simple Automation Tool

#python #automation #tutorial #productivity

If you've ever dealt with nested JSON data and needed to convert it into a flat CSV format for analysis or import into spreadsheets, you know how frustrating it can be. Nested structures can make it hard to extract meaningful data, especially when dealing with large datasets. That's where my JSON to CSV Converter comes in. It's a simple Python script that helps you flatten complex JSON structures and export them into a clean, readable CSV file.

The script I've built is designed to handle nested dictionaries and lists, recursively extracting all the key-value pairs into a single-level structure. This makes it easy to export the data for use in tools like Excel, Google Sheets, or even for feeding into machine learning models.

Let me walk you through how it works and how you can use it.

First, you'll need to install the script. You can grab the full script here: Gumroad Link. The script is a single Python file that you can run from the command line or integrate into your existing projects.

Here's a basic example of how to use the script:

from json_to_csv import flatten_json, write_to_csv

# Sample nested JSON
data = {
    "name": "Alice",
    "address": {
        "city": "New York",
        "zip": "10001"
    },
    "hobbies": ["reading", "coding"]
}

# Flatten the JSON
flattened = flatten_json(data)

# Write to CSV
write_to_csv(flattened, 'output.csv')
Enter fullscreen mode Exit fullscreen mode

This script takes the nested JSON object and converts it into a flat dictionary. The flatten_json function recursively traverses the input, adding keys with a dot notation to represent the nested structure. For example, "address.city" becomes a key in the output dictionary.

The write_to_csv function then takes this flattened data and writes it to a CSV file. The output will look like this:

name,address.city,address.zip,hobbies
Alice,New York,10001,reading,coding
Enter fullscreen mode Exit fullscreen mode

This format is easy to work with and can be imported into any spreadsheet application.

The script is particularly useful when dealing with APIs that return nested JSON responses. It allows you to quickly convert the data into a format that's compatible with most data processing tools.

One of the key features of the script is its ability to handle lists as well. For instance, if a field contains a list of items, the script will create a column for each item, making it easy to process and analyze.

I've also included some basic error handling to catch malformed JSON or unexpected data types, which helps prevent the script from crashing during processing.

If you're working on a project that involves data extraction or transformation, this tool can save you a lot of time. It's a great addition to any developer's toolkit, especially for those looking to improve their automation workflows.

What are your thoughts on this approach? Have you used similar tools or scripts in your projects? I'd love to hear your experiences and any suggestions for improvements!

Top comments (0)