Automating Your Backups with a Simple Bash Script

#devops #bash #automation #scripting

Learn how to create a robust, automated file backup system using Bash, complete with compression, exclusions, and retention policies.

As developers, we know that data loss is a nightmare. Whether it's a hardware failure or an accidental rm -rf, having a reliable backup system is essential. While there are many complex tools available, sometimes a simple, customized Bash script is all you need to get the job done efficiently.

In this post, I'll walk you through a lightweight Bash script I built to automate file backups. It handles compression, excludes unnecessary files, and even manages disk space by deleting old archives.

The Problem

Manual backups are tedious and prone to human error. You might forget to run them, or you might end up filling your disk with redundant copies. I wanted a solution that:

Is easy to trigger via CLI or cron.
Compresses data to save space.
Automatically cleans up old backups.
Ignores "noise" like .git folders and temporary files.

The Solution: `backup.sh`

Here is the breakdown of the script's core functionality.

1. Robust Input Validation

Before doing anything, the script ensures that the user provided the necessary source and destination paths, and verifies that the source actually exists.

if [ $# -ne 2 ]; then
    echo "Usage: $0 <source_directory> <destination_directory>"
    exit 1
fi

SOURCE_DIR="$1"
DESTINATION_DIR="$2"

if [ ! -d "$SOURCE_DIR" ]; then
    echo "Error: Source directory '$SOURCE_DIR' does not exist."
    exit 1
fi

2. Smart Directory Management

If your destination folder doesn't exist yet, the script handles it gracefully using mkdir -p.

if [ ! -d "$DESTINATION_DIR" ]; then
    mkdir -p "$DESTINATION_DIR"
fi

3. Efficient Compression with Exclusions

One of the most powerful parts of this script is how it filters files. We don't want to back up heavy .git history or transient log files. By combining find and tar, we only grab what matters.

EXCLUSIONS="*.git/* *log* *temp*"

find "$SOURCE_DIR" -type f -not -path "*$EXCLUSIONS*" -print0 | 
xargs -0 tar -czvf "$DESTINATION_DIR/backup.tar.gz" -C "$SOURCE_DIR" .

4. Automatic Retention Policy

To prevent your backup drive from filling up, the script automatically purges files older than 30 days.

find "$DESTINATION_DIR" -type f -mtime +30 -delete

How to Use It

Clone the repo (or copy the script).
Make it executable:

   chmod +x backup.sh

Run a backup:

   ./backup.sh ~/my_project ~/backups/my_project_backups

Conclusion

This script is a great starting point for anyone looking to automate their workflow. It's modular, easy to read, and relies on standard Unix tools that are available on almost every system.

Next Steps: You could easily extend this by adding: