Learning AWK: A Simple and Powerful Tool

Revati — Sun, 20 Oct 2024 11:20:50 +0000

After getting comfortable with Bash scripting, I was on the lookout for something that could handle data processing more efficiently. That’s when my mentor M Prashant introduced me to AWK. At first, I wasn’t sure I needed it—Bash was doing the job—but once I started using AWK, I realized how powerful it actually is.

Here’s my journey of learning AWK, and why I think it’s worth your time if you work with data or text files regularly.
What is AWK?

AWK is a command-line tool that processes text files. It reads a file line by line, looks for patterns, and performs actions on lines that match. It sounds technical, but once I tried a few basic commands, it clicked. AWK is great when you need to filter, extract, or even transform data quickly.
My First Steps with AWK

Printing Everything:

awk '{ print }' file.txt

My first command in AWK! It just prints every line from the file. Simple, but a good starting point.

Printing Specific Columns:

awk '{ print $1, $3 }' file.txt

AWK splits lines into fields, so $1 is the first column, $3 is the third, and so on. This command let me print just the parts I needed, which was super handy for working with CSV files.

Finding Specific Patterns:

awk '/error/ { print }' log.txt

This was a lifesaver when I had to go through logs. It printed only the lines containing the word “error,” saving me a ton of time.

Why AWK is a Game-Changer

The real magic of AWK, for me, came when I realized how fast it handles data. For example, summing up numbers from a column is a task that would take a while in Bash, but AWK does it in one line:

awk '{ sum += $2 } END { print sum }' data.txt

In this case, it adds up all the numbers in the second column and prints the total. That’s when I thought, “Wow, this tool is powerful!”
Handy AWK Tips I Use

Changing Field Separators: Normally, AWK treats spaces as the separator between fields, but for CSV files, you can switch it to a **comma:**

awk 'BEGIN { FS="," } { print $1, $3 }' file.csv

Counting Lines:

awk 'END { print NR }' file.txt

This command prints the total number of lines in a file. It’s great when I need to check the size of a dataset.

Replacing Text:

awk '{ gsub(/old/, "new"); print }' file.txt

AWK can quickly replace all occurrences of a word. I’ve used this to make quick edits to files without opening them.

Final Thoughts

Learning AWK was a turning point for me. I went from thinking I didn’t need another tool to realizing how much time it saves when working with large files or complex data. Thanks to Prashant for pushing me to learn it! Now, I can’t imagine handling logs or CSVs without AWK.

If you work with text data regularly, give AWK a try. It’s a bit of a learning curve, but once you understand the basics, it’ll become your go-to tool for fast and efficient data processing.

My Experience Learning Bash Scripting as a Student

Revati — Sun, 13 Oct 2024 14:33:14 +0000

I recently started learning Bash scripting. I wanted to share a bit about why I decided to learn it and how it’s been helpful so far.

Why Learn Bash?

As a student, I’ve worked with Python, but I realized learning Bash could make my life easier when working with Linux systems and automating tasks like file organization or backups. Bash is great for handling these tasks directly from the command line.

How I Learned

Started small: I began with basic commands like navigating directories and creating files.
YouTube help: M Prashant’s YouTube channel was super helpful. His videos on Bash scripting are easy to follow, especially for beginners.
Practice: I wrote small scripts to automate simple tasks, like organizing files or setting reminders.

What I’ve Gained

Time saved: Automating tasks has made things quicker.
Better with Linux: I’m more comfortable using the terminal.
Confidence in scripting: I’m now writing scripts more easily.

If you’re just starting with Bash, I highly recommend checking out M Prashant’s YouTube channel. Let me know if you have any questions or if you're learning Bash too!

Happy coding! 😊

DEV Community: Revati

Learning AWK: A Simple and Powerful Tool

My Experience Learning Bash Scripting as a Student