DEV Community: Mohit Majumdar

Simplifying Selenium Projects with Containerized Chrome

Mohit Majumdar — Thu, 13 Jun 2024 19:18:00 +0000

Today, I stumbled upon a game-changing solution for my Selenium projects, and I wanted to share my experience. Over the past few months, I’ve been grappling with the challenge of hosting my project in the cloud. The main issue was that my project involves opening a browser to scrape data, which made things complex.

Initially, I thought about using a Windows server, downloading Chrome on it, and running the code there. However, this approach quickly became too resource-intensive and unwieldy. Managing the server and ensuring everything ran smoothly was a headache, and it didn’t seem like a sustainable solution.

During my research, I came across an alternative that changed everything: containerized Chrome with Selenium. For those unfamiliar, containerization allows you to bundle your application with all its dependencies into a "container" that can run consistently across different computing environments. This means you can deploy your Selenium projects with Chrome in a much more lightweight and scalable manner.

I decided to give it a try, and the results have been fantastic. Setting up containerized Chrome in the cloud was straightforward, and it significantly reduced the load on my resources. Not only did it make the deployment process easier, but it also enhanced the performance and reliability of my scraping tasks.

If you’re facing similar challenges with hosting Selenium projects, I highly recommend looking into containerized Chrome. It has made my life much easier, and I believe it can do the same for you. Embracing this approach has been a game-changer, turning a cumbersome task into a streamlined process.

Give it a try, and see the difference it can make for your projects!

Django Database Reset Chronicles: Recovering from the Brink of Disaster

Mohit Majumdar — Mon, 05 Feb 2024 18:33:50 +0000

Introduction:

Start with a humorous or relatable anecdote about the life of a programmer dealing with databases, setting the tone for the challenges and lessons ahead.

The Tricky Tango of Table Renaming:

Describe the seemingly innocent decision to rename tables in models.py that spiraled into a migration mayhem. Use witty programming-related metaphors to capture the chaos.

The Daredevil Move: Deleting Tables Directly:

Confess to the brave (or reckless) act of deleting tables directly and the unexpected fallout that ensued. Perhaps liken it to performing a high-stakes stunt in the programming circus.

DROP table_name;

The Plot Twist: Attempted Solution with `dumpdata`:

Share the optimism of trying to salvage the situation with Django's dumpdata command, only to be thwarted by the missing table. Compare it to a heroic mission that faced an unexpected enemy.

python manage.py dumdata > data.json

Backing Up - The Safety Net:

Emphasize the importance of backups with a dramatic comparison to a superhero's utility belt. Discuss the relief of taking a backup using pg_dump and how it provided a lifeline in the midst of the chaos.

pg_dump -U username -d database_name -t tablename -f data.sql

The Great Format Fiasco:

Detail the realization that the saved SQL file was in the wrong format, leading to the ultimate database reset. Infuse humor by comparing it to a classic blunder in a programmer's sitcom.

to check file type run
file filename

Discovering the Magic of `psql`:

Unveil the eureka moment of discovering the alternative solution using psql to restore the database, overcoming errors with a touch of wizardry. Paint it as the unexpected plot twist in the saga.

psql -U username -d database_name -f data.sql

Manual Redo - The Redemption Arc:

Describe the redemption arc of redoing tasks manually, with a touch of irony and determination. Emphasize the satisfaction of finding the data intact, akin to a surprising plot twist in a programmer's novel.

Lessons from the Debugging Odyssey:

Inject humor and wisdom into the lessons learned, framing them as essential survival tips for programmers navigating the treacherous waters of database management. Use relatable metaphors and analogies.

Conclusion:

Wrap up the story with a witty and encouraging conclusion, leaving readers with a smile and a newfound appreciation for the unpredictability of database adventures. Encourage them to share their own tales of triumphs and tribulations.

Unveiling My First AWS Bill: A Beginner's Journey into Cloud Costs

Mohit Majumdar — Thu, 04 Jan 2024 17:34:03 +0000

Introduction:

Hey everyone! In December 2023, I dove headfirst into the fascinating realm of AWS, driven by a simple curiosity about the cloud. Little did I know that this journey would unfold into a valuable lesson on understanding the ins and outs of AWS billing.

Section 1: AWS Billing Overview:

AWS welcomes you with a user-friendly billing interface, where you only pay for what you use—a pretty sweet deal! Even though I was cruising along in the free tier, a surprise bill came knocking on my virtual door.

AWS Cost Management:

Navigating the financial side of AWS is made easier with AWS Cost Management. Picture it as your trusty sidekick in budget creation. To stay ahead of any unexpected costs, I set up a zero-budget alert, acting like a friendly reminder if I ever started to exceed those free tier limits.

The Oops Moment:

In my excitement to explore, I goofed up. I had several Elastic Compute Cloud (EC2) instances up and running, thinking I was being smart by consolidating my data into a single image for use in different places. Then there was this snapshot—about 30GB in size—that I created and completely forgot about. Surprise, surprise, after my free tier bid farewell, a bill showed up, courtesy of that unnoticed snapshot.

Conclusion:

Lesson learned: always keep an eye on the stuff you deploy in the cloud. If you're done with it, kick it to the virtual curb to avoid any surprise charges. And hey, those budget alerts? Golden. They're like your financial guardian angel, preventing any unexpected budget heartaches.

In this ever-evolving world of cloud tech, it's all about sharing experiences. Hopefully, by sharing mine, I've made navigating the AWS landscape a bit easier for you. Just remember, the cloud is fantastic, but it pays to be a savvy user. Happy cloud adventures!

DEV Community: Mohit Majumdar

Simplifying Selenium Projects with Containerized Chrome

Django Database Reset Chronicles: Recovering from the Brink of Disaster

Introduction:

The Tricky Tango of Table Renaming:

The Daredevil Move: Deleting Tables Directly:

The Plot Twist: Attempted Solution with dumpdata:

Backing Up - The Safety Net:

The Great Format Fiasco:

Discovering the Magic of psql:

Manual Redo - The Redemption Arc:

Lessons from the Debugging Odyssey:

Conclusion:

Unveiling My First AWS Bill: A Beginner's Journey into Cloud Costs

Introduction:

Section 1: AWS Billing Overview:

AWS Cost Management:

The Oops Moment:

Conclusion:

The Plot Twist: Attempted Solution with `dumpdata`:

Discovering the Magic of `psql`: