DEV Community

John Glennan
John Glennan

Posted on

1 1

Parsing the Interwebs

My first cli project I created from scratch used Nokogiri. I found that using the The Bastards Book of Ruby was a great resource. I highly recommend checking out their website to refer to, if your looking to make a web scraper cli. Grabbing css selectors for the first time was not an easy task. The internet is deep and so are its selectors. You might be asking yourself how do you grab selectors? Using Nokogiri a ruby gem you parse the url creating nodes that you can then iterate over and use to present data to the end user. If you inspect the page and grab the css selector from the html you parsed, you can grab very specific data. I found that not every website could be scraped and that was my biggest setback. As a beginner in software development sometimes its better to take a step back, realizing that its not your fault your not getting the results you expect. The key here is to keep trying and don't give up. You will produce results with perseverance and patience.

Sentry image

Hands-on debugging session: instrument, monitor, and fix

Join Lazar for a hands-on session where you’ll build it, break it, debug it, and fix it. You’ll set up Sentry, track errors, use Session Replay and Tracing, and leverage some good ol’ AI to find and fix issues fast.

RSVP here →

Top comments (0)

Billboard image

The Next Generation Developer Platform

Coherence is the first Platform-as-a-Service you can control. Unlike "black-box" platforms that are opinionated about the infra you can deploy, Coherence is powered by CNC, the open-source IaC framework, which offers limitless customization.

Learn more

👋 Kindness is contagious

Please leave a ❤️ or a friendly comment on this post if you found it helpful!

Okay