DEV Community

fooooo-png
fooooo-png

Posted on • Originally published at helpcenter.octoparse.com

1

News: Crawler auto-generation tool!

The Octoparse 8.1(bate) is Octoparse brand new version, helping to improve the non-programmer's experience of web scraping. The greatest thing about this new version is the crawler auto-generation function.

Crawler auto-generation algorithm
Traditionally speaking, if someone wants to create a crawler, he/she should start from learning computer languages, like Jave Script, R, Python or some others and then write the codes with the assistance of the open-source libraries, like Github and Beautiful soup. Or they can choose a web scraping tool to get it done. The topmost popular tools are Octoparse, webscraper.io, and Parsehub, according to their traffic.

ranking

Compared with using computer languages to create a crawler, a web scraping tool could be an easier choice as learning using the tool is easier. To make it easier than easier, Octoparse develops the auto-generation algorithm to empower non-programmers the ability of web scraping. Everyone is able to achieve auto-generating a crawler after entering a URL.

Octoparse 8.1(bate) has been released with the crawler auto-generation function and available for everyone to have it a try!
Download

Here're two videos for further references.
https://www.youtube.com/watch?v=s6pirJKtVk0&t
https://www.youtube.com/watch?v=6TWJ2LKGWQk

If you have figure out a better way to create a crawler to scrape data online, please leave your message in the comment area!

AWS Q Developer image

Your AI Code Assistant

Automate your code reviews. Catch bugs before your coworkers. Fix security issues in your code. Built to handle large projects, Amazon Q Developer works alongside you from idea to production code.

Get started free in your IDE

Top comments (0)

Postmark Image

Speedy emails, satisfied customers

Are delayed transactional emails costing you user satisfaction? Postmark delivers your emails almost instantly, keeping your customers happy and connected.

Sign up

👋 Kindness is contagious

Please leave a ❤️ or a friendly comment on this post if you found it helpful!

Okay