cUrls is a simple tool crawl urls from domain using colly
library. Source code in here.
Installation
First, install golang
Then, clone from soure code and install:
git clone https://github.com/ductnn/cUrls.git
cd cUrls
go get
Usage
Run command:
go run curls.go > sub.txt
# Enter domain you want to crawl.
# Example
http://httpbin.org/
Check results in file sub.txt:
Visiting http://httpbin.org/
Link found: "\n \n \n \n \n \n " -> https://github.com/requests/httpbin
Link found: "the developer - Website" -> https://kennethreitz.org
Link found: "Send email to the developer" -> mailto:me@kennethreitz.org
Link found: "Flasgger" -> https://github.com/rochacbruno/flasgger
Link found: "HTML form" -> /forms/post
So done !!! =))))
Show your support
Give a ⭐ if you like this application ❤️
Contribution
Contributions are more than welcome in this project!
License
The MIT License (MIT). Please see LICENSE for more information.
Top comments (0)