DEV Community

Discussion on: picoCTF: where are the robots

Collapse
 
amrithanaidu profile image
amrithanaidu

When you get to the page and see the Disallow: /1bb4c.html, how do you get to that page?

Collapse
 
mr_h profile image
Huxley

/1bb4c.html is the url path

Collapse
 
amrithanaidu profile image
amrithanaidu

So would I add that on to the end of the url of the last website I got to?

Thread Thread
 
mr_h profile image
Huxley

Replace the /robots.txt with it