I'm a software developer from India. :india:
I live in Shrirampur City, Maharastra :india:
I'm currently learning Back-end Web Developing via Python Programming Language.
Check the robots.txt is written correctly which finds where google bot can index the sites and also Add sitemap.xml file location with domain in robots.txt.
Creator of TinkerHost, the no-cost hosting platform for beginners and small businesses! I enjoy programming and PHP and SQL, and learning about new technologies and techniques for building websites.
Thanks for the reply! Unfortunately, all the pages marked as that are in my site map, and are not restricted by robots.txt. The files that are rerun an error instead.
It is definitely not a robots.txt thing. If pages are blocked by robots.txt then they won't show up in Google search console at all. Google's crawler respects robots.txt so won't crawl stuff if you direct them not to.
Anyway, there isn't really anything you can do to make them index those pages quicker. The fact that they crawled them is the first step. If they were listed as duplicates, or that Google selected a different url as canonical, or something similar, would be a different story. You'll likely see the number of pages marked as "crawled currently not indexed" go down over time as Google adds them to index, or excludes them for other reasons.
Creator of TinkerHost, the no-cost hosting platform for beginners and small businesses! I enjoy programming and PHP and SQL, and learning about new technologies and techniques for building websites.
Even without seeing your robots.txt it was clear that wasn't the cause, as Google won't even crawl those. Just be patient with the ones marked as "crawled not currently indexed." Google doesn't instantly index the pages they crawl, and doesn't necessarily index all that they crawl. It sounds like your site is new since you mentioned a week ago. Watch for other reasons pages are excluded. The "crawled currently not indexed" status is where pages end up before either being indexed or excluded for other reasons. Some pages may stay in that status for longer than others. On my domain, there are close to 400 urls that are indexed currently, and around 80 with the status "crawled currently not indexed." Some of those will likely be indexed in the future. Others may stay in that status indefinitely.
Creator of TinkerHost, the no-cost hosting platform for beginners and small businesses! I enjoy programming and PHP and SQL, and learning about new technologies and techniques for building websites.
i also had the same issue but there is a way:
robots.txtis written correctly which finds where google bot can index the sites and also Addsitemap.xmlfile location with domain inrobots.txt.Thanks for the reply! Unfortunately, all the pages marked as that are in my site map, and are not restricted by robots.txt. The files that are rerun an error instead.
It is definitely not a robots.txt thing. If pages are blocked by robots.txt then they won't show up in Google search console at all. Google's crawler respects robots.txt so won't crawl stuff if you direct them not to.
Anyway, there isn't really anything you can do to make them index those pages quicker. The fact that they crawled them is the first step. If they were listed as duplicates, or that Google selected a different url as canonical, or something similar, would be a different story. You'll likely see the number of pages marked as "crawled currently not indexed" go down over time as Google adds them to index, or excludes them for other reasons.
Please see post edit
Even without seeing your robots.txt it was clear that wasn't the cause, as Google won't even crawl those. Just be patient with the ones marked as "crawled not currently indexed." Google doesn't instantly index the pages they crawl, and doesn't necessarily index all that they crawl. It sounds like your site is new since you mentioned a week ago. Watch for other reasons pages are excluded. The "crawled currently not indexed" status is where pages end up before either being indexed or excluded for other reasons. Some pages may stay in that status for longer than others. On my domain, there are close to 400 urls that are indexed currently, and around 80 with the status "crawled currently not indexed." Some of those will likely be indexed in the future. Others may stay in that status indefinitely.
Thanks. I read this part wrong, mistakenly thinking you sad that was the issue! “It is definitely not a robots.txt thing”.
I was worried that there was nothing I could do, although I kind of expected it. Thanks for the conformation though.