DEV Community

Devs, make sure your page is searchable!

Igor Irianto on February 04, 2020

The Issue Ever since launching my site, https://irian.to/, I found that I couldn't google any page on my site. For example, when I googl...
Collapse
 
ajeet profile image
Ajeet Yadav

Hey Igor,

You can google this "site:your_site" to see the indexed psots by google.
For example, site:ajeet.dev

site-indexing-status

Collapse
 
chandrasd profile image
Chandra Dasari

On a side note if you tried
site:facebook.com -www

You would get all the subdomains that are indexed by google.

Collapse
 
iggredible profile image
Igor Irianto • Edited

Oh nice! What's the difference between googling with site: and without it? (What is "indexed" search?)

Collapse
 
ajeet profile image
Ajeet Yadav

Quoting from this site: shoutmeloud.com/google-crawling-an...
"In layman’s terms, indexing is the process of adding web pages into Google search."

If you use "site:your_site", you will get a list of your indexed posts/pages/categories/etc that are indexed by google.

You should also read this article - how search engine works :)

moz.com/beginners-guide-to-seo/how...

Thread Thread
 
iggredible profile image
Igor Irianto

Just did this today at work. We were researching something and my coworker suggested using "site:further_query" method. Much thanks for sharing Ajeet!

Thread Thread
 
ajeet profile image
Ajeet Yadav

Your welcome 😊

Collapse
 
michaeltharrington profile image
Michael Tharrington

This seems like an appropriate place to remind folks that they're able to use canonical URLs when posting on DEV!

From the DEV FAQ:

https://p78.f0.n0.cdn.getcloudapp.com/items/yAuLONYD/Image+2020-02-04+at+5.51.41+PM.png?v=9b95576b7153223502f65fffff78ebd3

If you are sharing any work on DEV that you previously posted elsewhere, it's a good idea to add "canonical_url: blogname.com/postname" to the Front Matter of the post if using the "basic markdown" editor. If using the "rich + markdown" version of the editor, just click on the three-dots menu when writing your post and you'll see the option to input your canonical.

By the way, if you're not quite sure which editor version you're using or didn't even realize that there are different editor versions, 🀯 just go here in your settings and poke around!

Collapse
 
iggredible profile image
Igor Irianto • Edited

Very nice!! I wasn't aware of this feature either. I am going to go back to every single blogs that I cross-posted and adding this.
You are awesome. So glad you posted this. 😎

Btw for those who don't know canonical url: yoast.com/what-is-a-canonical-url/

Collapse
 
michaeltharrington profile image
Michael Tharrington • Edited

No problem! Happy to help. πŸ˜€

And good thinking on providing the explanation of what a canonical url is β€” definitely important for anyone who plans on cross posting to be aware of this!

Collapse
 
patryktech profile image
Patryk

You should submit a sitemap.xml file to Google, rather than manually adding each page.

Collapse
 
ajeet profile image
Ajeet Yadav

Agree with Patryk. Generate a sitemap and submit to google console periodically. Sitemaps looks like this: ajeet.dev/sitemap.xml

Collapse
 
iggredible profile image
Igor Irianto

Is it a good practice to update sitemap and submit to google every time I add new page?
If not, what's a good frequency?

Thread Thread
 
patryktech profile image
Patryk

Normally, as long as Google knows to index your site and follow links, it shouldn't really be necessary, but it doesn't really hurt. It's just a PITA to do it manually.

You can always submit a sitemapindex to Google, and generate a new sitemap every time you add a page (I presume you mean blog posts). Then Google will pull your sitemap periodically, and should update its index without intervention.

If you can automate the sitemap generation as part of your workflow (e.g. in the save signal on a Post model in Django), that would require basically zero manual intervention.

Collapse
 
downey profile image
Tim Downey

Google can also discover your site on its own if another site links to it. This + submitting my sitemap initially is usually enough for my site.

If you're cross-posting content to DEV from your blog you could try adding an "Originally posted on " line to the DEV post.

Collapse
 
iggredible profile image
Igor Irianto

I knew that more cross-referencing (backlinking?) helps with SEO but didn't know that it helps with unindexed files discoverability. Lots of good insight here πŸ‘

Collapse
 
ericathedev profile image
Erica Tanti

Thank you for an easy to follow guide! πŸ™ŒMaking my site searchable didn't cross my mind when I created my website recently! I managed to set up Google indexing on my own site successfully.

Regarding the sitemap, I submitted it specifically to the Google Search Console here:

Google Search Console, Sitemaps section

When submitting the sitemap a popup told me that Google would index the sitemap automatically and would let me know if there were any problems indexing the sitemap in future.

Collapse
 
iggredible profile image
Igor Irianto

Glad you found this helpful πŸ‘

Collapse
 
colinmcdermott profile image
Colin McDermott

The method you described is useful also, especially if the page has not been indexed already.