Presently Blogger has completed his work on sitemap.xml. Now Blogger is reading sitemap entries through the feed. By this method, the most recent 25 posts are submitted to search engines. If you want search engine, bots, only work on the most recent 25 posts, and then you should use robots.txt type 1 given below. If you set robots.txt like this, then the Google Adsense bot can crawl the entire blog for the best Adsense performance.
Robots.txt Type 1
Note: You may alter Blogspot’s default robots.txt like above.’
Robots.txt Type 2
Note: Don’t forget to change the https://www.techprevue.blogspot.com with your blog address or a custom domain. If you want search engine bots to crawl the most recent 500 posts, you should need to use the following robots.txt type 2. If you already have more than 500 posts on your blog, you can add one more sitemap line highlighted in red. Robots.txt
Robots.txt Type 3
Note: Don’t forget to change the https://www.techprevue.blogspot.com with your blog address or a custom domain. Mathematical expression for Blogger robots.txt sitemap entries: Where m=500 and n=1, 2, 3, 4,…, n. If you have organized post labels in a good format and good experience of search engine optimization (SEO), then you can remove the following line – Most important: if you don’t want to submit any blogger post or page to search engines, then you can add them like that: For Post, add a line like that – For Page add a line like that –
Manage Blogger custom robots.txt
For this, please follow these steps carefully. Dashboard ›› Blog’s Settings ›› Search Preferences ›› Crawlers and indexing ›› Custom robots.txt ›› Edit ›› Yes To get a better understanding of this you can take reference of the image given below:
I hope you’ll benefit from this post and get a better search engine presence and ranking.
