Create Custom Robots.txt File and Increase Traffic on your Website

Create Custom Robots.txt File and Increase Traffic on your Website

Custom Robots.txt file plays a most important rule while indexing your pages on Google Search Console which will help you get more organic traffic by ranking your website on Google.
So before we create a Custom Robots.txt lets see what is Custom Robots.txt File.
Create Custom Robots.txt File and Increase Traffic on your Website


What is Custom Robots.txt File?

Custom Robots.txt is a text file on the server in that you can write which directories and web pages or links should not be included for search results. It means you can restrict search engine bots to crawl some directories and web pages or links of your website or blog. Now custom robots.txt is available for Blogger.

This Custom Robots.txt File will help you rank your website when you submit your Sitemap in sitemaps section in the Google Search Console.

If you don't know how to submit a sitemap in the Google Search Console to index your posts then click on the below link.

Manually Index your Blogger Posts on Google Search Console!

How to Create Custom Robots.txt File?

Creating Custom Robots.txt file is so simple just replace the text in double quotes with your website address in the below code.


User-agent: *

Disallow: /search
Allow: /

Sitemap: http://"www.yoursite.com"/atom.xml?redirect=false&start-index=1&max-results=500

After replacing this text in the double quotes with your site address your Custom Robots.txt file is successfully created!

here is a featured video from my youtube channel
Now you have to paste it in your blogger, to do that head over to the settings section in the blogger and click on search preferences.
There you can find Custom robots.txt section which is initially disabled, you need to enable it, on enabling it will show a text box where you need paste the above code.
Now save the Custom robots.txt file and that's it, you have successfully created the custom robots.txt file.

Comments

  1. I do not even know how I finished up right here, however I believed this publish was good. I do not realize who you’re but certainly you are going to a well-known blogger when you are not already Cheers! www.dynamicmarketing.sg

    ReplyDelete
  2. Good post but I was wondering if you could write a litte more on this subject? I’d be very thankful if you could elaborate a little bit further. Appreciate it! increase website traffic free software

    ReplyDelete

Post a Comment