It is very easy to add/edit the robot.txt file in Blogger but you will have to take full information about the robot.txt file Below link because this file is very necessary with the purpose of SEO, the search engineer is very easy to crawl content from your website.
How to add a Robots.txt file to Blogger
In Blogger, you can go to the option setting of the robots.txt file and get it in the search preferences when we make our Blogspot blog SEO friendly, then we get the option of this robots.txt file, as the other people leave it. If you skip this option, then the blogger automatically creates the best robots.txt file for you, but if you want to have some parts hidden from your blog to the search engine then you can use it but if you take blogging seriously Have been So when you migrate Blogspot to WordPress then you should use this feature. Now let us learn how to add this file to Blogspot blog. Before that let us know about some things that you will use in this file.
Robot.txt syntax for Blogspot blog
- Allow: If you allow something inside the text file, it means that you want this part to appear in the search engine
- Disallow: If you disallow a post, it means that you do not want these parts to appear in search engines
- User-agent: By using this option you can show your visitors what they want to appear on their site, such as the source of the image, saying this file is SAV etc.
- User-agent: Mediapartners-Google: Using this, you can hide the Adsense code from the user if you disallow it, Google Adsense will not show ads on your site.
- Go to the settings of the blogger and click on the search preferences then click on robots.txt then click on edit.
- Now you have to copy the code below and paste it into the box and save it
Disallow: / search
Note: Place your sitemap on the sitemap instead of setting the setting
This way, you can do some blogs and show on your blogspot blog by placing it in the robots.txt file and if you are using a blogger then this feature will not be good for you and if you use the WordPress use If you are using this feature, please use it.