Median UI 1.6 Premium Blogger Template Free Download

Someone asked me about the robot.txt setting used on this blog. Then I answered that timeseo current robot.txt settings are:

User-agent: *
Disallow: /search
Allow: /
Sitemap: https://www.andisyam.web.id/sitemap.xml

Previously, I had never done any settings for robot.txt on the Blogger platform. However, after reading the Google Webmaster robot.txt guide and the latest Google Adsense robot.txt , I then took the initiative to activate the txt robot in the Settings menu > Blogger search preferences .

This txt robot setting has only been running for about "2 weeks" (from this article published), and there has been no significant change in traffic. But until 2019 there was a positive effect on the "blogs" (blogger platforms) that I managed, namely the index time on Google became faster coupled with fetching as Google urls on Google webmasters, rather than me not setting this Robot.txt .

If you want to manually activate and install this special "correct" robot.txt (according to me personally) for the Blogger platform just like Andisyam's blog, the method is very easy:

Login to blogger.com

Click Settings

Select Search preferences

Then, Edit in the special robot.txt section

Select Yes to Enable custom robots.txt content? and open a column

Copy and paste the code that I have given above into the open robot.txt costume column

change https://www.andisyam.web.id with your domain

If so, Save for changes

That's how to activate robottxt for the Blogger platform and the same code as this blog.

For the Custom robots header tag setting, I didn't enable it. As for custom ads.txt, read:

How to Solve Google Adsense Ads.txt Problems on the Blogger Platform

A & Q

A: Why every robot.txt check for Blogger platform blogs is always a 404 page?

Q: I don't know, but what I understand is that it doesn't interfere with indexing in the SERP

Note! If in the future you experience a decrease in traffic and lose your position in the SERP with a "long" duration (at least 2 months) due to following the installation of Andisyam's robottxt blog, I recommend returning to the initial robot.txt settings.