Hello, if your blogger user and you want to edit a custom robot txt and header tag for a blogger. So in this article, you will learn, How To Edit Custom Robot Txt And Header Tag In Blogger?
we explain custom robot text step by step. you need not worry about your site indexing on the google search engine. Just you have to follow this post clearly.
What is a robots.txt file?
Custom robot txt: Crawlers and indexing your site fast on the google search engine. it helps to grow the audience on your site and post, pages. Do SEO strategies on your site.
Robots.txt is a text file that informs web crawlers (spiders or bots) about which parts of a website or blog to be crawled and which parts should not be crawled. That file is known as a robots.txt file.
Edit custom robots.txt for blogger/blogpost index fast
Robot.txt header tag help to a website or blog, post, page and archive. Which pages and posts should be indexed in the google search engine?
For example, you may have a file for internal use – and it is of no use for the search engines. You don’t want this file to appear in search results. Therefore, it is prudent to hide such files from search engines.
Below are three images related to robots tag where you can enable each as your requirements of a website or blog. I suggest enabling the header tag which shows in the images below.
If you successfully enable robot tags to your site, Now you have to edit custom robots.txt file below step by step.
Why robots.txt file too important for index on google
Robots.txt file play major role in crawling your website. Where you allow search engine bots or crawler to your site, where what allowed data or link of your website goto index on google search engine.
Robots.txt file contains directives which all the top search engines honor. Using these directives you can give instructions to web spiders to ignore certain portions of your website.
Also you can disallow some link which should not be no search engine or public.
How to Edit Custom robots.txt file for blogger
if you have already listed the website on the Google search engine. You have doubts about why not show page or post in Google search.
Here we clear all doubts about you.
Open a browser and go to https://blogger.com and open settings Scroll down there you found Custom Robot text.
Click on it and open it there you have do these settings.
Add or edit robots.txt for blogger step are following.
User-agent: Mediapartners-Google
Disallow:
User-agent: *
Disallow: /search
Allow: /
Sitemap: http://example.blogspot.com/feeds/posts/default?orderby=UPDATED
- Go to your blogger dashboard
- Open Settings > Search Preferences > Crawlers and indexing > Custom robots.txt > Edit > Yes
- Here you can make changes in the robots.txt file
- After making changes, click the Save Changes button
- Open the settings of robots.txt file
- Copy the above code or txt file to the robots.txt section
- Edit your site map https://example.blogspot.com/ than leave as at is.
- Now you successfully edit your site robots.txt file you can check
- URl. http://www.yourblog.blogspot.com/robots.txt
Details and explanation for robots.txt file
Wildcards
Following wildcard characters are often used in robots.txt files.
* means all, everything
/ means root directory
User-agent
This directive indicates the web crawlers to which the settings in robots.txt will apply.
Disallow
It directs the web crawlers not to crawl the indicated directory or file. For example
Disallow: / would tell the web crawler not to crawl anything in your blog (because you’re disallowing the root directory).
Disallow: /dir/* would direct web crawler not to crawl any file under /dir/ directory.
Disallow: /dir/myfile.htm would direct web crawler not to crawl myfile.htm under the dir folder. Crawler will crawl all other files under the dir directory.
Allow
Thi directive special asks a web crawler to crawl a particular directory or file of a particular blog site. For example:
Disallow: /dir/myfile.htm
Allow: /dir/myfile.htm
meaning of the above two lines is that the crawler should crawl /dir/myfile.htm
The first line bars the crawler but the second line again allows the crawler to crawl website.
Conclusion
So when you update above all settings or apply these on your site, you’re site or blog will able crawling by google bot. Also read this article too learn seo for blogger
Thanks for reading this article comments for community
