How to resubmit robots.txt to Google

on

An error in robots.txt can cause Google to stop crawling a section of your site. In such case it is good to update and resubmit you robots.txt to Google proactively. Assuming that you have owned your website in Google search console, here are the steps to resubmit your site.

  1. Click on Crawl > robots.txt Tester in Google search console (webmaster tools).
    google-search-console-robots-txt-tester
  2. Click on Submit button below the robots.txt file text area.
  3. You see a popup as shown below with few options. Click on submit button next to “Ask google to update”.
    google-search-console-submit-robots-txt
  4. After sometime, check robots.txt in Tester page again. You should be able to see updated robots.txt.

Suggested posts:

  1. robots.txt disallow all example
  2. How to remove urls from Google index using webmaster tools
  3. How to prevent your test blog from google crawling but show adsense ads
  4. Verify a web site in google search console (webmaster tools)
  5. How to use Google custom search with lazy loading approach
  6. How to use wildcard in robots.txt
  7. Should I block Googlebot from crawling javascript and css?
  8. Xml sitemap – quick introduction
Share this article: share on facebook share on linkedin tweet this submit to reddit
Posted in | Tagged , , ,