InfoHeap
Tech tutorials, tips, tools and more
Navigation
  • Home
  • Tutorials
    • CSS tutorials & examples
    • CSS properties
    • Javascript cookbook
    • Linux/Unix Command Line
    • Mac
    • PHP
      • PHP functions online
      • PHP regex
    • WordPress
  • Online Tools
    • Text utilities
    • Online Lint Tools
search

robots.txt

  • Online robots.txt check
  • wildcard
  • disallow all
  • resubmit robots.txt to Google
  • Googlebot and js, css crawl
  • robot noindex, follow for wordpress
  • Allow Google adsense bot
  • parse robots.txt using python
 
  • Home
  • > Tutorials
  • > Web Development
  • > SEO
  • > robots.txt

How to resubmit robots.txt to Google

on Feb 4, 2016

An error in robots.txt can cause Google to stop crawling a section of your site. In such case it is good to update and resubmit you robots.txt to Google proactively. Assuming that you have owned your website in Google search console, here are the steps to resubmit your site.

  1. Click on Crawl > robots.txt Tester in Google search console (webmaster tools).
    google-search-console-robots-txt-tester
  2. Click on Submit button below the robots.txt file text area.
  3. You see a popup as shown below with few options. Click on submit button next to “Ask google to update”.
    google-search-console-submit-robots-txt
  4. After sometime, check robots.txt in Tester page again. You should be able to see updated robots.txt.

Suggested posts:

  1. Should I block Googlebot from crawling javascript and css?
  2. Xml sitemap – quick introduction
  3. How to undo HTTP 301 site/domain redirect
  4. How to use wildcard in robots.txt
  5. robots.txt disallow all example
  6. How to become Google verified author of your wordpress blog using Google+ profile
  7. Using robotexclusionrulesparser python module to parse robots.txt and crawl a site
  8. How to prevent your test blog from google crawling but show adsense ads
Share this article: share on facebook share on linkedin tweet this submit to reddit
Posted in Tutorials | Tagged robots.txt, SEO, Tutorials, Webmaster

Follow InfoHeap

facebook
twitter
googleplus
  • Browse site
  • Article Topics
  • Article archives
  • Recent Articles
  • Contact Us
  • Omoney
Popular Topics: Android Development | AngularJS | Apache | AWS and EC2 | Bash shell scripting | Chrome developer tools | CSS | CSS cookbook | CSS properties | CSS Pseudo Classes | CSS selectors | CSS3 | CSS3 flexbox | Devops | Git | HTML | HTML5 | Java | Javascript | Javascript cookbook | Javascript DOM | jQuery | Kubernetes | Linux | Linux/Unix Command Line | Mac | Mac Command Line | Mysql | Networking | Node.js | Online Tools | PHP | PHP cookbook | PHP Regex | Python | Python array | Python cookbook | SEO | Site Performance | SSH | Ubuntu Linux | Web Development | Webmaster | Wordpress | Wordpress customization | Wordpress How To | Wordpress Mysql Queries

Copyright © 2023 InfoHeap.

Powered by WordPress