Friday, May 21, 2010

Google Webmaster Tools And URL Removal

If you have a blog that you don't want indexed by Google Search, you block it from being indexed using the selections in Settings - Basic. Sometimes, you may have a blog that you do want indexed, but specific posts that you do not want indexed.

You can block individual posts from being indexed, using Google Webmaster Tools, and the URL removal request tool.

The URL removal request tool is accessed from the "Crawler access" wizard in "Site configuration". Note the advice provided, first.
If private or out-of-date content is appearing in Google search results, use the Removal URL tool to request its removal (but first, make sure to review our removal requirements).
Having fulfilled the requirements, hit the "New removal request" button, and enter the URL of the post in question.

Note that you will be required to verify that the specific URL is returning a "404" or "410" in the "Crawl errors" or similar diagnostic report, before continuing. You'll also be asked for the removal reason.
  • Remove page from search results and cache
  • Remove page from cache only
  • Remove directory

>> Top

3 comments:

Just Another Thought Online said...

What if you have multiple crawl errors which are robots.txt and you never intentionally made those text files? How can you fix them?

I currently have 33 robots.txt on search terms, but I did not set it up that way on purpose and I want to remove the robots.txt.

Chuck said...

You can't remove the file - nor can you actually edit it. The absolutely best that you can do is make a few changes to the settings which control it.

http://blogging.nitecruzr.net/2008/04/controlling-search-engine-spiders.html

Dreatori Alexis said...

I love using this tool. It really makes the url removal easier. I have some web pages that need to be deleted on Google's indexed pages and the Webmaster tools did all the job.