If you have a blog that you don't want indexed by Google Search, you block it from being indexed using the selections in Settings - Basic. Sometimes, you may have a blog that you do want indexed, but specific posts that you do not want indexed.
You can block individual posts from being indexed, using Google Webmaster Tools, and the URL removal request tool.
The URL removal request tool is accessed from the "Crawler access" wizard in "Site configuration". Note the advice provided, first.
Note that you will be required to verify that the specific URL is returning a "404" or "410" in the "Crawl errors" or similar diagnostic report, before continuing. You'll also be asked for the removal reason.
>> Top
You can block individual posts from being indexed, using Google Webmaster Tools, and the URL removal request tool.
The URL removal request tool is accessed from the "Crawler access" wizard in "Site configuration". Note the advice provided, first.
If private or out-of-date content is appearing in Google search results, use the Removal URL tool to request its removal (but first, make sure to review our removal requirements).Having fulfilled the requirements, hit the "New removal request" button, and enter the URL of the post in question.
Note that you will be required to verify that the specific URL is returning a "404" or "410" in the "Crawl errors" or similar diagnostic report, before continuing. You'll also be asked for the removal reason.
- Remove page from search results and cache
- Remove page from cache only
- Remove directory
>> Top
Comments
I currently have 33 robots.txt on search terms, but I did not set it up that way on purpose and I want to remove the robots.txt.
http://blogging.nitecruzr.net/2008/04/controlling-search-engine-spiders.html