Pages

Wednesday, July 27, 2011

Stop Search Engines to Indexing your site

This is something unrelated to IBM WCS but I encountered a situation where I had to do this on a IBM WCS powered ecommerce site.
To prevent a Search Engine from indexing a page, place the code below between the <HEAD> and </HEAD> tags.


<META NAME="ROBOTS" CONTENT="NOINDEX,NOFOLLOW">

This tag tells the robots not to index this page and not to follow any links within the page.

<META NAME="ROBOTS" CONTENT="NOINDEX,FOLLOW">

This tag tells the robots not to index this page, but follow any links within the page.


Another way is to place a Robots.txt file under the webroot folder of the webserver with the following contents


User-agent: *
Disallow: /
 
This will disallow indexing on the whole site 

No comments:

Post a Comment