Pages

Showing posts with label indexing. Show all posts
Showing posts with label indexing. Show all posts

Wednesday, July 27, 2011

Stop Search Engines to Indexing your site

This is something unrelated to IBM WCS but I encountered a situation where I had to do this on a IBM WCS powered ecommerce site.
To prevent a Search Engine from indexing a page, place the code below between the <HEAD> and </HEAD> tags.


<META NAME="ROBOTS" CONTENT="NOINDEX,NOFOLLOW">

This tag tells the robots not to index this page and not to follow any links within the page.

<META NAME="ROBOTS" CONTENT="NOINDEX,FOLLOW">

This tag tells the robots not to index this page, but follow any links within the page.


Another way is to place a Robots.txt file under the webroot folder of the webserver with the following contents


User-agent: *
Disallow: /
 
This will disallow indexing on the whole site