Create a Meta Robots Tag

Sometimes you may not actually want the search engine spiders to visit certain pages within your Web site. Although this is often not the case, especially because the goals of search-engine optimization are to increase search-engine-generated traffic, there are situations where the privacy of a particular Web page or Web site is of utmost concern. The meta robots tag allows you to identify what pages the search engines are allowed to index in their results pages and whether or not they are allowed to follow links on those pages to other Web pages or Web sites. This is especially useful if certain sections of your Web site require payment to access. The last thing you want is search engines sending visitors directly to those locations.