The Robots Tag allow you the way how your website will be crawled by all search engines.
Four Types of Meta Robots tag are as below:
1. Index, Follow
2. Index, NoFollow
3. NoIndex, Follow
4. NoIndex, NoFollow
1. Index, Follow : This type of robots tag determines that search engine robots will start crawling your website from the index page and then will continue to the another website pages.
2. Index, NoFollow : This type of robots tag determines that search engine robots will start crawling your website from the index page and then will continue to the another website pages.
3. NoIndex, Follow : This type of robots tag determines that search engine robots will skip index page , but will crawl another pages of the website.
4. NoIndex, NoFollow : This type of robots tag determines that none of the website pages will be crawled by the robot and your website will not be indexes by the search engines.
Example of meta robots tag
<meta name=robots content="index,follow" >