By default, Googlebot will index a page and follow links to it.
You can use a special HTML <META> tag to tell robots not to index the content of a page, and/or not scan it for links to follow.
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
In the majority of cases this is only used on development or staging sites and not used on live websites.
This extension generates a notification if a robots meta tag is found with either "noindex" or "nofollow" in the contents.