Example of statement to allow indexing but deny crawling:

[shaownhasan]

robots
The attribute value robots specifies information for search engine crawlers. The information specified is whether to allow or deny indexing, and whether to allow or deny following links (crawling). Two pieces of information can also be specified by separating them with a comma.

<meta name="robots" content="index,nofollow">

generator
The generator attribute value specifies the software used to create the page's documentation. Enter chile phone number resource the name of the software in the content attribute.

Example:
<meta name="generator" content="Software used to create the document">

application-name
The attribute value application-name specifies the name of the web application. The content attribute contains the web application name. Added in HTML5.

Example:
<meta name="application-name" content="Web application name">