start learning
Image 1

Meta Robots tag

Role: Instructs search engines on how to crawl and index the page.
Importance: Controls whether search engines should index the page and follow links, crucial for SEO strategy.

    <meta name="robots" content="index, follow">

All the Meta Robots tag values that are commonly used:

  1. index
  2. noindex
  3. follow
  4. nofollow
  5. noarchive
  6. nosnippet
  7. noodp (no longer relevant, used to prevent using the Open Directory Project description)
  8. notranslate
  9. noimageindex
  10. unavailable_after: [date]
  11. max-snippet:[number]
  12. max-image-preview:[setting] (settings: none, standard, large)
  13. max-video-preview:[number]

These values can be combined to give specific instructions to search engine crawlers. For example, noindex, nofollow means the page should not be indexed and its links should not be followed.
The combined Meta Robots tag values commonly used together:

  1. index, follow
  2. noindex, follow
  3. index, nofollow
  4. noindex, nofollow
  5. noarchive, nosnippet
  6. noindex, noarchive
  7. index, noarchive
  8. noindex, noarchive, nofollow
  9. noindex, noarchive, nosnippet
  10. noindex, nofollow, noarchive
  11. noindex, nofollow, noarchive, nosnippet
  12. noindex, nofollow, noimageindex
  13. noindex, nofollow, unavailable_after: [date]
  14. index, follow, noarchive
  15. index, follow, noimageindex
  16. index, follow, noarchive, nosnippet
  17. index, follow, noarchive, max-snippet:[number]
  18. index, follow, max-image-preview:[setting] (settings: none, standard, large)
  19. index, follow, max-video-preview:[number]

These combinations can be used to fine-tune how search engines interact with your web pages.

Meta Robots tag must be placed between the <head> and </head> as follow:

<!DOCTYPE html>
    <meta name="robots" content="index, follow">
    <title>Sample Page</title>
      <!-- body content here -->
        <!-- Footer content here -->