X-Robots-Tag Checker

X-Robots-Tag is an HTTP response header that provides the same directives as the robots meta tag (noindex, nofollow, etc.) but works for non-HTML resources like PDFs, images, and API responses.

Use X-Robots-Tag for non-HTML files (PDFs, images, videos) that can't contain meta tags, or when you need server-level control over indexation without modifying page content.

If both are present, search engines follow the most restrictive directive. A noindex in either the header or meta tag will prevent indexing. Ensure consistency to avoid unexpected behavior.