What is x-robots-tag

When you want to block the indexing of some specific pages of a site, you just have to use the meta robots noindex tag. But to do this with documents that are not in HTML format, like PDF documents, audio, Word, Excel, Powerpoint, etc., Google and Yahoo manage the X-Robots-Tag directive. This helps declare directly…
Read more