X-Robots

HTTP response header

Header usage statistics

X-Robots response header information and usage statistics.

Websites using header X-Robots 249
Percentage of websites that use X-Robots header <0.1%
Total discovered header values 6
Header uses directives No
Header values are unique or random No
Most popular in the country United States of America

Distribution by websites popularity

X-Robots detection in the top websites by popularity

Top 10k sites 0 websites
Top 100k sites 3 websites
Top 1m sites 24 websites

Websites utilizing X-Robots

List of websites that use X-Robots header

Domain Country Rank Contacts
gahanmeats.ie United States of America 19,490
www.gahanmeats.ie United States of America 19,490
www.keyneticsltd.co.uk United States of America 58,213
www.beatingtheblues.co.uk United States of America 214,720
hellomynameis.org.uk United States of America 221,613
www.hellomynameis.org.uk United States of America 221,613
See full domain list
Flat price per report, subscription is not required.

Geographical Distribution

Header usage distribution by websites across the globe.






Common header values

List of top common X-Robots header values

Header value Value prevalence
noindex 94.78%
noindex, nofollow, noarchive 2.41%
noarchive,noodp,noydir 1.20%
<Files ~ "\.pdf$">"noindex, nofollow"</Files> 0.80%
noindex, follow 0.40%
noindex, nofollow 0.40%