X-Robots

HTTP response header

Header usage statistics

X-Robots response header information and usage statistics.
Websites using header X-Robots129
Percentage of websites that use X-Robots header<0.1%
Total discovered header values18
Header uses directivesNo
Header values are unique or randomNo
Most popular in the country United States

X-Robots Directives

X-Robots directives value information and usage statistics
DirectiveShareWebsites countUnique Values

X-Robots header usage distribution by website rank



Geographical Distribution

Header usage distribution by websites across the globe.



Websites utilizing X-Robots

List of websites that use X-Robots header
DomainCountryRankContacts
bildagentur.panthermedia.net Germany110,322
www.lavacamedcen.com United States224,258
stockagency.panthermedia.net United States346,050
flimmit.at Austria408,057
webmail.simply.com Denmark417,045
www.myfidelio.at Austria544,952
See full domain list

Common header values

List of top common X-Robots header values
Header valueValue prevalence
noarchive,noodp,noydir20.93%
noai, noimageai13.18%
noindex,nofollow13.18%
noindex12.40%
noindex, nofollow, noarchive12.40%
noindex, nofollow10.85%
no-index3.88%
follow2.33%
noindex,follow2.33%
follow, index, noarchive, max-snippet:-1, max-video-preview:-1, max-image-preview:large1.55%
noindex,noarchive,nosnippet,nofollow1.55%
All0.78%
all,index,follow0.78%
index, follow0.78%
index, follow, archive0.78%
index, follow, max-image-preview:large, max-snippet:-1, max-video-preview:-10.78%
index,follow0.78%
noindex, noarchive, nosnippet0.78%