X-Is-Crawler

HTTP response header

Header usage statistics

X-Is-Crawler response header information and usage statistics.
Websites using header X-Is-Crawler6
Percentage of websites that use X-Is-Crawler header<0.1%
Total discovered header values2
Header uses directivesNo
Header values are unique or randomNo
Most popular in the country Germany

X-Is-Crawler Directives

X-Is-Crawler directives value information and usage statistics
DirectiveShareWebsites countUnique Values

X-Is-Crawler header usage distribution by website rank



Geographical Distribution

Header usage distribution by websites across the globe.



Websites utilizing X-Is-Crawler

List of websites that use X-Is-Crawler header
DomainCountryRankContacts
4eck-media.de Germany1,167,739
stackoverflow.microsoft.com United States2,308,480
weihnachtskalender.psd-tutorials.de Germany46,918,578
community.psd-tutorials.de Germany71,967,268
psd-tutorials.net Germany110,821,406
soedemo.stackenterprise.co United States112,563,662
See full domain list

Common header values

List of top common X-Is-Crawler header values
Header valueValue prevalence
false66.67%
033.33%