X-IsCrawler

HTTP response header

Header usage statistics

X-IsCrawler response header information and usage statistics.
Websites using header X-IsCrawler19
Percentage of websites that use X-IsCrawler header<0.1%
Total discovered header values1
Header uses directivesNo
Header values are unique or randomNo
Most popular in the country United States

X-IsCrawler Directives

X-IsCrawler directives value information and usage statistics
DirectiveShareWebsites countUnique Values

X-IsCrawler header usage distribution by website rank



Geographical Distribution

Header usage distribution by websites across the globe.



Websites utilizing X-IsCrawler

List of websites that use X-IsCrawler header
DomainCountryRankContacts
toledoblade.com United States35,264
www.toledoblade.com United States35,264
pge.post-gazette.com United States448,685
liber.post-gazette.com United States463,939
plus.sites.post-gazette.com United States485,420
m.toledoblade.com United States1,599,927
See full domain list

Common header values

List of top common X-IsCrawler header values
Header valueValue prevalence
0100.00%