x-is-crawler

HTTP response header

Header usage statistics

x-is-crawler response header information and usage statistics.

Websites using header x-is-crawler 290
Percentage of websites that use x-is-crawler header <0.1%
Total discovered header values 2
Header uses directives No
Header values are unique or random No
Most popular in the country United States of America

Distribution by websites popularity

x-is-crawler detection in the top websites by popularity

Top 10k sites 3 websites
Top 100k sites 23 websites
Top 1m sites 103 websites

Websites utilizing x-is-crawler

List of websites that use x-is-crawler header

Domain Country Rank Contacts
stackoverflow.com United States of America 63
crypto.stackexchange.com United States of America 3,391
space.stackexchange.com United States of America 3,621
superuser.com United States of America 11,329
askubuntu.com United States of America 13,063
serverfault.com United States of America 16,517
See full domain list

Geographical Distribution

Header usage distribution by websites across the globe.






Common header values

List of top common x-is-crawler header values

Header value Value prevalence
0 94.48%
1 5.52%