x-googlenews-bot

you say to your clients you will crawl their sites as googlebot crawls. And then you should be sure of requesting the same HTTP headers as googlebot from their servers. The response information and later data you collect from a server depend on what you request in your crawlers HTTP headers.

Header usage statistics

x-googlenews-bot response header information and usage statistics.

Websites using header x-googlenews-bot	438
Percentage of websites that use x-googlenews-bot header	<0.1%
Total discovered header values	1
Header uses directives	No
Header values are unique or random	No
Most popular in the country	United States