website information and technology stack
Web technologies detected on this domain5 technologies
Web technologies detected across all robotstxt.org subdomains10 technologies
Advertisers detected on this domain1 technology
Website rank1,613
Website Location GB
Last technology updateMarch, 2024
Total robotstxt.org subdomain count1 subdomain
Top ranking subdomain www.robotstxt.org (Rank: 1,613)
IP Address93.93.131.3
Reverse IP446 websites share IP address.
Autonomous System Number (ASN)AS44684 (MYTHIC)
Total linking domains226 domains
Total linking IP161 IPs

Technology Stack

List of detected technologies used on the website.
TechnologyTechnology TypeVersionFirst detected
ApacheWeb Servers2.4.38December, 2023
DebianOperating SystemsDecember, 2023
DoubleClick Ad Exchange (AdX)Advertising NetworksDecember, 2023
Google AdSenseAdvertising NetworksDecember, 2023
JavaScriptDocument StandardsDecember, 2023


List of detected advertisers used on the website.
TechnologyTechnology TypeVersionFirst detected
google.com DirectAds.txtDecember, 2023

Uncommon response headers

List of uncommon response headers that were used by the website.
ServerApache/2.4.38 (Debian)