keyword.io
robots.txt

Robots Exclusion Standard data for keyword.io

Resource Scan

Scan Details

Site Domain keyword.io
Base Domain keyword.io
Scan Status Ok
Last Scan2025-04-19T19:57:54+00:00
Next Scan 2025-04-26T19:57:54+00:00

Last Scan

Scanned2025-04-19T19:57:54+00:00
URL https://keyword.io/robots.txt
Domain IPs 104.21.65.226, 172.67.193.135, 2606:4700:3030::6815:41e2, 2606:4700:3037::ac43:c187
Response IP 104.21.65.226
Found Yes
Hash f7f765159eb1064ff0b8fa76d575018f41ba628a80c4ced8aaf07cb82456ecb6
SimHash 80541b8dd766

Groups

blexbot

Rule Path
Disallow /

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file

Warnings

  • 1 invalid line.