t.co
robots.txt

Robots Exclusion Standard data for t.co

Resource Scan

Scan Details

Site Domain t.co
Base Domain t.co
Scan Status Ok
Last Scan2024-09-21T16:45:41+00:00
Next Scan 2024-10-21T16:45:41+00:00

Last Scan

Scanned2024-09-21T16:45:41+00:00
URL https://t.co/robots.txt
Domain IPs 172.66.0.227
Response IP 162.159.140.229
Found Yes
Hash c49cd659c742fc58285a85a9d4a98158a879c9654ef2fc36e86f3c9de5b50dd2
SimHash 885c5a0047d4

Groups

twitterbot

Rule Path
Disallow

googlebot

Rule Path
Disallow

*

Rule Path
Disallow /

Comments

  • Google Search Engine Robot