31.to
robots.txt

Robots Exclusion Standard data for 31.to

Resource Scan

Scan Details

Site Domain 31.to
Base Domain 31.to
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-14T04:15:10+00:00
Next Scan 2025-11-13T04:15:10+00:00

Last Successful Scan

Scanned2025-06-23T04:16:12+00:00
URL https://31.to/robots.txt
Redirect https://xyzcd.ai/robots.txt
Redirect Domain xyzcd.ai
Redirect Base xyzcd.ai
Domain IPs 104.21.62.133, 172.67.136.44, 2606:4700:3031::ac43:882c, 2606:4700:3037::6815:3e85
Redirect IPs 104.21.81.218, 172.67.165.58, 2606:4700:3034::6815:51da, 2606:4700:3034::ac43:a53a
Response IP 104.21.81.218
Found Yes
Hash 735679ba67d0a8c17b73a4c7e488464622da070531a21358dd13882d0775e462
SimHash 2d50d7242733

Groups

*

Rule Path
Allow /$
Allow /*.htm$
Allow /*.php$
Allow /*.xml$
Allow /*.txt$
Allow /*.jpg$
Allow /*.png$
Allow /*.gif$
Allow /tag/
Disallow /