toot.cat
robots.txt

Robots Exclusion Standard data for toot.cat

Resource Scan

Scan Details

Site Domain toot.cat
Base Domain toot.cat
Scan Status Ok
Last Scan2024-10-02T02:35:38+00:00
Next Scan 2024-10-03T02:35:38+00:00

Last Scan

Scanned2024-10-02T02:35:38+00:00
URL https://toot.cat/robots.txt
Domain IPs 2a01:4ff:f0:b12f::1, 5.161.31.3
Response IP 5.161.31.3
Found Yes
Hash 3f7d04d1d3cf30c8aa79a133e7c16a02940c2d5844fae26d01be60ccc59721fd
SimHash aa74baa5f763

Groups

gptbot

Rule Path
Disallow /

content-nation

Rule Path
Disallow /

*

Rule Path
Disallow /media_proxy/
Disallow /interact/

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file