psu.social
robots.txt

Robots Exclusion Standard data for psu.social

Resource Scan

Scan Details

Site Domain psu.social
Base Domain psu.social
Scan Status Ok
Last Scan2025-10-19T13:40:01+00:00
Next Scan 2025-10-20T13:40:01+00:00

Last Scan

Scanned2025-10-19T13:40:01+00:00
URL https://psu.social/robots.txt
Domain IPs 104.21.49.109, 172.67.189.194, 2606:4700:3033::ac43:bdc2, 2606:4700:3037::6815:316d
Response IP 104.21.49.109
Found Yes
Hash ed1dea361406dfab5f3b7b877959b7d1403d86943b8727f86c4fdfb5a8aa6b55
SimHash aa549a84f762

Groups

gptbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

*

Rule Path
Disallow /media_proxy/
Disallow /interact/

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file