yellowsquared.us
robots.txt

Robots Exclusion Standard data for yellowsquared.us

Resource Scan

Scan Details

Site Domain yellowsquared.us
Base Domain yellowsquared.us
Scan Status Ok
Last Scan2025-11-30T02:23:15+00:00
Next Scan 2025-12-07T02:23:15+00:00

Last Scan

Scanned2025-11-30T02:23:15+00:00
URL https://yellowsquared.us/robots.txt
Domain IPs 104.21.32.109, 172.67.185.244, 2606:4700:3030::6815:206d, 2606:4700:3035::ac43:b9f4
Response IP 172.67.185.244
Found Yes
Hash 08c1deccd77ef362b124b8fcbdaaa735df4bb2061015bd4761c76dbd2e590725
SimHash 2a211bcb8e32

Groups

*

Rule Path
Allow /
Allow /llms.txt
Allow /agents.txt
Disallow /reset_password.html
Disallow /email_verified.html

Other Records

Field Value
sitemap https://yellowsquared.us/sitemap.xml

Comments

  • Sitemap
  • Allow crawling of important files for LLMs and AI agents
  • Disallow sensitive files