now.calpoly.edu
robots.txt

Robots Exclusion Standard data for now.calpoly.edu

Resource Scan

Scan Details

Site Domain now.calpoly.edu
Base Domain calpoly.edu
Scan Status Ok
Last Scan2025-08-25T23:44:46+00:00
Next Scan 2025-09-08T23:44:46+00:00

Last Scan

Scanned2025-08-25T23:44:46+00:00
URL https://now.calpoly.edu/robots.txt
Domain IPs 13.68.101.62
Response IP 13.68.101.62
Found Yes
Hash 304454408626429288f123906b844a65529bf659d86b7263df4cd6210899d2ee
SimHash ed145c14e95b

Groups

*

Rule Path
Disallow /notfound
Disallow /forbidden
Disallow /error
Disallow /api/
Disallow /engage/

Other Records

Field Value
sitemap https://now.calpoly.edu/sitemap.xml