engineering.pitt.edu
robots.txt

Robots Exclusion Standard data for engineering.pitt.edu

Resource Scan

Scan Details

Site Domain engineering.pitt.edu
Base Domain pitt.edu
Scan Status Ok
Last Scan2025-11-20T00:55:51+00:00
Next Scan 2025-12-20T00:55:51+00:00

Last Scan

Scanned2025-11-20T00:55:51+00:00
URL https://engineering.pitt.edu/robots.txt
Domain IPs 136.142.9.37
Response IP 136.142.9.37
Found Yes
Hash 2eaf7baf5de9c7781b5f89c1ebc0cff5ee22eea92a4186b1d34afa3b7c160c2d
SimHash 1904d455c7d3

Groups

*

Rule Path
Disallow /episerver/
Disallow /utils/
Disallow /admintools/

Other Records

Field Value
sitemap https://www.engineering.pitt.edu/sitemap.xml