aei.pitt.edu
robots.txt

Robots Exclusion Standard data for aei.pitt.edu

Resource Scan

Scan Details

Site Domain aei.pitt.edu
Base Domain pitt.edu
Scan Status Ok
Last Scan2025-12-11T23:05:54+00:00
Next Scan 2026-01-10T23:05:54+00:00

Last Scan

Scanned2025-12-11T23:05:54+00:00
URL https://aei.pitt.edu/robots.txt
Domain IPs 136.142.156.219
Response IP 136.142.156.219
Found Yes
Hash 70402d1b01d8be170c709afd15f08c6a871d26d17f65b4411e336336e452935e
SimHash 2845c8404d13

Groups

*

Rule Path
Disallow /cgi/

Other Records

Field Value
sitemap http://aei.pitt.edu/sitemap.xml