crpgsa.unm.edu
robots.txt

Robots Exclusion Standard data for crpgsa.unm.edu

Resource Scan

Scan Details

Site Domain crpgsa.unm.edu
Base Domain unm.edu
Scan Status Ok
Last Scan2024-09-16T03:18:47+00:00
Next Scan 2024-10-16T03:18:47+00:00

Last Scan

Scanned2024-09-16T03:18:47+00:00
URL http://crpgsa.unm.edu/robots.txt
Domain IPs 142.251.10.121, 2404:6800:4003:c0f::79
Response IP 74.125.68.121
Found Yes
Hash 9c8830b34ce7b64cd28e032883824f05c0ac3afa5bdeb87a9345df671cccc8ef
SimHash 0b049e504793

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search
Allow /

Other Records

Field Value
sitemap http://crpgsa.unm.edu/sitemap.xml