climate.sdstate.edu
robots.txt

Robots Exclusion Standard data for climate.sdstate.edu

Resource Scan

Scan Details

Site Domain climate.sdstate.edu
Base Domain sdstate.edu
Scan Status Ok
Last Scan2025-09-17T19:57:09+00:00
Next Scan 2025-10-17T19:57:09+00:00

Last Scan

Scanned2025-09-17T19:57:09+00:00
URL https://climate.sdstate.edu/robots.txt
Domain IPs 137.216.132.64
Response IP 137.216.132.64
Found Yes
Hash 7a1a640f7856eb114255ed7e1326dbe9a30485b0053a1adf9fa18cbeef458ecb
SimHash fd17d915edc0

Groups

*

Rule Path
Disallow /downloads
Disallow /error
Disallow /Connections
Disallow /test
Disallow /waterSAVE
Disallow /etc/status
Disallow /noaa
Disallow /.well-known/
Disallow /apple-app-site-association
Disallow /maps
Disallow /umrb
Disallow /USDA
Disallow /ClimateCorp
Allow /

Other Records

Field Value
sitemap http://climate.sdstate.edu/sitemap.txt