Log In Sign Up

ndbc.noaa.gov
robots.txt

Robots Exclusion Standard data for ndbc.noaa.gov

Resource Scan

Scan Details

Site Domain ndbc.noaa.gov
Base Domain noaa.gov
Scan Status Ok
Last Scan2024-11-14T10:12:48+00:00
Next Scan 2024-12-14T10:12:48+00:00

Last Scan

Scanned2024-11-14T10:12:48+00:00
URL https://ndbc.noaa.gov/robots.txt
Redirect https://www.ndbc.noaa.gov/robots.txt
Redirect Domain www.ndbc.noaa.gov
Redirect Base noaa.gov
Domain IPs 13.35.238.55, 13.35.238.63, 13.35.238.76, 13.35.238.83, 2600:9000:2085:4600:f:a185:9800:93a1, 2600:9000:2085:4c00:f:a185:9800:93a1, 2600:9000:2085:ba00:f:a185:9800:93a1, 2600:9000:2085:be00:f:a185:9800:93a1, 2600:9000:2085:c000:f:a185:9800:93a1, 2600:9000:2085:c200:f:a185:9800:93a1, 2600:9000:2085:ee00:f:a185:9800:93a1, 2600:9000:2085:fa00:f:a185:9800:93a1
Redirect IPs 13.35.238.55, 13.35.238.63, 13.35.238.76, 13.35.238.83, 2600:9000:2085:2c00:f:a185:9800:93a1, 2600:9000:2085:3200:f:a185:9800:93a1, 2600:9000:2085:3a00:f:a185:9800:93a1, 2600:9000:2085:5c00:f:a185:9800:93a1, 2600:9000:2085:9800:f:a185:9800:93a1, 2600:9000:2085:ba00:f:a185:9800:93a1, 2600:9000:2085:be00:f:a185:9800:93a1, 2600:9000:2085:ca00:f:a185:9800:93a1
Response IP 13.35.238.83
Found Yes
Hash ee981508ba56e52e36448cd0295cdbd5a145f79193e7b6e7189e2025c4b58b3c
SimHash 99807789ac42

Groups

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /
Back to top

Comments

  • robots.txt file for https://www.ndbc.noaa.gov/
  • e-mail webmaster.ndbc@noaa.gov for problems
Back to top

Warnings

  • 2 invalid lines.
Back to top