Log In Sign Up

www.ndbc.noaa.gov
robots.txt

Robots Exclusion Standard data for www.ndbc.noaa.gov

Resource Scan

Scan Details

Site Domain www.ndbc.noaa.gov
Base Domain noaa.gov
Scan Status Ok
Last Scan2024-04-21T18:27:31+00:00
Next Scan 2024-05-21T18:27:31+00:00

Last Scan

Scanned2024-04-21T18:27:31+00:00
URL https://www.ndbc.noaa.gov/robots.txt
Domain IPs 108.157.254.126, 108.157.254.50, 108.157.254.61, 108.157.254.75, 2600:9000:2753:2000:f:a185:9800:93a1, 2600:9000:2753:2400:f:a185:9800:93a1, 2600:9000:2753:4800:f:a185:9800:93a1, 2600:9000:2753:b400:f:a185:9800:93a1, 2600:9000:2753:ca00:f:a185:9800:93a1, 2600:9000:2753:dc00:f:a185:9800:93a1, 2600:9000:2753:f400:f:a185:9800:93a1, 2600:9000:2753:f600:f:a185:9800:93a1
Response IP 108.157.254.126
Found Yes
Hash ee981508ba56e52e36448cd0295cdbd5a145f79193e7b6e7189e2025c4b58b3c
SimHash 99807789ac42

Groups

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /
Back to top

Comments

  • robots.txt file for https://www.ndbc.noaa.gov/
  • e-mail webmaster.ndbc@noaa.gov for problems
Back to top

Warnings

  • 2 invalid lines.
Back to top