nps.gov
robots.txt

Robots Exclusion Standard data for nps.gov

Resource Scan

Scan Details

Site Domain nps.gov
Base Domain nps.gov
Scan Status Ok
Last Scan2024-05-18T06:12:06+00:00
Next Scan 2024-06-01T06:12:06+00:00

Last Scan

Scanned2024-05-18T06:12:06+00:00
URL https://nps.gov/robots.txt
Domain IPs 2600:9000:20aa:0:1:983:9400:93a1, 52.6.8.53
Response IP 52.6.8.53
Found Yes
Hash 31a9c02930c4fe974228a1ed44a6e9b5b848ebd3174d6177ad47fed4f0f858a7
SimHash 651cd44463d9

Groups

*

Rule Path
Disallow /ns/
Disallow /search/
Disallow /loader.cfm
Disallow /*loader.cfm*

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5