science.nasa.gov
robots.txt

Robots Exclusion Standard data for science.nasa.gov

Resource Scan

Scan Details

Site Domain science.nasa.gov
Base Domain nasa.gov
Scan Status Ok
Last Scan2025-03-03T06:59:29+00:00
Next Scan 2025-04-02T06:59:29+00:00

Last Scan

Scanned2025-03-03T06:59:29+00:00
URL https://science.nasa.gov/robots.txt
Domain IPs 192.0.66.161
Response IP 192.0.66.161
Found Yes
Hash 3bbb5c7f845bd97a7787e0cd4763d74eaf9799f220cd9bae8a07d6e62f6fa69c
SimHash 61128973c735

Groups

usasearch

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

*

No rules defined. All paths allowed.

Warnings

  • 1 invalid line.