external.nsf.gov
robots.txt

Robots Exclusion Standard data for external.nsf.gov

Resource Scan

Scan Details

Site Domain external.nsf.gov
Base Domain nsf.gov
Scan Status Ok
Last Scan2025-10-08T05:40:14+00:00
Next Scan 2025-10-22T05:40:14+00:00

Last Scan

Scanned2025-10-08T05:40:14+00:00
URL https://external.nsf.gov/robots.txt
Domain IPs 3.15.167.135, 3.15.167.136, 3.15.167.137
Response IP 3.15.167.136
Found Yes
Hash 0c0e1d3bc28de33a9359699f4591c11cd84b7f5097583f33be5b887eccd55b65
SimHash 6854810063a0

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Allow /$
Allow /login/login.htm
Disallow /

bingbot

Rule Path
Allow /$
Disallow /