nature.org
robots.txt
Robots Exclusion Standard data for nature.org
Resource Scan
Scan Details
Site Domain | nature.org |
Base Domain | nature.org |
Scan Status | Ok |
Last Scan | 2024-04-29T15:53:06+00:00 |
Next Scan | 2024-05-29T15:53:06+00:00 |
Last Scan
Scanned | 2024-04-29T15:53:06+00:00 |
URL | https://nature.org/robots.txt |
Redirect | https://www.nature.org/robots.txt |
Redirect Domain | www.nature.org |
Redirect Base | nature.org |
Domain IPs | 52.32.206.232, 52.35.49.46 |
Redirect IPs | 23.59.168.97 |
Response IP | 23.59.168.97 |
Found | Yes |
Hash | 2d011dd09a84a6dbf17ec5e53f675d2432f8014f3305c10a467e6ddfcfe3ebd2 |
SimHash | e6257e016190 |
Groups
*
Rule | Path |
---|---|
Disallow | /master |
Disallow | /config |
Disallow | /en-us/butler-conservation-fund.html |
Disallow | /en-us/membership-and-giving/long-international-matching-fund.html |
Disallow | /en-us/membership-and-giving/butler-conservation-fund.html |
Other Records
Field | Value |
---|---|
sitemap | https://www.nature.org/sitemap-index.xml |
Comments