rwjf.org
robots.txt
Robots Exclusion Standard data for rwjf.org
Resource Scan
Scan Details
| Site Domain | rwjf.org |
| Base Domain | rwjf.org |
| Scan Status | Ok |
| Last Scan | 2024-11-08T15:50:27+00:00 |
| Next Scan | 2024-12-08T15:50:27+00:00 |
Last Scan
| Scanned | 2024-11-08T15:50:27+00:00 |
| URL | https://rwjf.org/robots.txt |
| Redirect | https://www.rwjf.org/robots.txt |
| Redirect Domain | www.rwjf.org |
| Redirect Base | rwjf.org |
| Domain IPs | 108.156.133.57, 108.156.133.83, 108.156.133.87, 108.156.133.97 |
| Redirect IPs | 3.165.82.114, 3.165.82.25, 3.165.82.52, 3.165.82.91 |
| Response IP | 3.165.82.114 |
| Found | Yes |
| Hash | 7c21ea13112d00831498cf133b2d4f5fad859a886fd53545d60226faebec4469 |
| SimHash | ec4c5470df13 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /content/dam |
| Disallow | /contentblock* |
| Disallow | /en/internal |
| Disallow | /en/archive |
| Disallow | /en/search-results.html |
| Disallow | /en/test.html |
| Disallow | /en/test |
| Disallow | /content/communicationstoolbox |
| Disallow | /communicationstoolbox |
| Disallow | /content/granteeresources |
| Disallow | /en/email-profile-center |
jigsaw/2.3.0 w3c_css_validator_jfouffa/2.0
| Rule | Path |
|---|---|
| Disallow | /content/dam/images |
| Disallow | /content/dam/files/interactives |
| Disallow | /content/dam/files/legacy-files |
| Disallow | /content/dam/web-assets |
| Disallow | /content/dam/supplementary-assets |
| Disallow | /content/dam/connect |
| Disallow | /content/dam/wcs |
| Disallow | /content/dam/legacy |
| Disallow | /content/dam/COH |
| Disallow | /contentblock* |
| Disallow | /en/internal |
| Disallow | /en/archive |
| Disallow | /en/search-results.html |
| Disallow | /en/test.html |
| Disallow | /en/test |
| Disallow | /content/communicationstoolbox |
| Disallow | /communicationstoolbox |
| Disallow | /content/granteeresources |
| Disallow | /en/email-profile-center |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.rwjf.org/sitemap.xml |