crohnsandcolitis.com
robots.txt
Robots Exclusion Standard data for crohnsandcolitis.com
Resource Scan
Scan Details
| Site Domain | crohnsandcolitis.com |
| Base Domain | crohnsandcolitis.com |
| Scan Status | Ok |
| Last Scan | 2024-09-20T15:41:41+00:00 |
| Next Scan | 2024-10-20T15:41:41+00:00 |
Last Scan
| Scanned | 2024-09-20T15:41:41+00:00 |
| URL | https://crohnsandcolitis.com/robots.txt |
| Redirect | https://www.crohnsandcolitis.com/robots.txt |
| Redirect Domain | www.crohnsandcolitis.com |
| Redirect Base | crohnsandcolitis.com |
| Domain IPs | 159.180.132.176 |
| Redirect IPs | 13.35.18.111, 13.35.18.117, 13.35.18.89, 13.35.18.98, 2600:9000:20c7:200:5:8ced:94c0:93a1, 2600:9000:20c7:2a00:5:8ced:94c0:93a1, 2600:9000:20c7:3600:5:8ced:94c0:93a1, 2600:9000:20c7:6800:5:8ced:94c0:93a1, 2600:9000:20c7:7400:5:8ced:94c0:93a1, 2600:9000:20c7:8800:5:8ced:94c0:93a1, 2600:9000:20c7:a400:5:8ced:94c0:93a1, 2600:9000:20c7:e800:5:8ced:94c0:93a1 |
| Response IP | 13.35.18.89 |
| Found | Yes |
| Hash | cd9d52d59fb50d16917c708cae2bb42fbcdb52d008df4ea0d1c8c4bd06c77cb8 |
| SimHash | 27195dc57d93 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search-results* |
| Disallow | /page-not-found* |
| Disallow | /system-error* |
| Disallow | /jcr* |
| Disallow | /generatepdf* |
| Disallow | /api/* |
| Disallow | /thank-you* |
| Disallow | /content/usergenerated/content/forms/af/* |
| Disallow | /jcr%3Acontent/ |
| Disallow | /_jcr_content/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.crohnsandcolitis.com/sitemap.xml |
Comments