21guides.com
robots.txt
Robots Exclusion Standard data for 21guides.com
Resource Scan
Scan Details
| Site Domain | 21guides.com |
| Base Domain | 21guides.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't establish SSL connection. |
| Last Scan | 2025-09-27T15:23:52+00:00 |
| Next Scan | 2025-12-26T15:23:52+00:00 |
Last Successful Scan
| Scanned | 2024-09-02T01:49:39+00:00 |
| URL | https://21guides.com/robots.txt |
| Domain IPs | 34.120.190.48, 34.149.120.3, 34.160.17.71, 35.190.31.54 |
| Response IP | 34.149.120.3 |
| Found | Yes |
| Hash | 483a5677c0acf98d695b47cb253e8e930ef0caf0cf69ff2144319370ac67dbb1 |
| SimHash | 39155ca0f090 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /profile/ |
| Disallow | /admin/ |
| Disallow | /guides/*/edit |
| Disallow | /guides/create |
| Disallow | /guides/undefined |
| Disallow | /guides/print-PDF/* |
| Disallow | /login |
| Disallow | /register |
| Disallow | /verify |
| Disallow | /top-users |
| Disallow | /terms-of-use |
| Disallow | /privacy-policy |
| Disallow | /cookies |
| Disallow | /contact |
| Disallow | /password/reset |
| Disallow | */no-records |
Comments