codesofrohan.com
robots.txt
Robots Exclusion Standard data for codesofrohan.com
Resource Scan
Scan Details
| Site Domain | codesofrohan.com |
| Base Domain | codesofrohan.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-07-07T22:33:03+00:00 |
| Next Scan | 2025-07-21T22:33:03+00:00 |
Last Successful Scan
| Scanned | 2025-06-22T15:33:46+00:00 |
| URL | https://codesofrohan.com/robots.txt |
| Domain IPs | 2a02:4780:38:b92a:dab7:a149:4639:7095, 2a02:4780:39:39da:e4d0:3ec5:99ce:bcf7, 91.108.100.1, 93.127.196.179 |
| Response IP | 91.108.100.200 |
| Found | Yes |
| Hash | 01455e33d1011bebe0abd50c17d055382a90505a8a78558325d522b5c9af8977 |
| SimHash | 69a00b7276a0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /backend/ |
| Disallow | /admin/ |
| Disallow | /private/ |
| Disallow | /tmp/ |
| Disallow | /cgi-bin/ |
| Disallow | /assets/ |
| Disallow | /*.php$ |
| Disallow | /*.sql$ |
| Disallow | /*.env$ |
| Disallow | /*.json$ |
| Allow | /blogs/ |
| Allow | /course/ |
| Allow | /images/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://codesofrohan.com/sitemap.xml |
Comments