coders.dev
robots.txt
Robots Exclusion Standard data for coders.dev
Resource Scan
Scan Details
| Site Domain | coders.dev |
| Base Domain | coders.dev |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-30T09:09:43+00:00 |
| Next Scan | 2024-06-06T09:09:43+00:00 |
Last Successful Scan
| Scanned | 2023-03-13T13:34:11+00:00 |
| URL | https://coders.dev/robots.txt |
| Redirect | https://www.coders.dev/robots.txt |
| Redirect Domain | www.coders.dev |
| Redirect Base | coders.dev |
| Domain IPs | 2001:4860:4802:32::15, 2001:4860:4802:34::15, 2001:4860:4802:36::15, 2001:4860:4802:38::15, 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21 |
| Redirect IPs | 138.199.46.68, 2400:52e0:1500::868:1 |
| Response IP | 138.199.46.68 |
| Found | Yes |
| Hash | c81ffc531b284b8575241791af95fca82e7d3d216ce7e97d54f1357ff721af35 |
| SimHash | 7b153d544d54 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /footerform/ |
| Disallow | /portfolio.html |
| Disallow | /media/ |
| Disallow | /media/ |
| Disallow | /case-study/ |
| Disallow | /signup/ |
| Disallow | /images/candidates/ |
| Disallow | /images/cust/ |
| Disallow | /administrator/ |
| Disallow | /admin/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.coders.dev/sitemap.xml |