roboway.in
robots.txt
Robots Exclusion Standard data for roboway.in
Resource Scan
Scan Details
| Site Domain | roboway.in |
| Base Domain | roboway.in |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-06-03T16:58:05+00:00 |
| Next Scan | 2025-06-10T16:58:05+00:00 |
Last Successful Scan
| Scanned | 2025-05-03T16:29:57+00:00 |
| URL | https://roboway.in/robots.txt |
| Domain IPs | 2a02:4780:84:177f:f0b2:ce4f:ee05:458a, 84.32.84.66 |
| Response IP | 77.37.66.101 |
| Found | Yes |
| Hash | 2841834f58920ba8deb6e2cd7ff40a71aed76f0b27d356f634ef01ead9b5d960 |
| SimHash | 6c506c80d583 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /cgi-bin/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://roboway.in/sitemap_index.xml |
Comments