rayon.in.ua
robots.txt
Robots Exclusion Standard data for rayon.in.ua
Resource Scan
Scan Details
| Site Domain | rayon.in.ua |
| Base Domain | rayon.in.ua |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-07-16T11:54:16+00:00 |
| Next Scan | 2024-10-14T11:54:16+00:00 |
Last Successful Scan
| Scanned | 2024-03-19T11:46:38+00:00 |
| URL | https://rayon.in.ua/robots.txt |
| Redirect | https://rayon.in.ua/robots |
| Domain IPs | 104.26.0.20, 104.26.1.20, 172.67.73.150, 2606:4700:20::681a:114, 2606:4700:20::681a:14, 2606:4700:20::ac43:4996 |
| Response IP | 104.26.1.20 |
| Found | Yes |
| Hash | d288498bd07eac17013502c85905f2a92362a9abed2caa228fe51f93512bc5e5 |
| SimHash | 0205bc97fdb3 |
Groups
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| sitemap | https://rayon.in.ua/sitemap<br /> |
Warnings
- 20 invalid lines.
- `host` is not a known field.