castingy.ru
robots.txt
Robots Exclusion Standard data for castingy.ru
Resource Scan
Scan Details
Site Domain | castingy.ru |
Base Domain | castingy.ru |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-08-30T20:18:04+00:00 |
Next Scan | 2024-11-28T20:18:04+00:00 |
Last Successful Scan
Scanned | 2024-02-03T20:16:09+00:00 |
URL | https://castingy.ru/robots.txt |
Domain IPs | 104.21.54.77, 172.67.136.195, 2606:4700:3030::ac43:88c3, 2606:4700:3031::6815:364d |
Response IP | 172.67.136.195 |
Found | Yes |
Hash | 2b1386a3b0881a293cd02626c884d95d3b524ca511c11d23ff3d2ddd2b6422f5 |
SimHash | 255d9ccdc093 |
Groups
*
Rule | Path |
---|---|
Disallow | /index.php |
Disallow | /search |
Disallow | /rss |
Disallow | /rssfeed |
Disallow | /users |
Disallow | /tags |
Disallow | /redirect?url=* |
Disallow | /auth/register |
Disallow | /pages/pravila.html |
Disallow | /pages/o-sajte.html |
Disallow | /iforms/kontakty |
Other Records
Field | Value |
---|---|
sitemap | https://castingy.ru/sitemap.xml |
Warnings
- `host` is not a known field.