cap.ru
robots.txt
Robots Exclusion Standard data for cap.ru
Resource Scan
Scan Details
| Site Domain | cap.ru |
| Base Domain | cap.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-24T04:55:38+00:00 |
| Next Scan | 2024-11-22T04:55:38+00:00 |
Last Successful Scan
| Scanned | 2023-01-08T06:40:43+00:00 |
| URL | https://cap.ru/robots.txt |
| Domain IPs | 194.226.90.3 |
| Response IP | 194.226.90.3 |
| Found | Yes |
| Hash | b16d2294bdd5d7e39eb6b59588355d085e6a5235117825b4966d8da6ce81960b |
| SimHash | 88527c4288f3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin |
| Disallow | /Admin |
| Disallow | /spec |
| Disallow | /Spec |
| Disallow | /services |
| Disallow | /Services |
| Disallow | /Content |
| Disallow | /content |
| Disallow | /UserContent |
| Disallow | /usercontent |
| Disallow | /UserFiles |
| Disallow | /userfiles |
| Disallow | *%26page%3D* |
| Disallow | *.aspx* |
Other Records
| Field | Value |
|---|---|
| sitemap | http://cap.ru/sitemap.xml |
Warnings
- `host` is not a known field.