ucrazy.ru
robots.txt
Robots Exclusion Standard data for ucrazy.ru
Resource Scan
Scan Details
| Site Domain | ucrazy.ru |
| Base Domain | ucrazy.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-03-29T22:47:31+00:00 |
| Next Scan | 2024-06-27T22:47:31+00:00 |
Last Successful Scan
| Scanned | 2023-12-01T18:27:29+00:00 |
| URL | https://ucrazy.ru/robots.txt |
| Domain IPs | 104.21.33.40, 172.67.158.149, 2606:4700:3032::ac43:9e95, 2606:4700:3036::6815:2128 |
| Response IP | 104.21.33.40 |
| Found | Yes |
| Hash | 7b604c0643352cc14fc8283dc66c16b0b72a31e548239a386b7676499d9c1e55 |
| SimHash | 411483610e73 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /users |
| Disallow | /rules |
| Disallow | /feedback |
| Disallow | /games/page/ |
| Disallow | /pictures/page/ |
| Disallow | /foto/page/ |
| Disallow | /gif/page/ |
| Disallow | /demotivator/page/ |
| Disallow | /celebrities/video/ |
| Disallow | /interesting/page/ |
| Disallow | /cinema/page/ |
| Disallow | /anekdot/page/ |
| Disallow | /hitech/page/ |
| Disallow | /auto/page/ |
| Disallow | /sport/page/ |
| Disallow | /music/page/ |
| Disallow | /other/page/ |
| Disallow | /animals/page/ |
| Disallow | /konkurs/page/ |
| Disallow | /news/page/ |
| Disallow | /page/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://ucrazy.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.
Comments