diets.ru
robots.txt
Robots Exclusion Standard data for diets.ru
Resource Scan
Scan Details
| Site Domain | diets.ru |
| Base Domain | diets.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-28T13:02:22+00:00 |
| Next Scan | 2024-10-05T13:02:22+00:00 |
Last Scan
| Scanned | 2024-09-28T13:02:22+00:00 |
| URL | https://diets.ru/robots.txt |
| Redirect | https://www.diets.ru/robots.txt |
| Redirect Domain | www.diets.ru |
| Redirect Base | diets.ru |
| Domain IPs | 217.65.3.118 |
| Redirect IPs | 217.65.3.118 |
| Response IP | 217.65.3.118 |
| Found | Yes |
| Hash | 0efd949085e737a2d2d08b60853e45262a479584f0b5176a6262b8736b7f1d52 |
| SimHash | de017c73a197 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ajax/ |
| Disallow | /blog/*page%3D |
| Disallow | /blog/*tag%3D |
| Disallow | /catalog/feedback/new/ |
| Disallow | /comments/ |
| Disallow | /community/*page%3D |
| Disallow | /community/*tag%3D |
| Disallow | /favorites/ |
| Disallow | /flenta/ |
| Disallow | /friends/ |
| Disallow | /getinvite/ |
| Disallow | /glenta/ |
| Disallow | /infavs/ |
| Disallow | /invite/ |
| Disallow | /invites/ |
| Disallow | /login/ |
| Disallow | /mail/ |
| Disallow | /map/ |
| Disallow | /org/ |
| Disallow | /points/ |
| Disallow | /qa/ask/ |
| Disallow | /remind/ |
| Disallow | /signup/ |
| Disallow | /useralbums/ |
| Disallow | /usercommunities/ |
| Disallow | /users/ |
| Disallow | /usercards/ |
| Disallow | */profile/ |
| Disallow | */user/ |
| Disallow | */search/ |
| Disallow | */settings/ |
| Disallow | *submit |
| Disallow | *sortby%3D |
| Disallow | *_by%3D |
| Disallow | *page%3D0 |
| Disallow | *mysql |
| Disallow | *script |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.