mentoday.ru
robots.txt
Robots Exclusion Standard data for mentoday.ru
Resource Scan
Scan Details
| Site Domain | mentoday.ru |
| Base Domain | mentoday.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-28T21:03:59+00:00 |
| Next Scan | 2024-10-05T21:03:59+00:00 |
Last Scan
| Scanned | 2024-09-28T21:03:59+00:00 |
| URL | https://mentoday.ru/robots.txt |
| Redirect | https://www.mentoday.ru/robots.txt |
| Redirect Domain | www.mentoday.ru |
| Redirect Base | mentoday.ru |
| Domain IPs | 51.250.102.195 |
| Redirect IPs | 2a11:27c0:10::182, 95.181.182.182 |
| Response IP | 95.181.182.182 |
| Found | Yes |
| Hash | 3b646ce5bad404d4930d9ea87904ee4d34f41946a66c6788f5d079b665e59248 |
| SimHash | 74b46e4f4383 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /api/ |
| Disallow | /auth/ |
| Disallow | /profile/ |
| Disallow | /search/ |
| Disallow | /options/ |
| Disallow | /draft/ |
| Disallow | /email/confirm/ |
| Disallow | /changepassword/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mentoday.ru/sitemap.xml |
| sitemap | https://www.mentoday.ru/sitemap/foto1-utf8.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.