tatar-inform.ru
robots.txt
Robots Exclusion Standard data for tatar-inform.ru
Resource Scan
Scan Details
| Site Domain | tatar-inform.ru |
| Base Domain | tatar-inform.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-14T12:14:45+00:00 |
| Next Scan | 2024-11-21T12:14:45+00:00 |
Last Scan
| Scanned | 2024-11-14T12:14:45+00:00 |
| URL | https://tatar-inform.ru/robots.txt |
| Redirect | https://www.tatar-inform.ru/robots.txt |
| Redirect Domain | www.tatar-inform.ru |
| Redirect Base | tatar-inform.ru |
| Domain IPs | 185.27.193.165 |
| Redirect IPs | 185.27.193.165 |
| Response IP | 185.27.193.165 |
| Found | Yes |
| Hash | 14b2d9debc97d4ad10ea9145330a56183df4e10cbc8f1e9a0e682d2b1a4ca35d |
| SimHash | ea34cde51e42 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin |
| Disallow | /login |
| Disallow | /test |
| Disallow | /search |
| Disallow | /news/date/list |
| Disallow | /news/rubric/list/official$ |
| Disallow | /news/rubric/list/politics$ |
| Disallow | /news/rubric/list/business$ |
| Disallow | /news/rubric/list/science$ |
| Disallow | /news/rubric/list/society$ |
| Disallow | /news/rubric/list/culture$ |
| Disallow | /news/rubric/list/press$ |
| Disallow | /news/rubric/list/agriculture$ |
| Disallow | /news/rubric/list/religion$ |
| Disallow | /news/rubric/list/sport$ |
| Disallow | /news/rubric/list/health$ |
| Disallow | /news/rubric/list/ecology$ |
| Disallow | /news/rubric/list/incident$ |
| Disallow | /news/rubric/list/showtime$ |
| Disallow | /news/rubric/list/letters$ |
| Disallow | /news/rubric/list/transport$ |
| Disallow | /news/rubric/list/world$ |
| Disallow | /news/rubric/list/tatar_world$ |
| Disallow | /news/rubric/list/computers$ |
| Disallow | /*customer_preview* |
| Disallow | /*new_template* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.tatar-inform.ru/sitemap/sitemap.xml |
| sitemap | https://sport.tatar-inform.ru/sitemap/sitemap.xml |
Warnings
- `clean-param` is not a known field.