text.ru
robots.txt
Robots Exclusion Standard data for text.ru
Resource Scan
Scan Details
| Site Domain | text.ru |
| Base Domain | text.ru |
| Scan Status | Ok |
| Last Scan | 2024-05-29T01:11:53+00:00 |
| Next Scan | 2024-06-05T01:11:53+00:00 |
Last Scan
| Scanned | 2024-05-29T01:11:53+00:00 |
| URL | https://text.ru/robots.txt |
| Domain IPs | 104.26.4.13, 104.26.5.13, 172.67.71.4, 2606:4700:20::681a:40d, 2606:4700:20::681a:50d, 2606:4700:20::ac43:4704 |
| Response IP | 104.26.5.13 |
| Found | Yes |
| Hash | 5b0090a79077eeda8c0bfdbe1b7cb5447cbf2a1e7c80d0674a248a0192fe5775 |
| SimHash | 4e66974ed19b |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /text_check |
| Disallow | /antiplagiat/* |
| Disallow | /plagiarismchecker/* |
| Allow | /antiplagiat/$ |
| Allow | /antiplagiat$ |
| Disallow | /css/ |
| Disallow | /js/ |
| Disallow | /*ajax* |
| Disallow | /exchange/orders/ |
| Disallow | /exchange/get_file/ |
| Disallow | /exchange/orders/view/ |
| Disallow | /shop/articles/filter |
| Disallow | /shop/news/filter |
| Disallow | /user/ |
| Disallow | /rd/ |
| Disallow | /registration?r= |
| Disallow | /registration/confirm |
| Disallow | /registration/success |
| Disallow | /image/get_shop_preview |
| Disallow | /login?r= |
| Disallow | /login/key/* |
*
| Rule | Path |
|---|---|
| Disallow | /text_check/ |
| Disallow | /antiplagiat/ |
| Disallow | /plagiarismchecker/ |
| Disallow | /css/ |
| Disallow | /js/ |
| Disallow | /*ajax* |
| Disallow | /exchange/orders/ |
| Disallow | /exchange/get_file/ |
| Disallow | /exchange/orders/view/ |
| Disallow | /shop/articles/filter |
| Disallow | /shop/news/filter |
| Disallow | /user/ |
| Disallow | /rd/ |
| Disallow | /registration?r= |
| Disallow | /registration/confirm |
| Disallow | /registration/success |
| Disallow | /image/get_shop_preview |
| Disallow | /login?r= |
| Disallow | */?rv= |
| Disallow | /author/1 |
| Disallow | /author/2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://text.ru/sitemaps/text.ru/sitemapIndex.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.