1text.com
robots.txt
Robots Exclusion Standard data for 1text.com
Resource Scan
Scan Details
| Site Domain | 1text.com |
| Base Domain | 1text.com |
| Scan Status | Ok |
| Last Scan | 2024-05-15T18:17:04+00:00 |
| Next Scan | 2024-05-22T18:17:04+00:00 |
Last Scan
| Scanned | 2024-05-15T18:17:04+00:00 |
| URL | https://1text.com/robots.txt |
| Domain IPs | 104.21.46.46, 172.67.223.160, 2606:4700:3030::6815:2e2e, 2606:4700:3037::ac43:dfa0 |
| Response IP | 104.21.46.46 |
| Found | Yes |
| Hash | a9c847a525367c2edaad1bb62d25bd072c513223399d09eeeb15eee11b308a9a |
| SimHash | 0f60956ed193 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /text_check |
| Disallow | /antiplagiat/* |
| Disallow | /plagiarismchecker/* |
| Allow | /antiplagiat/$ |
| Allow | /antiplagiat$ |
| Disallow | /css/ |
| Disallow | /js/ |
| Disallow | /*ajax* |
| Disallow | /exchange/orders/ |
| Disallow | /exchange/get_file/ |
| Disallow | /exchange/orders/view/ |
| Disallow | /shop/articles/filter |
| Disallow | /shop/news/filter |
| Disallow | /user/ |
| Disallow | /rd/ |
| Disallow | /registration?r= |
| Disallow | /registration/confirm |
| Disallow | /registration/success |
| Disallow | /image/get_shop_preview |
| Disallow | /login?r= |
| Disallow | /login/key/* |
*
| Rule | Path |
|---|---|
| Disallow | /text_check/ |
| Disallow | /antiplagiat/ |
| Disallow | /plagiarismchecker/ |
| Disallow | /css/ |
| Disallow | /js/ |
| Disallow | /*ajax* |
| Disallow | /exchange/orders/ |
| Disallow | /exchange/get_file/ |
| Disallow | /exchange/orders/view/ |
| Disallow | /shop/articles/filter |
| Disallow | /shop/news/filter |
| Disallow | /user/ |
| Disallow | /rd/ |
| Disallow | /registration?r= |
| Disallow | /registration/confirm |
| Disallow | /registration/success |
| Disallow | /image/get_shop_preview |
| Disallow | /login?r= |
| Disallow | */?rv= |
| Disallow | /author/1 |
| Disallow | /author/2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://1text.com/sitemaps/1text.com/sitemapIndex.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.