1text.com
robots.txt
Robots Exclusion Standard data for 1text.com
Resource Scan
Scan Details
| Site Domain | 1text.com |
| Base Domain | 1text.com |
| Scan Status | Ok |
| Last Scan | 2024-11-14T09:30:29+00:00 |
| Next Scan | 2024-11-21T09:30:29+00:00 |
Last Scan
| Scanned | 2024-11-14T09:30:29+00:00 |
| URL | https://1text.com/robots.txt |
| Domain IPs | 104.21.46.46, 172.67.223.160, 2606:4700:3030::6815:2e2e, 2606:4700:3037::ac43:dfa0 |
| Response IP | 172.67.223.160 |
| Found | Yes |
| Hash | 384fb5629f939a8f854eb99c1afe9fd1045882ada96928341bcbb6ff9b6b6338 |
| SimHash | 5f60346ab191 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /text_check |
| Disallow | /antiplagiat/* |
| Disallow | /plagiarismchecker/* |
| Allow | /antiplagiat/$ |
| Allow | /antiplagiat$ |
| Disallow | /css/ |
| Disallow | /js/ |
| Disallow | /*ajax* |
| Disallow | /exchange/orders/ |
| Disallow | /exchange/get_file/ |
| Disallow | /exchange/orders/view/ |
| Disallow | /shop/articles/filter |
| Disallow | /shop/news/filter |
| Disallow | /user/ |
| Disallow | /rd/ |
| Disallow | /registration?r= |
| Disallow | /registration/confirm |
| Disallow | /registration/success |
| Disallow | /image/get_shop_preview |
| Disallow | /login?r= |
| Disallow | /login/key/* |
*
| Rule | Path |
|---|---|
| Disallow | /text_check/ |
| Disallow | /antiplagiat/ |
| Allow | /antiplagiat/$ |
| Disallow | /plagiarismchecker/ |
| Allow | /plagiarismchecker/$ |
| Disallow | /seo/ |
| Allow | /seo/$ |
| Disallow | /spelling/ |
| Allow | /spelling/$ |
| Disallow | /arbitrage/ |
| Allow | /arbitrage/$ |
| Disallow | /css/ |
| Disallow | /js/ |
| Disallow | /*ajax* |
| Disallow | /exchange/orders/ |
| Disallow | /exchange/get_file/ |
| Disallow | /exchange/orders/view/ |
| Disallow | /shop/articles/filter |
| Disallow | /shop/news/filter |
| Disallow | /user/ |
| Disallow | /rd/ |
| Disallow | /registration?r= |
| Disallow | /registration/confirm |
| Disallow | /registration/success |
| Disallow | /image/get_shop_preview |
| Disallow | */?rv= |
| Disallow | */?r= |
| Disallow | */?email= |
| Disallow | */?etext= |
| Disallow | */?template= |
| Disallow | */?sub1= |
| Disallow | */?paymentId= |
| Disallow | */?type= |
| Disallow | */?source= |
| Disallow | */?category= |
| Disallow | */?coverage= |
| Disallow | */?erid= |
| Disallow | */?ref= |
| Disallow | */?rel_scan= |
| Disallow | */?exchangePage= |
| Disallow | */?authuser= |
| Disallow | */?target= |
| Disallow | */?sort= |
| Disallow | */?state= |
| Disallow | */?file= |
| Disallow | */?utm_order_number= |
| Disallow | */?cc_key= |
| Disallow | */?sm_au= |
| Disallow | */?from= |
| Disallow | */?locale= |
| Disallow | */?mbstx= |
| Disallow | */?utm_source= |
| Disallow | */?sub2= |
| Disallow | /author/1 |
| Disallow | /author/2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://1text.com/sitemaps/1text.com/sitemapIndex.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.