gtfan.ru
robots.txt
Robots Exclusion Standard data for gtfan.ru
Resource Scan
Scan Details
| Site Domain | gtfan.ru |
| Base Domain | gtfan.ru |
| Scan Status | Ok |
| Last Scan | 2024-05-07T11:19:29+00:00 |
| Next Scan | 2024-05-14T11:19:29+00:00 |
Last Scan
| Scanned | 2024-05-07T11:19:29+00:00 |
| URL | https://gtfan.ru/robots.txt |
| Redirect | https://www.gtfan.ru/robots.txt |
| Redirect Domain | www.gtfan.ru |
| Redirect Base | gtfan.ru |
| Domain IPs | 81.177.135.185 |
| Redirect IPs | 81.177.135.185 |
| Response IP | 81.177.135.185 |
| Found | Yes |
| Hash | b6b9af945b1941f7fa0516c9c4848e4874ae6085e3b934d725eca883b626e167 |
| SimHash | a618dcf462b0 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /cli/ |
| Disallow | /components/ |
| Disallow | /go/ |
| Disallow | /go/index.php |
| Disallow | /jupgrade/ |
| Disallow | /images/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /logs/ |
| Disallow | /media/ |
| Disallow | /modules/ |
| Disallow | /plugins/ |
| Disallow | /templates/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Disallow | /forum/go.php |
| Disallow | /forum/faq.php |
| Disallow | /forum/mcp.php |
| Disallow | /forum/memberlist.php |
| Disallow | /forum/posting.php |
| Disallow | /forum/report.php |
| Disallow | /forum/search.php |
| Disallow | /forum/style.php |
| Disallow | /forum/ucp.php |
| Disallow | /forum/viewtopic.php?p=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
*
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /cli/ |
| Disallow | /components/ |
| Disallow | /go/ |
| Disallow | /go/index.php |
| Disallow | /jupgrade/ |
| Disallow | /images/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /logs/ |
| Disallow | /media/ |
| Disallow | /modules/ |
| Disallow | /plugins/ |
| Disallow | /templates/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Disallow | /forum/go.php |
| Disallow | /forum/faq.php |
| Disallow | /forum/mcp.php |
| Disallow | /forum/memberlist.php |
| Disallow | /forum/posting.php |
| Disallow | /forum/report.php |
| Disallow | /forum/search.php |
| Disallow | /forum/style.php |
| Disallow | /forum/ucp.php |
| Disallow | /forum/viewtopic.php?p=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.