24cats.ru
robots.txt
Robots Exclusion Standard data for 24cats.ru
Resource Scan
Scan Details
| Site Domain | 24cats.ru |
| Base Domain | 24cats.ru |
| Scan Status | Ok |
| Last Scan | 2024-06-23T13:17:56+00:00 |
| Next Scan | 2024-06-30T13:17:56+00:00 |
Last Scan
| Scanned | 2024-06-23T13:17:56+00:00 |
| URL | https://24cats.ru/robots.txt |
| Redirect | https://www.24cats.ru:443/robots.txt |
| Redirect Domain | www.24cats.ru |
| Redirect Base | 24cats.ru |
| Domain IPs | 91.227.68.33 |
| Redirect IPs | 91.227.68.33 |
| Response IP | 91.227.68.33 |
| Found | Yes |
| Hash | 955f0cda658aac49c5b4d235f38e4e865d28fc7e949b84c70a1bf8826cec21db |
| SimHash | 035c941029d0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /index2.php |
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /components/ |
| Disallow | /images/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /media/ |
| Disallow | /modules/ |
| Disallow | /plugins/ |
| Disallow | /templates/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Disallow | /forum/clientscript/ |
| Disallow | /forum/cpstyles/ |
| Disallow | /forum/customavatars/ |
| Disallow | /forum/customprofilepics/ |
| Disallow | /forum/images/ |
| Disallow | /forum/modcp/ |
| Disallow | /forum/ajax.php |
| Disallow | /forum/attachment.php |
| Disallow | /forum/calendar.php |
| Disallow | /forum/cron.php |
| Disallow | /forum/editpost.php |
| Disallow | /forum/global.php |
| Disallow | /forum/image.php |
| Disallow | /forum/inlinemod.php |
| Disallow | /forum/joinrequests.php |
| Disallow | /forum/login.php |
| Disallow | /forum/memberlist.php |
| Disallow | /forum/misc.php |
| Disallow | /forum/moderator.php |
| Disallow | /forum/newattachment.php |
| Disallow | /forum/newreply.php |
| Disallow | /forum/newthread.php |
| Disallow | /forum/online.php |
| Disallow | /forum/poll.php |
| Disallow | /forum/postings.php |
| Disallow | /forum/printthread.php |
| Disallow | /forum/private.php |
| Disallow | /forum/profile.php |
| Disallow | /forum/register.php |
| Disallow | /forum/report.php |
| Disallow | /forum/reputation.php |
| Disallow | /forum/search.php |
| Disallow | /forum/sendmessage.php |
| Disallow | /forum/showgroups.php |
| Disallow | /forum/subscription.php |
| Disallow | /forum/threadrate.php |
| Disallow | /forum/usercp.php |
| Disallow | /forum/usernote.php |
| Disallow | /component/joomgallery/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 40 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.24cats.ru/forum/sitemap_index.xml.gz |
| sitemap | http://www.24cats.ru/index.php?option=com_xmap&sitemap=1&view=xml&no_html=1 |
Warnings
- `host` is not a known field.
Comments