24gps.ru
robots.txt
Robots Exclusion Standard data for 24gps.ru
Resource Scan
Scan Details
Site Domain | 24gps.ru |
Base Domain | 24gps.ru |
Scan Status | Ok |
Last Scan | 2024-11-10T17:53:17+00:00 |
Next Scan | 2024-11-17T17:53:17+00:00 |
Last Scan
Scanned | 2024-11-10T17:53:17+00:00 |
URL | https://24gps.ru/robots.txt |
Redirect | https://www.24gps.ru:443/robots.txt |
Redirect Domain | www.24gps.ru |
Redirect Base | 24gps.ru |
Domain IPs | 91.227.68.33 |
Redirect IPs | 91.227.68.33 |
Response IP | 91.227.68.33 |
Found | Yes |
Hash | f8d8a5cd5188a75525cd53d96b946612480ed2a9702b12169669948d50701ec0 |
SimHash | 8b5c941028d2 |
Groups
*
Rule | Path |
---|---|
Disallow | /administrator/ |
Disallow | /cache/ |
Disallow | /components/ |
Disallow | /images/ |
Disallow | /includes/ |
Disallow | /installation/ |
Disallow | /language/ |
Disallow | /libraries/ |
Disallow | /media/ |
Disallow | /modules/ |
Disallow | /plugins/ |
Disallow | /templates/ |
Disallow | /tmp/ |
Disallow | /xmlrpc/ |
Disallow | /forum/clientscript/ |
Disallow | /forum/cpstyles/ |
Disallow | /forum/customavatars/ |
Disallow | /forum/customprofilepics/ |
Disallow | /forum/images/ |
Disallow | /forum/modcp/ |
Disallow | /forum/ajax.php |
Disallow | /forum/attachment.php |
Disallow | /forum/calendar.php |
Disallow | /forum/cron.php |
Disallow | /forum/editpost.php |
Disallow | /forum/global.php |
Disallow | /forum/image.php |
Disallow | /forum/inlinemod.php |
Disallow | /forum/joinrequests.php |
Disallow | /forum/login.php |
Disallow | /forum/member.php |
Disallow | /forum/memberlist.php |
Disallow | /forum/misc.php |
Disallow | /forum/moderator.php |
Disallow | /forum/newattachment.php |
Disallow | /forum/newreply.php |
Disallow | /forum/newthread.php |
Disallow | /forum/online.php |
Disallow | /forum/poll.php |
Disallow | /forum/postings.php |
Disallow | /forum/printthread.php |
Disallow | /forum/private.php |
Disallow | /forum/profile.php |
Disallow | /forum/register.php |
Disallow | /forum/report.php |
Disallow | /forum/reputation.php |
Disallow | /forum/search.php |
Disallow | /forum/sendmessage.php |
Disallow | /forum/showgroups.php |
Disallow | /forum/subscription.php |
Disallow | /forum/threadrate.php |
Disallow | /forum/usercp.php |
Disallow | /forum/usernote.php |
Other Records
Field | Value |
---|---|
crawl-delay | 40 |
Other Records
Field | Value |
---|---|
sitemap | http://www.24gps.ru/forum/sitemap_index.xml.gz |
sitemap | http://www.24gps.ru/index.php?option=com_xmap&sitemap=1&view=xml&no_html=1 |
Warnings
- `host` is not a known field.