check-domains.com
robots.txt
Robots Exclusion Standard data for check-domains.com
Resource Scan
Scan Details
Site Domain | check-domains.com |
Base Domain | check-domains.com |
Scan Status | Ok |
Last Scan | 2024-09-12T05:55:36+00:00 |
Next Scan | 2024-10-12T05:55:36+00:00 |
Last Scan
Scanned | 2024-09-12T05:55:36+00:00 |
URL | https://check-domains.com/robots.txt |
Redirect | http://www.check-domains.com/robots.txt |
Redirect Domain | www.check-domains.com |
Redirect Base | check-domains.com |
Domain IPs | 46.4.59.83 |
Redirect IPs | 46.4.59.83 |
Response IP | 46.4.59.83 |
Found | Yes |
Hash | 939538b8b2c6ce24cad8b4a7f0dd997152563a5f91043cd75ec143233553f2c4 |
SimHash | ab2cd5786b4f |
Groups
*
Rule | Path |
---|---|
Disallow | /administrator/ |
Disallow | /components/ |
Disallow | /includes/ |
Disallow | /installation/ |
Disallow | /language/ |
Disallow | /libraries/ |
Disallow | /media/ |
Disallow | /modules/ |
Disallow | /tmp/ |
Disallow | /xmlrpc/ |
Disallow | /test/ |
Disallow | /plesk-stat/ |
Disallow | /picture_library/ |
Disallow | /seo/admin/ |
Disallow | /seo/content/ |
Disallow | /seo/contact/ |
Disallow | /seo/klib/ |
Disallow | /seo/modules/ |
Disallow | /seo/tpl/ |
Disallow | /seo/captcha.php |
Disallow | /seo/config.php |
Disallow | /notavail.htm |
Disallow | /amember/ |
Disallow | /amemberv4/ |
Disallow | /legal/ |
Comments