codespeedy.com
robots.txt
Robots Exclusion Standard data for codespeedy.com
Resource Scan
Scan Details
Site Domain | codespeedy.com |
Base Domain | codespeedy.com |
Scan Status | Ok |
Last Scan | 2024-10-05T17:09:00+00:00 |
Next Scan | 2024-10-12T17:09:00+00:00 |
Last Scan
Scanned | 2024-10-05T17:09:00+00:00 |
URL | https://codespeedy.com/robots.txt |
Domain IPs | 23.92.31.72, 2600:3c02::f03c:94ff:fef6:7410 |
Response IP | 23.92.31.72 |
Found | Yes |
Hash | 2cc60d29ccaf8e172adb7fcd14d1294239a3aa8e8541ac839eaa79e17421d6b7 |
SimHash | 4ba05d42e909 |
Groups
*
Rule | Path |
---|---|
Disallow | /products/payments/ |
Disallow | /recommends/ |
Disallow | /exam/ |
Disallow | /go/ |
Disallow | /cgi-bin/ |
Disallow | /wp-admin/ |
Disallow | /comments/feed/ |
Disallow | /trackback/ |
Disallow | /index.php |
Disallow | /feed/ |
Disallow | /demophp/ |
Disallow | /products/product/ |
Disallow | /ml/ |
Disallow | /checkout/ |
Allow | /wp-admin/admin-ajax.php |
Disallow | /xmlrpc.php |
Disallow | /g54fdfzGk54GHV/ |
Disallow | /store/ |
Disallow | /products/user_login/ |
Other Records
Field | Value |
---|---|
crawl-delay | 4 |
Other Records
Field | Value |
---|---|
sitemap | https://www.codespeedy.com/sitemap.xml |
Warnings
- 2 invalid lines.
Comments