crackingx.com
robots.txt
Robots Exclusion Standard data for crackingx.com
Resource Scan
Scan Details
Site Domain | crackingx.com |
Base Domain | crackingx.com |
Scan Status | Ok |
Last Scan | 2024-09-22T20:01:51+00:00 |
Next Scan | 2024-10-22T20:01:51+00:00 |
Last Scan
Scanned | 2024-09-22T20:01:51+00:00 |
URL | https://crackingx.com/robots.txt |
Domain IPs | 104.21.59.147, 172.67.179.187, 2606:4700:3032::6815:3b93, 2606:4700:3036::ac43:b3bb |
Response IP | 104.21.59.147 |
Found | Yes |
Hash | 5d5388c81ab2c44e4eb55fafd83542e3a9c366ee878121cee7c3f870452883b6 |
SimHash | 4659ca704fa1 |
Groups
*
Rule | Path |
---|---|
Disallow | /goto/ |
Disallow | /posts/ |
Disallow | /admin.php |
Disallow | /login/ |
Disallow | /find-new/ |
Disallow | /account/ |
Disallow | /attachments/ |
Disallow | /help/ |
Disallow | /lfs/ |
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://crackingx.com/sitemap.php |
Warnings
- `host` is not a known field.