crackingthat.com
robots.txt
Robots Exclusion Standard data for crackingthat.com
Resource Scan
Scan Details
Site Domain | crackingthat.com |
Base Domain | crackingthat.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-05-22T18:04:02+00:00 |
Next Scan | 2025-08-20T18:04:02+00:00 |
Last Successful Scan
Scanned | 2023-01-10T20:00:24+00:00 |
URL | https://crackingthat.com/robots.txt |
Domain IPs | 104.21.50.218, 172.67.210.184, 2606:4700:3031::6815:32da, 2606:4700:3036::ac43:d2b8 |
Response IP | 104.21.50.218 |
Found | Yes |
Hash | 5a42b15e03b6bfb62bfbcc28ed17ce41b724944dc12e998ace02daf4733188d1 |
SimHash | 2c5cd668632d |
Groups
*
Rule | Path |
---|---|
Disallow | /misc.php?action=help |
Disallow | /misc.php?action=help&hid=2 |
Disallow | /captcha.php |
Disallow | /modcp.php |
Disallow | /moderation.php |
Disallow | /printthread.php |
Disallow | /task.php |
Disallow | /archive/ |
Disallow | /online.php |
Disallow | /calendar.php |
Disallow | /reputation.php |
Disallow | /*nextoldest* |
Disallow | /*nextnewest* |
Disallow | /*datecut* |
Disallow | /*lastpost* |
Disallow | /*markread* |
Disallow | /ratethread.php |
Disallow | /report.php |
Disallow | /sendthread.php* |
Disallow | /usercp.php* |
Disallow | /usercp2.php* |
Disallow | /newreply.php* |
Disallow | /newthread.php* |
Disallow | /editpost.php |
Disallow | /private.php |
Disallow | /search.php |
Disallow | /memberlist.php |
Disallow | /showteam.php |
Disallow | /stats.php |
Disallow | /showratings.php |
Disallow | /syndication.php* |
Disallow | /misc.php |
Disallow | /*sortby* |
Disallow | /*action%3Demailuser* |
Disallow | /*action%3Dnextnewest* |
Disallow | /*action%3Dnextoldest* |
Disallow | /*year%3D* |
Disallow | /*action%3Dweekview* |
Disallow | /*action%3Dnextnewest* |
Disallow | /*action%3Dnextoldest* |
Disallow | /*sort%3D* |
Disallow | /*order%3D* |
Disallow | /*mode%3D* |
Disallow | /*datecut%3D* |
Disallow | /usuario-*?action=emailuser |
Disallow | /ratethread.php |
Disallow | /attachment.php |
Warnings
- 3 invalid lines.