crackingthat.com
robots.txt

Robots Exclusion Standard data for crackingthat.com

Resource Scan

Scan Details

Site Domain crackingthat.com
Base Domain crackingthat.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-05-22T18:04:02+00:00
Next Scan 2025-08-20T18:04:02+00:00

Last Successful Scan

Scanned2023-01-10T20:00:24+00:00
URL https://crackingthat.com/robots.txt
Domain IPs 104.21.50.218, 172.67.210.184, 2606:4700:3031::6815:32da, 2606:4700:3036::ac43:d2b8
Response IP 104.21.50.218
Found Yes
Hash 5a42b15e03b6bfb62bfbcc28ed17ce41b724944dc12e998ace02daf4733188d1
SimHash 2c5cd668632d

Groups

*

Rule Path
Disallow /misc.php?action=help
Disallow /misc.php?action=help&hid=2
Disallow /captcha.php
Disallow /modcp.php
Disallow /moderation.php
Disallow /printthread.php
Disallow /task.php
Disallow /archive/
Disallow /online.php
Disallow /calendar.php
Disallow /reputation.php
Disallow /*nextoldest*
Disallow /*nextnewest*
Disallow /*datecut*
Disallow /*lastpost*
Disallow /*markread*
Disallow /ratethread.php
Disallow /report.php
Disallow /sendthread.php*
Disallow /usercp.php*
Disallow /usercp2.php*
Disallow /newreply.php*
Disallow /newthread.php*
Disallow /editpost.php
Disallow /private.php
Disallow /search.php
Disallow /memberlist.php
Disallow /showteam.php
Disallow /stats.php
Disallow /showratings.php
Disallow /syndication.php*
Disallow /misc.php
Disallow /*sortby*
Disallow /*action%3Demailuser*
Disallow /*action%3Dnextnewest*
Disallow /*action%3Dnextoldest*
Disallow /*year%3D*
Disallow /*action%3Dweekview*
Disallow /*action%3Dnextnewest*
Disallow /*action%3Dnextoldest*
Disallow /*sort%3D*
Disallow /*order%3D*
Disallow /*mode%3D*
Disallow /*datecut%3D*
Disallow /usuario-*?action=emailuser
Disallow /ratethread.php
Disallow /attachment.php

mediapartners-google

Rule Path
Allow /

dotbot

Rule Path
Disallow /

Warnings

  • 3 invalid lines.