caught.net
robots.txt
Robots Exclusion Standard data for caught.net
Resource Scan
Scan Details
Site Domain | caught.net |
Base Domain | caught.net |
Scan Status | Ok |
Last Scan | 5/20/2025, 9:38:07 PM |
Next Scan | 6/19/2025, 9:38:07 PM |
Last Scan
Scanned | 5/20/2025, 9:38:07 PM |
URL | https://caught.net/robots.txt |
Domain IPs | 104.21.82.153, 172.67.158.238, 2606:4700:3032::6815:5299, 2606:4700:3033::ac43:9eee |
Response IP | 104.21.82.153 |
Found | Yes |
Hash | 770dd633d8a213021716d7aca0f823b96cf976fb933cef63962b61b8abf0d4aa |
SimHash | 798d6e6a8793 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /administrator/ |
Disallow | /wp/ |
Disallow | /admin/ |
Disallow | /wordpress/ |
Disallow | /phpmyadmin/ |
Disallow | /awmdata/ |
Disallow | /lawfind/ |
Disallow | /images/ |
Disallow | /cgi-bin/ |
Disallow | /docs/ |
Disallow | /pr1.htm |
Disallow | /pr1jour.htm |
Disallow | /caught/ |
Other Records
Field | Value |
---|---|
sitemap | http://www.caught.net/sitemap.xml |