caudata.org
robots.txt
Robots Exclusion Standard data for caudata.org
Resource Scan
Scan Details
| Site Domain | caudata.org |
| Base Domain | caudata.org |
| Scan Status | Ok |
| Last Scan | 5/17/2025, 5:37:55 PM |
| Next Scan | 5/24/2025, 5:37:55 PM |
Last Scan
| Scanned | 5/17/2025, 5:37:55 PM |
| URL | https://caudata.org/robots.txt |
| Domain IPs | 207.7.88.208 |
| Response IP | 207.7.88.208 |
| Found | Yes |
| Hash | 3148cbf73ce3a0a5012d16de1c2fd785c1b314c1420a1c5fec5b3ad0148720b6 |
| SimHash | 0d735e00eb73 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /forum/admincp/ |
| Disallow | /forum/chat/ |
| Disallow | /forum/customprofilepics/ |
| Disallow | /forum/images/ |
| Disallow | /forum/includes/ |
| Disallow | /forum/modcp/ |
| Disallow | /forum/messages/ |
| Disallow | /images/ |
| Disallow | /forum/newreply.php |
| Disallow | /forum/editpost.php |
| Disallow | /forum/login.php |
| Disallow | /forum/usercp.php |
| Disallow | /forum/search.php |
| Disallow | /forum/member.php |
| Disallow | /forum/online.php |
| Disallow | /forum/sendmessage.php |
| Disallow | /forum/memberlist.php |
| Disallow | /forum/cache.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |