tdpri.com
robots.txt
Robots Exclusion Standard data for tdpri.com
Resource Scan
Scan Details
| Site Domain | tdpri.com |
| Base Domain | tdpri.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-08T16:04:05+00:00 |
| Next Scan | 2024-12-07T16:04:05+00:00 |
Last Successful Scan
| Scanned | 2023-08-16T14:27:39+00:00 |
| URL | https://tdpri.com/robots.txt |
| Domain IPs | 104.21.38.176, 172.67.137.27, 2606:4700:3032::6815:26b0, 2606:4700:3035::ac43:891b |
| Response IP | 172.67.137.27 |
| Found | Yes |
| Hash | 7be477867f1d43c8981beb1582d08119a65c1c6008b168d4fe501b78e5624a0f |
| SimHash | a870c870251b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /tmp/ |
| Disallow | /test/ |
| Disallow | /ssh/ |
| Disallow | /xcache/ |
| Disallow | /plesk-stat/ |
| Disallow | /picture_library/ |
| Disallow | /phpmyadmin/ |
| Disallow | /dev/ |
| Disallow | /chat/ |
| Disallow | /calendar/ |
| Disallow | /ads-direct/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |