dokumen.tips
robots.txt
Robots Exclusion Standard data for dokumen.tips
Resource Scan
Scan Details
| Site Domain | dokumen.tips |
| Base Domain | dokumen.tips |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2024-08-23T22:01:23+00:00 |
| Next Scan | 2024-10-22T22:01:23+00:00 |
Last Successful Scan
| Scanned | 2024-06-25T22:00:26+00:00 |
| URL | https://dokumen.tips/robots.txt |
| Domain IPs | 104.21.96.29, 172.67.150.161, 2606:4700:3035::ac43:96a1, 2606:4700:3037::6815:601d |
| Response IP | 104.21.96.29 |
| Found | Yes |
| Hash | 56c6f96d80cf666e1e0ddc0633c14f77d27a70d6985a4350cedbae0a13f73e8a |
| SimHash | 2b508252e113 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /reader/f/ |
| Disallow | /search |
| Disallow | /amp/search |
| Disallow | /contacts.html |
| Disallow | /login.html |
| Disallow | /register.html |
| Disallow | /user/forgot.html |
| Disallow | /report-copyright.html |
| Disallow | /mobile/menu.html |
| Disallow | /ajax/ |
| Disallow | /cdn-cgi/ |