dolink.id
robots.txt
Robots Exclusion Standard data for dolink.id
Resource Scan
Scan Details
Site Domain | dolink.id |
Base Domain | dolink.id |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2/24/2025, 11:28:35 AM |
Next Scan | 5/25/2025, 11:28:35 AM |
Last Successful Scan
Scanned | 7/30/2024, 11:06:03 AM |
URL | https://dolink.id/robots.txt |
Domain IPs | 139.99.90.231 |
Response IP | 139.99.90.231 |
Found | Yes |
Hash | 20e57149fd25bd4aae5acbeffe434ae75a6edf335f0de67f78ce3185c3092300 |
SimHash | 6855dc1566c7 |
Groups
*
Rule | Path |
---|---|
Disallow |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://dolink.id/sitemap |
sitemap | https://dolink.id/sitemap/1 |
sitemap | https://dolink.id/sitemap/2 |