dolink.id
robots.txt

Robots Exclusion Standard data for dolink.id

Resource Scan

Scan Details

Site Domain dolink.id
Base Domain dolink.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2/24/2025, 11:28:35 AM
Next Scan 5/25/2025, 11:28:35 AM

Last Successful Scan

Scanned7/30/2024, 11:06:03 AM
URL https://dolink.id/robots.txt
Domain IPs 139.99.90.231
Response IP 139.99.90.231
Found Yes
Hash 20e57149fd25bd4aae5acbeffe434ae75a6edf335f0de67f78ce3185c3092300
SimHash 6855dc1566c7

Groups

googlebot

Rule Path
Disallow

googlebot-image
googlebot-mobile

Rule Path
Disallow

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://dolink.id/sitemap
sitemap https://dolink.id/sitemap/1
sitemap https://dolink.id/sitemap/2