dokuinvest.my.id
robots.txt

Robots Exclusion Standard data for dokuinvest.my.id

Resource Scan

Scan Details

Site Domain dokuinvest.my.id
Base Domain dokuinvest.my.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-09T14:58:08+00:00
Next Scan 2026-01-08T14:58:08+00:00

Last Successful Scan

Scanned2025-08-19T01:19:40+00:00
URL https://dokuinvest.my.id/robots.txt
Domain IPs 103.185.53.125
Response IP 103.185.53.125
Found Yes
Hash 457a5a0ada8785f409a658695c9daadf63eea9103d1113995f0113ceaff7f97a
SimHash 6c0d1d900f93

Groups

mediapartners-google

Rule Path
Disallow

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://dokuinvest.my.id/sitemap.xml
sitemap https://dokuinvest.my.id/rss.xml

Comments

  • Hello search engine
  • I am robots.txt
  • I am very happy to be crawled