open.dosm.gov.my
robots.txt

Robots Exclusion Standard data for open.dosm.gov.my

Resource Scan

Scan Details

Site Domain open.dosm.gov.my
Base Domain dosm.gov.my
Scan Status Ok
Last Scan2024-11-03T09:30:16+00:00
Next Scan 2024-12-03T09:30:16+00:00

Last Scan

Scanned2024-11-03T09:30:16+00:00
URL https://open.dosm.gov.my/robots.txt
Domain IPs 76.76.21.241, 76.76.21.93
Response IP 76.76.21.9
Found Yes
Hash 5f19c1a7d21ec42461e6f690f3438b02e6a8f85ac0a71a286e90d6d060b07092
SimHash 63448fe1a631

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://open.dosm.gov.my/sitemap.xml

Comments

  • *
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.