momotor.id
robots.txt

Robots Exclusion Standard data for momotor.id

Resource Scan

Scan Details

Site Domain momotor.id
Base Domain momotor.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-15T10:05:52+00:00
Next Scan 2024-07-14T10:05:52+00:00

Last Successful Scan

Scanned2023-05-29T10:03:26+00:00
URL https://momotor.id/robots.txt
Domain IPs 104.26.2.165, 104.26.3.165, 172.67.68.93, 2606:4700:20::681a:2a5, 2606:4700:20::681a:3a5, 2606:4700:20::ac43:445d
Response IP 104.26.2.165
Found Yes
Hash 91fef9c1ea6a4a14c5b4e162b3cea6bcd4847af57ebcdb5fefbc90c0d4621d53
SimHash 4944927445b1

Groups

*

Rule Path
Disallow /404

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://nextjs.momotor.id/sitemap.xml
sitemap https://nextjs.momotor.id/server-sitemap.xml

Comments

  • *
  • *
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.