myguidevietnam.com
robots.txt

Robots Exclusion Standard data for myguidevietnam.com

Resource Scan

Scan Details

Site Domain myguidevietnam.com
Base Domain myguidevietnam.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-15T08:38:51+00:00
Next Scan 2025-11-29T08:38:51+00:00

Last Successful Scan

Scanned2025-10-29T02:31:09+00:00
URL https://myguidevietnam.com/robots.txt
Redirect https://www.myguidevietnam.com/robots.txt
Redirect Domain www.myguidevietnam.com
Redirect Base myguidevietnam.com
Domain IPs 3.165.102.102, 3.165.102.125, 3.165.102.34, 3.165.102.98
Redirect IPs 3.165.102.102, 3.165.102.125, 3.165.102.34, 3.165.102.98
Response IP 3.165.102.102
Found Yes
Hash 78baadb351533f2fc29201abaf49bd1c4aadbf4d395c461b280f5271bc15fe87
SimHash 4a0dc8c08e10

Groups

*

Rule Path
Disallow /api/*
Disallow /admin/*
Disallow /data/*
Disallow /modal/*

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

petalbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.myguidevietnam.com/sitemap.xml