myguidesaudiarabia.com
robots.txt

Robots Exclusion Standard data for myguidesaudiarabia.com

Resource Scan

Scan Details

Site Domain myguidesaudiarabia.com
Base Domain myguidesaudiarabia.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-15T14:23:46+00:00
Next Scan 2025-09-22T14:23:46+00:00

Last Successful Scan

Scanned2025-08-24T14:22:38+00:00
URL https://myguidesaudiarabia.com/robots.txt
Redirect https://www.myguidesaudiarabia.com/robots.txt
Redirect Domain www.myguidesaudiarabia.com
Redirect Base myguidesaudiarabia.com
Domain IPs 13.33.45.29, 13.33.45.46, 13.33.45.60, 13.33.45.71
Redirect IPs 13.33.45.29, 13.33.45.46, 13.33.45.60, 13.33.45.71
Response IP 13.33.45.60
Found Yes
Hash c053559d8cce7d42459c35e594a2f01ab1bd0284c1e36e5c016a3aee07ec4ac7
SimHash 6b05d051ef91

Groups

*

Rule Path
Disallow /api/*
Disallow /admin/*
Disallow /modal/*

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.myguidesaudiarabia.com/sitemap.xml