xangrey.com
robots.txt

Robots Exclusion Standard data for xangrey.com

Resource Scan

Scan Details

Site Domain xangrey.com
Base Domain xangrey.com
Scan Status Ok
Last Scan2025-04-29T18:53:53+00:00
Next Scan 2025-05-29T18:53:53+00:00

Last Scan

Scanned2025-04-29T18:53:53+00:00
URL https://xangrey.com/robots.txt
Redirect https://www.xangrey.com/robots.txt
Redirect Domain www.xangrey.com
Redirect Base xangrey.com
Domain IPs 199.34.228.150
Redirect IPs 199.34.228.150
Response IP 199.34.228.150
Found Yes
Hash a0a3679c3b3c6a78dc15e06f4efe3aac8e976bb7d33f3e7750c55d13efa2994f
SimHash 6254dc742793

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/

Other Records

Field Value
sitemap https://www.XanGrey.com/sitemap.xml