rakhiworldwide.com
robots.txt

Robots Exclusion Standard data for rakhiworldwide.com

Resource Scan

Scan Details

Site Domain rakhiworldwide.com
Base Domain rakhiworldwide.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2026-02-25T10:08:36+00:00
Next Scan 2026-04-26T10:08:36+00:00

Last Successful Scan

Scanned2026-01-01T17:09:24+00:00
URL https://www.rakhiworldwide.com/robots.txt
Domain IPs 104.26.0.245, 104.26.1.245, 172.67.70.139, 2606:4700:20::681a:1f5, 2606:4700:20::681a:f5, 2606:4700:20::ac43:468b
Response IP 104.26.0.245
Found Yes
Hash 343023152947e46f7e325d6a28a8057da615aee94893c80d0996fcc09d884719
SimHash 62399250cff1

Groups

*

Rule Path
Disallow

oai-searchbot
chatgpt-user
perplexitybot
perplexity-user
firecrawlagent
andibot
exabot
phindbot
youbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

gptbot
ccbot
google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.rakhiworldwide.com/rakhiworldwide.xml
sitemap https://www.rakhiworldwide.com/country.xml
sitemap https://www.rakhiworldwide.com/usa.xml

Comments

  • Allow AI search and agent use
  • Disallow AI training data collection