rawshan.com
robots.txt

Robots Exclusion Standard data for rawshan.com

Resource Scan

Scan Details

Site Domain rawshan.com
Base Domain rawshan.com
Scan Status Ok
Last Scan2025-06-12T08:39:53+00:00
Next Scan 2025-07-12T08:39:53+00:00

Last Scan

Scanned2025-06-12T08:39:53+00:00
URL https://rawshan.com/robots.txt
Domain IPs 51.254.162.25
Response IP 51.254.162.25
Found Yes
Hash 70ccac6f4be69469a6528c9039f20b6d60d7ee8982427b83a3de1286afb65b60
SimHash 081edd60ae9b

Groups

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://rawshan.com/sitemap.xml