docs4dev.com
robots.txt

Robots Exclusion Standard data for docs4dev.com

Resource Scan

Scan Details

Site Domain docs4dev.com
Base Domain docs4dev.com
Scan Status Ok
Last Scan2025-10-05T00:09:56+00:00
Next Scan 2025-10-12T00:09:56+00:00

Last Scan

Scanned2025-10-05T00:09:56+00:00
URL https://docs4dev.com/robots.txt
Redirect https://www.docs4dev.com/robots.txt
Redirect Domain www.docs4dev.com
Redirect Base docs4dev.com
Domain IPs 104.21.67.244, 172.67.183.45, 2606:4700:3031::ac43:b72d, 2606:4700:3033::6815:43f4
Redirect IPs 121.40.65.201
Response IP 121.40.65.201
Found Yes
Hash 23cde969529ebf1a20a03e587bdfc51be1e04fa2be7642c60abe92bede0f15f3
SimHash f82cddc2ee39

Groups

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

*

Rule Path
Disallow
Disallow /auth
Disallow /me
Disallow /questions
Disallow /D%3A