davsadulshahar.com
robots.txt

Robots Exclusion Standard data for davsadulshahar.com

Resource Scan

Scan Details

Site Domain davsadulshahar.com
Base Domain davsadulshahar.com
Scan Status Ok
Last Scan5/23/2025, 10:43:58 AM
Next Scan 6/22/2025, 10:43:58 AM

Last Scan

Scanned5/23/2025, 10:43:58 AM
URL https://davsadulshahar.com/robots.txt
Domain IPs 104.21.73.49, 172.67.140.152, 2606:4700:3033::6815:4931, 2606:4700:3037::ac43:8c98
Response IP 172.67.140.152
Found Yes
Hash e6a40844033673a2f34a7b86b0f4de53a07f57b984a5ab547a85ff9992611349
SimHash 4a0c58e7e796

Groups

*

Rule Path
Allow /
Disallow /biz-admin
Disallow /account

Other Records

Field Value
crawl-delay 3

*

Rule Path
Disallow /private/

facebookbot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /sensitive-data/

Other Records

Field Value
sitemap https://weboobiz.com/sitemap.xml