bestsious.com
robots.txt

Robots Exclusion Standard data for bestsious.com

Resource Scan

Scan Details

Site Domain bestsious.com
Base Domain bestsious.com
Scan Status Ok
Last Scan2025-07-05T17:14:52+00:00
Next Scan 2025-08-04T17:14:52+00:00

Last Scan

Scanned2025-07-05T17:14:52+00:00
URL https://bestsious.com/robots.txt
Redirect https://www.bestsious.com/robots.txt
Redirect Domain www.bestsious.com
Redirect Base bestsious.com
Domain IPs 3.20.51.222
Redirect IPs 104.26.6.187, 104.26.7.187, 172.67.70.229, 2606:4700:20::681a:6bb, 2606:4700:20::681a:7bb, 2606:4700:20::ac43:46e5
Response IP 104.26.6.187
Found Yes
Hash ca10b2616706c6cb320f6145e36213faa3554ef0f771e7d22576f2e71b4e58aa
SimHash 03605e01c373

Groups

*

Rule Path
Disallow /

facebookbot

Rule Path
Allow /
Disallow /nocrawl

facebookexternalhit

Rule Path
Allow /
Disallow /nocrawl

facebookexternalhit/1.1

Rule Path
Allow /
Disallow /nocrawl

facebookexternalhit/1.0

Rule Path
Allow /
Disallow /nocrawl