bbww4.com
robots.txt

Robots Exclusion Standard data for bbww4.com

Resource Scan

Scan Details

Site Domain bbww4.com
Base Domain bbww4.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-01-16T04:28:40+00:00
Next Scan 2025-04-16T04:28:40+00:00

Last Successful Scan

Scanned2024-08-27T04:01:10+00:00
URL https://bbww4.com/robots.txt
Redirect https://www.bbww4.com/robots.txt
Redirect Domain www.bbww4.com
Redirect Base bbww4.com
Domain IPs 104.21.82.157, 172.67.158.243, 2606:4700:3031::6815:529d, 2606:4700:3035::ac43:9ef3
Redirect IPs 104.21.82.157, 172.67.158.243, 2606:4700:3031::6815:529d, 2606:4700:3035::ac43:9ef3
Response IP 172.67.158.243
Found Yes
Hash 1a644f3d5573b54742e1ceaa67c71f9f0e3c7f7742130834e83886b02dfcea94
SimHash 8a665b74a39b

Groups

*

Rule Path
Disallow

baiduspider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

huihuispider

Rule Path
Disallow /

gwdangspider

Rule Path
Disallow /

wochachaspider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogouspider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

Warnings

  • 2 invalid lines.