sdxhk.com
robots.txt

Robots Exclusion Standard data for sdxhk.com

Resource Scan

Scan Details

Site Domain sdxhk.com
Base Domain sdxhk.com
Scan Status Ok
Last Scan2024-11-02T04:05:00+00:00
Next Scan 2024-12-02T04:05:00+00:00

Last Scan

Scanned2024-11-02T04:05:00+00:00
URL http://sdxhk.com/robots.txt
Redirect http://www.sdxhk.com/robots.txt
Redirect Domain www.sdxhk.com
Redirect Base sdxhk.com
Domain IPs 104.165.233.233
Redirect IPs 104.165.233.233
Response IP 104.165.233.233
Found Yes
Hash 3bec0577bba761951663ad564cdff147a3e6b997842e854669b2f9fd162983cb
SimHash 3d45d9726113

Groups

baiduspider

Rule Path
Disallow

baiduspider-image

Rule Path
Disallow

yodaobot

Rule Path
Disallow

haosouspider

Rule Path
Disallow

toutiaospider

Rule Path
Disallow

yisouspider

Rule Path
Disallow

googlebot

Rule Path
Disallow

sogou spider

Rule Path
Disallow

sogou web spider

Rule Path
Disallow

sogou inst spider

Rule Path
Disallow

sogou spider2

Rule Path
Disallow

sogou blog

Rule Path
Disallow

sogou news spider

Rule Path
Disallow

sogou orion spider

Rule Path
Disallow

sosospider

Rule Path
Disallow

msnbot

Rule Path
Disallow

*

Rule Path
Disallow /

Warnings

  • 4 invalid lines.