gwcimg.90door.com
robots.txt

Robots Exclusion Standard data for gwcimg.90door.com

Resource Scan

Scan Details

Site Domain gwcimg.90door.com
Base Domain 90door.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-13T10:51:07+00:00
Next Scan 2024-09-20T10:51:07+00:00

Last Successful Scan

Scanned2024-01-28T19:52:37+00:00
URL http://gwcimg.90door.com/robots.txt
Domain IPs 124.236.103.55, 182.131.21.252, 183.60.150.17, 240e:940:e006:4:0:5:0:b, 240e:974:e200:1405:1000:0:1:1, 240e:97d:10:1401::40f
Response IP 182.131.21.252
Found Yes
Hash 56a5012b64053f212a5f8c6e454b1eae716bc8fb81a274abfc2a873b435c3a18
SimHash 6457f90151c3

Groups

baiduspider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

googlebot-mobile

Rule Path
Disallow /

yahoo-blogs/v3.9

Rule Path
Disallow /

psbot

Rule Path
Disallow /

*

Rule Path
Disallow /

Comments

  • robots.txt generated at http://portal.qiniu.com