qimg.xiaohongshu.com
robots.txt

Robots Exclusion Standard data for qimg.xiaohongshu.com

Resource Scan

Scan Details

Site Domain qimg.xiaohongshu.com
Base Domain xiaohongshu.com
Scan Status Ok
Last Scan2024-05-08T07:23:04+00:00
Next Scan 2024-06-07T07:23:04+00:00

Last Scan

Scanned2024-05-08T07:23:04+00:00
URL https://qimg.xiaohongshu.com/robots.txt
Domain IPs 23.2.16.11, 23.202.35.19, 2600:1413:b000:1e::17d1:2e48, 2600:1413:b000:1e::17d1:2e58
Response IP 184.27.123.234
Found Yes
Hash f53d329ada6ddef14db81f589076e11d54307be1bd8723bce41500b262d70bef
SimHash 6454db715377

Groups

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot

Rule Path
Allow /

yisouspider

Rule Path
Allow /

yahoo-blogs/v3.9

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

baiduspider

Rule Path
Allow /

sosospider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

*

Rule Path
Disallow /

Comments

  • robots config