pannss.bdstatic.com
robots.txt

Robots Exclusion Standard data for pannss.bdstatic.com

Resource Scan

Scan Details

Site Domain pannss.bdstatic.com
Base Domain bdstatic.com
Scan Status Ok
Last Scan2024-11-09T10:10:17+00:00
Next Scan 2024-11-23T10:10:17+00:00

Last Scan

Scanned2024-11-09T10:10:17+00:00
URL https://pannss.bdstatic.com/robots.txt
Domain IPs 111.170.25.38, 111.174.9.38, 113.219.142.38, 114.232.92.38, 117.33.185.38, 117.92.139.38, 118.180.40.38, 120.41.32.38, 121.14.156.38, 123.235.31.38
Response IP 220.169.152.38
Found Yes
Hash 27a61cfac1f6b8f8b066c89060079078b27f245f3bccd484a58140e680ff4122
SimHash db45dd91658b

Groups

baiduspider

Rule Path
Disallow /enterprise/
Disallow /share/link/
Disallow /wap/link/
Disallow /share/home/
Disallow /wap/share/home/
Disallow /s/1*
Disallow /api/shorturlinfo
Disallow /share/list
Disallow /share/wxlist

baiduspider-image

Rule Path
Disallow /enterprise/
Disallow /share/link/
Disallow /wap/link/
Disallow /share/home/
Disallow /wap/share/home/
Disallow /s/1*
Disallow /api/shorturlinfo
Disallow /share/list
Disallow /share/wxlist

baiduspider-video

Rule Path
Disallow /enterprise/
Disallow /share/link/
Disallow /wap/link/
Disallow /share/home/
Disallow /wap/share/home/
Disallow /s/1*
Disallow /api/shorturlinfo
Disallow /share/list
Disallow /share/wxlist

baiduspider-news

Rule Path
Disallow /enterprise/
Disallow /share/link/
Disallow /wap/link/
Disallow /share/home/
Disallow /wap/share/home/
Disallow /s/1*
Disallow /api/shorturlinfo
Disallow /share/list
Disallow /share/wxlist

googlebot

Rule Path
Disallow /enterprise/
Disallow /share/link/
Disallow /wap/link/
Disallow /share/home/
Disallow /wap/share/home/
Disallow /s/1*
Disallow /api/shorturlinfo
Disallow /share/list
Disallow /share/wxlist

msnbot

Rule Path
Disallow /enterprise/
Disallow /share/link/
Disallow /wap/link/
Disallow /share/home/
Disallow /wap/share/home/
Disallow /s/1*
Disallow /api/shorturlinfo
Disallow /share/list
Disallow /share/wxlist

youdaobot

Rule Path
Disallow /enterprise/
Disallow /share/link/
Disallow /wap/link/
Disallow /share/home/
Disallow /wap/share/home/
Disallow /s/1*
Disallow /api/shorturlinfo
Disallow /share/list
Disallow /share/wxlist

sogou web spider

Rule Path
Disallow /enterprise/
Disallow /share/link/
Disallow /wap/link/
Disallow /share/home/
Disallow /wap/share/home/
Disallow /s/1*
Disallow /api/shorturlinfo
Disallow /share/list
Disallow /share/wxlist

sogou inst spider

Rule Path
Disallow /enterprise/
Disallow /share/link/
Disallow /wap/link/
Disallow /share/home/
Disallow /wap/share/home/
Disallow /s/1*
Disallow /api/shorturlinfo
Disallow /share/list
Disallow /share/wxlist

sogou spider2

Rule Path
Disallow /enterprise/
Disallow /share/link/
Disallow /wap/link/
Disallow /share/home/
Disallow /wap/share/home/
Disallow /s/1*
Disallow /api/shorturlinfo
Disallow /share/list
Disallow /share/wxlist

sogou blog

Rule Path
Disallow /enterprise/
Disallow /share/link/
Disallow /wap/link/
Disallow /share/home/
Disallow /wap/share/home/
Disallow /s/1*
Disallow /api/shorturlinfo
Disallow /share/list
Disallow /share/wxlist

sogou news spider

Rule Path
Disallow /enterprise/
Disallow /share/link/
Disallow /wap/link/
Disallow /share/home/
Disallow /wap/share/home/
Disallow /s/1*
Disallow /api/shorturlinfo
Disallow /share/list
Disallow /share/wxlist

sogou orion spider

Rule Path
Disallow /enterprise/
Disallow /share/link/
Disallow /wap/link/
Disallow /share/home/
Disallow /wap/share/home/
Disallow /s/1*
Disallow /api/shorturlinfo
Disallow /share/list
Disallow /share/wxlist

jikespider

Rule Path
Disallow /enterprise/
Disallow /share/link/
Disallow /wap/link/
Disallow /share/home/
Disallow /wap/share/home/
Disallow /s/1*
Disallow /api/shorturlinfo
Disallow /share/list
Disallow /share/wxlist

sosospider

Rule Path
Disallow /enterprise/
Disallow /share/link/
Disallow /wap/link/
Disallow /share/home/
Disallow /wap/share/home/
Disallow /s/1*
Disallow /api/shorturlinfo
Disallow /share/list
Disallow /share/wxlist

yisouspider

Rule Path
Disallow /

*

Rule Path
Disallow /