video.h5.weibo.cn
robots.txt

Robots Exclusion Standard data for video.h5.weibo.cn

Resource Scan

Scan Details

Site Domain video.h5.weibo.cn
Base Domain weibo.cn
Scan Status Ok
Last Scan2024-04-29T19:37:37+00:00
Next Scan 2024-05-29T19:37:37+00:00

Last Scan

Scanned2024-04-29T19:37:37+00:00
URL https://video.h5.weibo.cn/robots.txt
Domain IPs 2400:89c0:3013:1::11:84, 2400:89c0:3013:1::11:89, 36.51.224.123, 36.51.224.126
Response IP 36.51.224.126
Found Yes
Hash 53515cc6328b3780135766f4069e31f66c7ead33a09db4591233aef42a2f903a
SimHash 4d7559746342

Groups

baiduspider

Rule Path
Disallow

googlebot

Rule Path
Disallow

sogou web spider

Rule Path
Disallow

bingbot

Rule Path
Disallow

smspider

Rule Path
Disallow

haosouspider

Rule Path
Disallow

yisouspider

Rule Path
Disallow

*

Rule Path
Disallow /

Warnings

  • 2 invalid lines.