player.bilibili.com
robots.txt

Robots Exclusion Standard data for player.bilibili.com

Resource Scan

Scan Details

Site Domain player.bilibili.com
Base Domain bilibili.com
Scan Status Ok
Last Scan2024-05-27T19:48:48+00:00
Next Scan 2024-06-26T19:48:48+00:00

Last Scan

Scanned2024-05-27T19:48:48+00:00
URL https://player.bilibili.com/robots.txt
Domain IPs 163.181.81.231, 163.181.81.232, 163.181.81.233, 163.181.81.234, 163.181.81.235, 163.181.81.236, 163.181.81.237, 163.181.81.238
Response IP 163.181.81.231
Found Yes
Hash 23c17436e1c9604d1c337a188d23d1e483f22b8c5e4f12a5f2a56f14f5b8875f
SimHash 9c244e0227bd

Groups

*

Rule Path
Disallow /blackboard/
Disallow /live/
Disallow /main/
Disallow /tools/
Disallow /crossdomain.xml
Disallow /gameplayer.html
Disallow /html5player.html

Comments

  • 禁止爬取已废弃的文件