Log In Sign Up

tencentcloud.com
robots.txt

Robots Exclusion Standard data for tencentcloud.com

Resource Scan

Scan Details

Site Domain tencentcloud.com
Base Domain tencentcloud.com
Scan Status Ok
Last Scan2025-06-01T23:56:41+00:00
Next Scan 2025-07-01T23:56:41+00:00

Last Scan

Scanned2025-06-01T23:56:41+00:00
URL https://tencentcloud.com/robots.txt
Redirect https://www.tencentcloud.com/robots.txt
Redirect Domain www.tencentcloud.com
Redirect Base tencentcloud.com
Domain IPs 43.156.222.125, 43.156.86.11
Redirect IPs 43.159.117.186
Response IP 43.159.117.186
Found Yes
Hash 378b599af463b3e8adeb226951211151a9cd90718d57e2d663ac5c52f159f2b6
SimHash 51209c44835b

Groups

*

No rules defined. All paths allowed.

Back to top

Comments

  • -----------------------------------------------------------------------------
  • author corazhan
  • 修改
  • fileEncoding = UTF-8
  • 禁止爬虫爬取无效URL，提升网站核心静态资源抓取及索引效率。
  • 无效URL包含:已下线产品线的URL，全动态URL，需权限验证的URL，存在问题的旧静态URL
  • 等各种无需被SE收录的URL。
  • -----------------------------------------------------------------------------
Back to top

Warnings

  • 5 invalid lines.
Back to top